system

Abstract

Provide a system. 【Solution means】Means for receiving input information and converting the information into structured data, Means for receiving input information and converting the information into structured data, Means for performing tax calculations and automatically generating necessary documents based on the structured data, Means for automatically checking the compliance of the generated documents with the laws and regulations, Means for providing feedback to the user and preparing data for electronic filing, Inquiry processing means using a generation model that responds to the user's questions in real time, Support means for aggregating the user's settlement history and sorting it by category, Means for automatically extracting and classifying transaction information required for electronic filing, A system including the above.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The process of final tax return is complicated and time-consuming for many sole proprietors, freelancers, and small business operators. Especially when multiple income sources and expense management are required, there is a high possibility of errors and omissions. In addition, due to the complexity of the tax law, it is difficult to confirm whether the declared content complies with the law correctly. Moreover, it is necessary to support the electronic filing format, which requires a lot of labor and expertise. Under such circumstances, the development of a support system that enables efficient and accurate tax filing is required.

Means for Solving the Problems

[0005] This invention provides a means for receiving input information and rapidly converting it into structured data. It then has the functionality to perform tax calculations based on that data and automatically generate the necessary tax documents. Furthermore, the generated documents are automatically checked for legal compliance, allowing users to submit tax returns without errors. It also uses a generative model that responds to user questions in real time, providing quick and accurate feedback. This enables the smooth progress of complex tax procedures and allows the system to centrally support the preparation of data for electronic filing.

[0006] "Input information" refers to detailed revenue and expense data that users provide to the system.

[0007] "Structured data" refers to data that is organized into a unified format or category.

[0008] "Tax calculation" refers to the process of calculating appropriate taxable income and tax amount by subtracting expenses from income.

[0009] "Automatic document generation" refers to a system automatically creating necessary tax documents based on calculation results.

[0010] "Compliance checks" refer to the automatic verification of whether the generated documents conform to current tax laws.

[0011] "Feedback" refers to information and suggestions provided by a system to the user.

[0012] "Data for electronic filing" refers to information that has been converted into a data format necessary for filing tax returns online.

[0013] A "generative model" refers to a type of AI that provides appropriate answers and information in real time in response to input data or questions.

[0014] "Inquiry processing means" refers to the function that allows the system to respond to questions and inquiries from users. [Brief explanation of the drawing]

[0015] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, when an emotion engine is combined. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined.

Embodiments for Carrying Out the Invention

[0016] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a processor with a reference number (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0019] In the following embodiments, a RAM (Random Access Memory) with a reference number is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0020] In the following embodiments, a storage with a reference number is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0021] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0023] [First Embodiment]

[0024] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0025] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0028] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0031] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0035] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0036] This invention is a system that supports efficient and accurate tax filing, and mainly consists of a server, terminals, and user operations. The system aims to input the user's tax information, process that information automatically, and ultimately complete the electronic filing.

[0037] First, the user uses a terminal to input their income and expenses. For example, the user can input detailed information such as being a freelancer and having income that varies from project to project. The terminal then sends this data to the server.

[0038] Next, the server structures the received data, categorizes expenses and income, and performs tax calculations according to tax laws. These calculations include, for example, detailed tax calculations based on the type of income and the attributes of expenses. Once the calculations are complete, the server automatically generates the necessary tax documents.

[0039] The generated documents are automatically checked for legal compliance by the server, and if there are any problems, feedback is provided to the user. The user can then make the necessary corrections from their device based on this feedback.

[0040] Furthermore, the server uses a generative AI model to respond to user questions in real time. For example, if a user asks, "Is a specific expense deductible?", the server will immediately provide an answer based on appropriate guidelines.

[0041] Finally, once all documents and data are complete, the server converts them into a format compatible with the electronic filing system. The user then performs a final check of this data via their terminal and officially completes the filing process.

[0042] Thus, the present invention integrates the entire process from collecting input information, structuring data, generating and checking documents, to electronic filing, enabling users to file tax returns more efficiently and reliably. Specifically, it can support a designer user in classifying their annual income by project, inputting corresponding expenses, and ultimately filing an accurate tax return.

[0043] The following describes the processing flow.

[0044] Step 1:

[0045] Users enter their income and expense information into the terminal. This information includes the amount of income, its source, and the type and amount of expenses. This input is guided to ensure that users provide reliable data.

[0046] Step 2:

[0047] The terminal sends the data entered by the user to the server. This transmission is performed using a secure communication protocol, ensuring the confidentiality of the information.

[0048] Step 3:

[0049] The server analyzes the received data and categorizes income and expenses accordingly. Income is separated by source, and expenses are categorized by type. This structures the data, enabling accurate tax calculations.

[0050] Step 4:

[0051] The server performs tax calculations based on the classified data. Here, applicable expenses are deducted from each income to determine the taxable amount. Based on the calculation results, the necessary tax return documents (e.g., Income Tax Return Form B) are automatically generated.

[0052] Step 5:

[0053] The server checks whether the generated documents comply with the latest tax laws. This check verifies legal compliance, and if there are any errors, the user is immediately provided with feedback for correction.

[0054] Step 6:

[0055] Users can review feedback from the server via their devices and make necessary corrections. This improves the accuracy of their declarations.

[0056] Step 7:

[0057] If a user has questions about the information they have provided, they can send an inquiry to the server via their device. The server uses an AI model to answer the user's questions in real time. This service aims to quickly resolve any ambiguities the user may have.

[0058] Step 8:

[0059] Once all data and documents have been verified and are in order, the server converts them into a format for electronic filing. The converted data is used in the final step of the filing process.

[0060] Step 9:

[0061] The user reviews the final declaration details on their device and performs the "Submit" action to complete the electronic filing process. This action causes the server to send the declaration details to the tax authority's electronic filing system.

[0062] Step 10:

[0063] The server confirms that the declaration has been successfully received and sends a completion notification to the user via the terminal. This allows the user to confirm that the declaration has been officially completed.

[0064] (Example 1)

[0065] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0066] Tax filing requires accurately digitizing income and expense information, performing calculations in accordance with the latest laws and regulations, and preparing appropriate documents. However, these processes are time-consuming and laborious, and checking for legal compliance in particular requires specialized knowledge, making errors common. Furthermore, there is a lack of systems that can immediately respond to users' questions that arise in real time. These challenges place a significant burden on sole proprietors and small and medium-sized enterprises in particular.

[0067] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0068] In this invention, the server includes means for converting input information into a data structure, means for performing financial calculations and automatically generating necessary documents, and means for automatically checking legal compliance. This enables the rapid and accurate processing of user data and the creation of documents that comply with the law. Furthermore, by enabling real-time question answering, users can proceed with tax filing with peace of mind.

[0069] "Input information" refers to data such as details of income and expenses provided by the user.

[0070] A "data structure" is a method of systematically organizing input information and converting it into a format suitable for computation and document generation.

[0071] "Financial calculation" refers to the process of calculating tax amounts based on income and expense data.

[0072] A "document" refers to a document or report containing information necessary for filing a tax return.

[0073] "Legal compliance" refers to the characteristic of ensuring that generated documents and data conform to current laws and regulations.

[0074] "Confirmation information" refers to feedback provided by the server to the user, prompting them to correct or add to the input information.

[0075] "Real-time" refers to the temporal characteristic of providing information in an immediate response to user requests.

[0076] A "generative model" is an artificial intelligence technology that generates appropriate answers in response to inquiries from users.

[0077] A "user" is an individual or organization that uses the system to perform tax filing tasks.

[0078] An "information processing device" is an electronic device used to transmit and receive data.

[0079] "Encryption" is an information transformation process performed to protect data.

[0080] This invention is a system for simplifying tax filing procedures, operating primarily through the interaction of a server, terminals, and users. The system aims to efficiently process input tax-related data and generate legally compliant documents. Specific embodiments of this system are described below.

[0081] Users first use a terminal to input their income and expense information. This information includes income sources and receipts that vary for each project. Accuracy of the information entered by users is essential for the system's success.

[0082] The terminal is responsible for sending information entered by the user to the server. To ensure data security, the terminal encrypts the communication content. For example, the TLS protocol can be used.

[0083] The server uses the Python Pandas library to convert received data into data structures. It also uses NumPy to perform financial calculations and calculate accurate tax amounts based on income and expenses. When generating necessary documents based on calculations in accordance with tax laws, the server uses the ReportLab library to generate documents in PDF format.

[0084] The generated documents are automatically checked for legal compliance. At this stage, a Python script is used with a rule-based checklist to verify that the documents meet legal requirements.

[0085] Furthermore, the server uses a generative AI model to provide real-time question-and-answer functionality. When a user asks a prompt such as, "Can I claim this specific expense?", the server provides an immediate answer based on appropriate guidelines.

[0086] Finally, the server converts the completed documents and data into a format suitable for the electronic filing system. The user can then review the data via their terminal and complete the electronic filing. This streamlines the entire filing process and enables users to file their tax returns accurately.

[0087] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0088] Step 1:

[0089] The user uses a terminal to input information related to income and expenses. The input data includes detailed income and expense information for each project. Specifically, the user enters information into input fields on the interface and confirms the data by pressing a confirmation button. The output of the process is the raw data entered by the user.

[0090] Step 2:

[0091] The terminal sends the data entered by the user to the server. To maintain data security, the terminal encrypts the data before transmission. Specifically, this process involves converting the data into packets using a secure communication method utilizing the TLS protocol and sending them to the server. The output of this process is the encrypted data received by the server.

[0092] Step 3:

[0093] The server decrypts the encrypted data received from the terminal and converts it into a data structure. The server uses the Python Pandas library to organize the received data into a data frame. Specifically, it maps each data item to its corresponding field and classifies income and expenses into their respective categories. The output of the process is a structured data frame.

[0094] Step 4:

[0095] The server performs tax calculations based on structured data. It uses the NumPy library to calculate the accurate tax amount from income and expenses. Specifically, it calculates the tax amount by applying the tax rate to the income. The output of the process is the calculated tax information.

[0096] Step 5:

[0097] The server automatically generates the necessary documents based on the calculation results. Using the ReportLab library, it creates PDF documents for tax filing. Specifically, it generates documents containing a table and explanatory text detailing the calculated tax amount. The output of the process is a completed PDF document.

[0098] Step 6:

[0099] The server checks the legal compliance of the generated documents. It uses a Python script to run a rule-based checklist to verify that the documents conform to the law. Specifically, it performs a process of cross-referencing with an existing legal dataset. The output of this process is the compliance verification result.

[0100] Step 7:

[0101] The server responds to user inquiries using a generative AI model. For example, if a user enters the prompt "Is this expense approved?", the server will refer to relevant guidelines and quickly generate an answer. Specifically, this involves the generative AI querying a rules database and providing the appropriate information. The output of this process is the response to the user.

[0102] Step 8:

[0103] The server converts the final completed documents and data into a format compatible with the electronic filing system. The server uses a dedicated API to convert the data format to a suitable format. Specifically, it reconstructs each data item to match the electronic filing format. The output of this process is a data file compatible with the electronic filing system.

[0104] Step 9:

[0105] The user uses their terminal to perform a final check of the data required for electronic filing, and if there are no changes, completes the filing. Specific actions include previewing the data on the terminal screen and pressing the submit button to complete the final submission. The output of the process is the status of filing completion.

[0106] (Application Example 1)

[0107] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0108] In today's world of widespread electronic payments, there is a need to efficiently utilize information obtained from everyday transactions conducted by individuals and businesses to enable accurate and convenient tax filing. However, current systems make it difficult to manage this information comprehensively and automate the process in a manner compliant with the law. Furthermore, there is a lack of mechanisms to quickly obtain answers when users have questions, which contributes to the problem of the tax filing process being easily complicated.

[0109] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0110] In this invention, the server includes means for receiving input information and converting that information into structured data, means for performing tax calculations and automatically generating necessary documents, and support means for aggregating the user's payment history and organizing it by category. This enables the user to effectively utilize data obtained from electronic payments and file tax returns efficiently in compliance with the law. Furthermore, by responding to inquiries in real time, questions that arise during the filing process can be resolved quickly.

[0111] "Input information" refers to data on income and expenses provided by the user.

[0112] "Structured data" refers to data in which input information is organized according to categories and formats.

[0113] "Tax calculation" is the process of calculating the amount of tax using income and expense data in accordance with tax laws.

[0114] "Documents" refers to official documents required for tax filing.

[0115] "Legal compliance" means that the generated documents and data conform to current laws and regulations.

[0116] "Feedback" refers to information provided to users for verification and improvement.

[0117] "Real-time response" refers to providing instant answers to user inquiries.

[0118] A "generative model" is an algorithm that uses artificial intelligence technology to generate appropriate answers to inquiries.

[0119] "Inquiry processing" is a function that responds to questions and requests from users.

[0120] "Settlement history" refers to a record of financial transactions conducted by a user.

[0121] "Support for organizing by category" refers to the process of aggregating and classifying payment history based on its type and purpose.

[0122] "Automatic extraction of transaction information" is a technology that automatically identifies and extracts information necessary for tax filing from payment history.

[0123] The system for implementing this invention consists of the interaction of a server, a terminal, and a user. The user uses the terminal to input their income and expenses. The terminal receives this input information, converts it into structured data, and sends it to the server.

[0124] The server performs tax calculations based on the received structured data and automatically generates the necessary documents. This includes detailed calculations based on tax laws and automatic checks for compliance with the generated documents. The server also aggregates the user's payment history and provides support for organizing expenses and income by category. This makes it possible to quickly extract and classify the transaction information necessary for electronic filing.

[0125] Furthermore, the server has the capability to respond to user inquiries in real time using a generative AI model. This means that users can receive quick and accurate support whenever they have questions. Specifically, inquiries can be made using prompt sentences, and the server will provide answers based on appropriate guidance.

[0126] The hardware used includes devices such as smartphones and desktop computers, and Firebase Firestore is used as the database management system. For AI-powered natural language processing, technologies such as TENSORFLOW® and BERT are used. AWS® Lambda is a suitable cloud service.

[0127] For example, when a user sends a question to the server such as, "Is this transaction eligible as an expense?", the server uses an AI model to analyze the transaction and provides specific guidelines in real time, such as, "If it is a purchase related to business operations, it may be considered."

[0128] An example of a prompt to a generative AI model is: "For the expense information entered by the user, please answer the question, 'Is this expense tax-deductible?'"

[0129] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0130] Step 1:

[0131] Users enter income and expense data using a terminal. This includes individual transactions and general expense information. The entered data is converted to a specific format on the terminal and prepared for transmission to the database.

[0132] Step 2:

[0133] The terminal converts the input information into structured data and sends it to the server. This structured data is organized by category and designed to clearly distinguish between income and expense items. This data is sent to the server in JSON format and used for analysis.

[0134] Step 3:

[0135] The server analyzes the received data and performs tax calculations based on the rules of the applicable tax laws. This includes calculating total income, deductible expenses, and the final tax amount. The calculation results are recorded internally and used in subsequent document generation processes.

[0136] Step 4:

[0137] The server automatically generates the necessary tax documents based on the analysis results. This includes creating documents in a legally compliant format, along with detailed calculation results. The generated documents are stored in a database and made available for user review.

[0138] Step 5:

[0139] The server checks the legal compliance of the generated documents. This process compares the generated data with the established tax law standards to check for errors or deficiencies. If necessary, data is prepared for sending feedback to the user.

[0140] Step 6:

[0141] In response to user inquiries, the server uses a generative AI model to create a response. Specifically, when a user submits a question through a prompt, the AI ​​refers to the input data and generates the optimal answer. This answer is then sent to the terminal immediately, based on natural language processing technology.

[0142] Step 7:

[0143] The server converts the finalized tax data into a format compatible with the electronic filing system. This process integrates documents and data, and performs data conversion according to the file formats and protocols required for electronic filing. The converted data is then displayed on the user's terminal for final confirmation.

[0144] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0145] This invention is a system for assisting with tax filing, providing more personalized support to users by combining it with an emotion engine that recognizes user emotions. The system functions through interaction between a server, a terminal, and the user.

[0146] In this system, users input income and expense details using a terminal. Since this information forms the basis of the system's processing, clear guidelines are provided for input. The terminal then transmits the entered data to the server.

[0147] The server structures the data, performs tax calculations based on it, and automatically generates the necessary documents. Furthermore, it performs legal checks and provides timely feedback to the user. This feedback is crucial for improving the accuracy of the user's tax filing activities.

[0148] A key feature of this invention is that the server incorporates an emotion engine. The emotion engine detects the user's stress and anxiety and generates feedback based on these. For example, if the user shows signs of stress during input, the engine generates and sends a relaxing message. This function reduces the user's mental burden and supports a smooth reporting process.

[0149] Furthermore, the server has the capability to respond to user questions in real time. Here, the emotion engine grasps the emotional nuances of the question and provides an answer in an appropriate tone. For example, an anxious question will receive a reassuring response.

[0150] In the final stage, the server converts all necessary documents into an electronic filing format and prompts the user to make a final confirmation of the filing. The user then completes the filing process using their terminal. By streamlining this entire process, the system provides a higher quality user experience.

[0151] For example, when a sole proprietor has to settle many expenses at the end of the fiscal year, the emotional engine's support can reduce stress and allow them to complete their tax filing quickly and accurately. In this process, users can enter data with confidence and resolve any questions immediately.

[0152] The following describes the processing flow.

[0153] Step 1:

[0154] The user uses the terminal to enter income and expense details. During this process, the user is prompted to follow the terminal's guide and enter more accurate data.

[0155] Step 2:

[0156] The terminal sends the input information to the server. The transmitted information includes the necessary fields for processing as structured data.

[0157] Step 3:

[0158] The server analyzes the received information and categorizes income and expenses appropriately. This categorization makes the data easier to process.

[0159] Step 4:

[0160] The server performs tax calculations based on the categorized data. This calculation accurately reflects all income and expenses, and determines the tax amount relevant to the user.

[0161] Step 5:

[0162] The server automatically generates the necessary tax documents, saving users the trouble of tedious paperwork.

[0163] Step 6:

[0164] The server automatically checks whether the generated documents comply with the law. This process helps prevent errors during filing.

[0165] Step 7:

[0166] The server uses an emotion engine to analyze user input and responses. For example, it analyzes input time and key typing speed to detect if the user may be experiencing stress.

[0167] Step 8:

[0168] The server provides feedback to the user based on the results of the sentiment analysis. This feedback may include reassuring messages or advice to help the user proceed smoothly.

[0169] Step 9:

[0170] Users can check feedback from the server on their devices and make corrections as needed. This allows users to confidently move on to the next step.

[0171] Step 10:

[0172] Once all the documents are ready, the server converts the data into an electronic filing format.

[0173] Step 11:

[0174] The user performs a final check and submits the electronic filing from their terminal. This action transmits the tax return to the tax authority's system.

[0175] Step 12:

[0176] The server confirms receipt of the declaration and terminates the declaration process by sending a completion notification to the user via the terminal.

[0177] (Example 2)

[0178] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0179] Current tax filing support systems only structure user-entered data, perform tax calculations, and automatically generate documents, making it difficult to provide support that addresses the user's emotional state. Furthermore, deficiencies in compliance checks and real-time responses to questions can increase the user's mental burden and potentially delay the filing process.

[0180] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0181] In this invention, the server includes means for structuring input information, means for performing calculations and automatically generating necessary information, means for automatically verifying legal compliance, means for responding to questions in real time using a generative model, and means for adjusting feedback according to the user's mental state using emotion recognition technology. This enables a smooth and legally compliant tax filing process while providing support tailored to the user's individual emotional state.

[0182] "Input information" refers to data about transactions and expenses provided by the user.

[0183] "Structuring" refers to the process of organizing received information into a certain format or style, making it easier to process.

[0184] A "generative model" refers to an algorithm or system that creates optimal feedback or responses based on input data and the user's state.

[0185] "Legal compliance" refers to the state in which the information or data created conforms to the relevant laws and regulations.

[0186] "Feedback" refers to advice and suggestions for improvement provided to users, and is used to enhance the user experience.

[0187] "Real-time response" refers to the process of providing immediate answers to user questions and inquiries.

[0188] "Emotion recognition technology" refers to methods for inferring a user's emotional state from their digital behavior and input data, and determining appropriate responses.

[0189] This invention is a system for assisting with tax filing and has the ability to recognize user emotions. This allows it to provide personalized support to the user.

[0190] Users use a terminal to enter detailed data about their transactions and expenses for the year. This terminal refers to a general computer or mobile device, and the interface is provided through a web browser or a dedicated application. The entered information is encrypted according to a predetermined security protocol and sent to the server.

[0191] The server structures the received data using specialized software. This organizes the data and puts it in a format suitable for processing by computations and generative models. This process incorporates algorithms that refer to the latest tax law database, automatically verifying that the generated data complies with the law.

[0192] The server also features a generative AI model that uses prompt messages to respond to user inquiries in real time. For example, a prompt message might ask, "Are there any points to be careful about when entering this month's expenses?" By using emotion recognition technology, the system estimates the user's stress level based on input speed and error rate, and sends messages to encourage relaxation as needed.

[0193] This allows users to continue their tax filing process with peace of mind, and any questions are answered immediately. As a result, it becomes possible to complete tax filing accurately and quickly while reducing stress.

[0194] This system is designed to make tax filing more efficient for sole proprietors and small and medium-sized enterprises, and its adaptability and accuracy are expected to lead to widespread use in many fields.

[0195] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0196] Step 1:

[0197] Users enter transaction and expense details using a terminal. The input interface is provided via a web browser or a dedicated application, and users enter each income and expense item according to the guidelines. This input data becomes the initial input to the system. The entered information is encrypted and sent to the server via a communication protocol.

[0198] Step 2:

[0199] The terminal uses the SSL / TLS protocol to ensure data security when sending entered information to the server. It checks the integrity of the transmitted data, verifying that there are no missing or incorrect entries. If the data is valid, it is forwarded to the server.

[0200] Step 3:

[0201] The server structures the received data using specialized software. The data is normalized and converted into a format that can be stored in the database. Data cleansing is applied to correct unnecessary whitespace and inconsistent data. This results in the output of normalized structured data.

[0202] Step 4:

[0203] The server performs calculations using structured data. This process utilizes tax-based calculation algorithms to calculate income tax and expense deductions. As a result of the calculations, the necessary tax documents are automatically generated and output.

[0204] Step 5:

[0205] The server verifies the legal compliance of the generated documents. It consults relevant legal databases to check if the content is appropriate. Based on the verification results, it generates feedback for the user. This feedback is sent to the user's terminal in a format that the user can review.

[0206] Step 6:

[0207] The server uses a generative AI model to respond to user questions in real time. When a user submits a question, an appropriate answer is generated using a prompt. Emotion recognition technology is used to provide feedback in a tone that matches the user's emotional state.

[0208] Step 7:

[0209] The server converts the final data into an electronic filing format and requests the user for final confirmation. The user reviews the content on their terminal and presses the approval button, at which point the data is securely transmitted to the tax authorities. This is the system's final output.

[0210] (Application Example 2)

[0211] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0212] The goal is to reduce the stress and anxiety users experience when filing financial statements or making electronic payments, and to provide a smoother and more secure process.

[0213] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0214] In this invention, the server includes means for receiving input information and converting that information into structured data, means for performing financial calculations and automatically generating necessary documents, and means for analyzing the user's emotional state in real time and providing support. This allows the user to proceed with procedures quickly and accurately while feeling secure.

[0215] "Input information" refers to detailed data about income and expenses that users provide when performing a procedure.

[0216] "Structured data" refers to data that has been transformed into a unified format based on input information, making it easier to analyze and process.

[0217] "Financial calculation" refers to the process of performing necessary financial calculations based on structured data and preparing appropriate financial statements.

[0218] A "document" is an official document that contains information necessary for procedures or declarations.

[0219] "Compliance with regulations" refers to the standard used to ensure that generated documents and procedures properly adhere to relevant laws and regulations.

[0220] "Feedback" refers to the provision of information that allows users to receive feedback on the accuracy of procedures and suggestions for improvement during the process.

[0221] "Data for electronic submission" refers to a dataset prepared for electronic application and reporting.

[0222] A "generative model" is an artificial intelligence-based program or algorithm used to create appropriate responses to user inquiries in real time.

[0223] "Emotional state" refers to the psychological conditions, such as stress and anxiety, that a user exhibits during the process.

[0224] "Providing support" means offering technical and psychological assistance to users so that they can proceed with the process smoothly.

[0225] This invention is implemented by a system in which a server, terminal, and user work together. The server receives input information provided by the user and converts it into structured data. In this process, the user directly inputs data using a terminal such as a smartphone or computer. The structured data is stored in a well-known database system such as MySQL® or PostgreSQL.

[0226] The server then performs financial calculations based on the structured data and automatically generates the necessary documents. This calculation process is carried out using programming languages ​​such as Python and R, and data analysis libraries such as NumPy and Pandas. The generated documents are converted to PDF format using Adobe PDF Library or similar services and provided to the user for review.

[0227] The server then automatically checks for compliance with legal regulations. This uses rule engines such as Drools or OpenRules. Feedback is provided to the user in real time, and data for electronic submission is prepared.

[0228] The server is equipped with sentiment analysis models using Google® Cloud Vision and Amazon Rekognition. This allows it to analyze the user's emotional state and provide appropriate support. When stress or anxiety is detected in the user, automatically generated calming messages are sent to the user's device.

[0229] As a concrete example, when a user makes a large online payment, the terminal's camera captures the user's facial expression, which is then analyzed by a server. If the user expresses concern, a reassuring message is displayed, such as, "This seller has achieved 100% customer satisfaction in the past 100 transactions."

[0230] An example of a prompt message generated using an AI model is: "The user is feeling uneasy on the payment screen. Please suggest ways to reassure them using past successful transaction data." This allows the user to proceed with the transaction with confidence.

[0231] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0232] Step 1:

[0233] Users use a terminal to enter details about their income and expenses. The input data is organized by field and sent from the terminal to the server. This allows the server to receive the input information to create structured data.

[0234] Step 2:

[0235] The server converts the received input information into structured data. Here, a database system (such as MySQL or PostgreSQL) is used to systematically store the data and format it for easier use in subsequent processing. The output of this process forms the dataset that underlies financial calculations.

[0236] Step 3:

[0237] The server performs financial calculations using structured data. It uses programming languages ​​such as Python and R, along with data analysis libraries like NumPy and Pandas, to calculate necessary financial indicators. The results of these calculations generate financial documents to be presented to the user, and these documents are converted to PDF format using Adobe PDF Library or similar tools.

[0238] Step 4:

[0239] The server verifies the compliance of the generated documents. This is done using rule engines such as Drools or OpenRules. The input is laws and regulations, and the output is a compliance status report.

[0240] Step 5:

[0241] The server analyzes the user's emotional state in real time. It analyzes facial image data acquired from the device's camera using APIs such as Google Cloud Vision and Amazon Rekognition. If user stress or anxiety is detected, a support message is automatically generated and sent to the user based on the results.

[0242] Step 6:

[0243] The server sends prompt sentences based on the sentiment analysis results to an AI model that generates appropriate feedback messages. For example, a prompt such as "The user is feeling anxious on the payment screen. Use past successful transaction data to suggest ways to reassure them" might be used. The output would be a specific message designed to alleviate the user's anxiety.

[0244] Step 7:

[0245] Users review the data for electronic submission via their terminal and then perform the final submission operation. This completes the entire process, enabling smooth tax filing and settlement.

[0246] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0247] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0248] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0249] [Second Embodiment]

[0250] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0251] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0252] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0253] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0254] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0255] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0256] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0257] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0258] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0259] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0260] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0261] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0262] This invention is a system that supports efficient and accurate tax filing, and mainly consists of a server, terminals, and user operations. The system aims to input the user's tax information, process that information automatically, and ultimately complete the electronic filing.

[0263] First, the user uses a terminal to input their income and expenses. For example, the user can input detailed information such as being a freelancer and having income that varies from project to project. The terminal then sends this data to the server.

[0264] Next, the server structures the received data, categorizes expenses and income, and performs tax calculations according to tax laws. These calculations include, for example, detailed tax calculations based on the type of income and the attributes of expenses. Once the calculations are complete, the server automatically generates the necessary tax documents.

[0265] The generated documents are automatically checked for legal compliance by the server, and if there are any problems, feedback is provided to the user. The user can then make the necessary corrections from their device based on this feedback.

[0266] Furthermore, the server uses a generative AI model to respond to user questions in real time. For example, if a user asks, "Is a specific expense deductible?", the server will immediately provide an answer based on appropriate guidelines.

[0267] Finally, once all documents and data are complete, the server converts them into a format compatible with the electronic filing system. The user then performs a final check of this data via their terminal and officially completes the filing process.

[0268] Thus, the present invention integrates the entire process from collecting input information, structuring data, generating and checking documents, to electronic filing, enabling users to file tax returns more efficiently and reliably. Specifically, it can support a designer user in classifying their annual income by project, inputting corresponding expenses, and ultimately filing an accurate tax return.

[0269] The following describes the processing flow.

[0270] Step 1:

[0271] Users enter their income and expense information into the terminal. This information includes the amount of income, its source, and the type and amount of expenses. This input is guided to ensure that users provide reliable data.

[0272] Step 2:

[0273] The terminal sends the data entered by the user to the server. This transmission is performed using a secure communication protocol, ensuring the confidentiality of the information.

[0274] Step 3:

[0275] The server analyzes the received data and categorizes income and expenses accordingly. Income is separated by source, and expenses are categorized by type. This structures the data, enabling accurate tax calculations.

[0276] Step 4:

[0277] The server performs tax calculations based on the classified data. Here, applicable expenses are deducted from each income to determine the taxable amount. Based on the calculation results, the necessary tax return documents (e.g., Income Tax Return Form B) are automatically generated.

[0278] Step 5:

[0279] The server checks whether the generated documents comply with the latest tax laws. This check verifies legal compliance, and if there are any errors, the user is immediately provided with feedback for correction.

[0280] Step 6:

[0281] Users can review feedback from the server via their devices and make necessary corrections. This improves the accuracy of their declarations.

[0282] Step 7:

[0283] If a user has questions about the information they have provided, they can send an inquiry to the server via their device. The server uses an AI model to answer the user's questions in real time. This service aims to quickly resolve any ambiguities the user may have.

[0284] Step 8:

[0285] When all data and documents have been confirmed and are in order, the server converts this into the format for e-filing. The converted data is used in the final step of the filing process.

[0286] Step 9:

[0287] The user checks the final filing details on the terminal and performs the "File" operation to complete the e-filing procedure. By this operation, the server transmits the filing details to the e-filing system of the tax authority.

[0288] Step 10:

[0289] The server confirms that the filing has been successfully received and sends a completion notice to the user via the terminal. The user can thus confirm that the filing has been formally completed.

[0290] (Example 1)

[0291] Next, Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal".

[0292] In tax filing, it is required to accurately digitize income and expense information, perform calculations in accordance with the latest laws and regulations, and create appropriate documents. However, these processes require a lot of effort and time, and especially the check for compliance with laws and regulations requires specialized knowledge, so errors are likely to occur. Also, there is a lack of a mechanism that can immediately respond to questions that users have in real time. These issues are a particularly heavy burden for sole proprietors and small and medium-sized enterprises.

[0293] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 1 is realized by the following respective means.

[0294] In this invention, the server includes means for converting input information into a data structure, means for performing financial calculations and automatically generating necessary documents, and means for automatically checking legal compliance. This enables the rapid and accurate processing of user data and the creation of documents that comply with the law. Furthermore, by enabling real-time question answering, users can proceed with tax filing with peace of mind.

[0295] "Input information" refers to data such as details of income and expenses provided by the user.

[0296] A "data structure" is a method of systematically organizing input information and converting it into a format suitable for computation and document generation.

[0297] "Financial calculation" refers to the process of calculating tax amounts based on income and expense data.

[0298] A "document" refers to a document or report containing information necessary for filing a tax return.

[0299] "Legal compliance" refers to the characteristic of ensuring that generated documents and data conform to current laws and regulations.

[0300] "Confirmation information" refers to feedback provided by the server to the user, prompting them to correct or add to the input information.

[0301] "Real-time" refers to the temporal characteristic of providing information in an immediate response to user requests.

[0302] A "generative model" is an artificial intelligence technology that generates appropriate answers in response to inquiries from users.

[0303] A "user" is an individual or organization that uses the system to perform tax filing tasks.

[0304] An "information processing device" is an electronic device used to transmit and receive data.

[0305] "Encryption" is an information conversion process performed to protect data.

[0306] This invention is a system for facilitating tax filing procedures and mainly operates through the interaction of a server, a terminal, and a user. The system aims to efficiently process the input tax-related data and generate documents compliant with the laws. The following will explain specific embodiments of this system.

[0307] First, the user uses the terminal to input information about their income and expenses. This information includes different income sources and receipts for each project. Also, the accuracy of the information input by the user is essential for the success of the system.

[0308] The terminal is responsible for sending the information input by the user to the server. At this time, to ensure the security of the data, the terminal encrypts the communication content. For example, it is conceivable to use the TLS protocol.

[0309] The server uses the Pandas library of Python to convert the received data into a data structure. Also, it uses NumPy to perform financial calculations and calculates the accurate tax amount based on income and expenses. When generating the necessary documents through calculations according to the tax law, the server uses the ReportLab library to generate documents in PDF format.

[0310] For the generated documents, automatic compliance checks with the laws are performed. At this stage, Python scripts are used to use a checklist according to the rules to check whether the documents meet the legal requirements.

[0311] Furthermore, the server uses a generative AI model to perform real-time question answering. When the user asks a question such as the prompt sentence "Can this specific expense be recorded?", the server immediately provides an answer based on appropriate guidelines.

[0312] Finally, the server converts the completed documents and data into a format suitable for the electronic filing system. The user can then review the data via their terminal and complete the electronic filing. This streamlines the entire filing process and enables users to file their tax returns accurately.

[0313] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0314] Step 1:

[0315] The user uses a terminal to input information related to income and expenses. The input data includes detailed income and expense information for each project. Specifically, the user enters information into input fields on the interface and confirms the data by pressing a confirmation button. The output of the process is the raw data entered by the user.

[0316] Step 2:

[0317] The terminal sends the data entered by the user to the server. To maintain data security, the terminal encrypts the data before transmission. Specifically, this process involves converting the data into packets using a secure communication method utilizing the TLS protocol and sending them to the server. The output of this process is the encrypted data received by the server.

[0318] Step 3:

[0319] The server decrypts the encrypted data received from the terminal and converts it into a data structure. The server uses the Python Pandas library to organize the received data into a data frame. Specifically, it maps each data item to its corresponding field and classifies income and expenses into their respective categories. The output of the process is a structured data frame.

[0320] Step 4:

[0321] The server performs tax calculations based on structured data. It uses the NumPy library to calculate the accurate tax amount from income and expenses. Specifically, it calculates the tax amount by applying the tax rate to the income. The output of the process is the calculated tax information.

[0322] Step 5:

[0323] The server automatically generates the necessary documents based on the calculation results. Using the ReportLab library, it creates PDF documents for tax filing. Specifically, it generates documents containing a table and explanatory text detailing the calculated tax amount. The output of the process is a completed PDF document.

[0324] Step 6:

[0325] The server checks the legal compliance of the generated documents. It uses a Python script to run a rule-based checklist to verify that the documents conform to the law. Specifically, it performs a process of cross-referencing with an existing legal dataset. The output of this process is the compliance verification result.

[0326] Step 7:

[0327] The server responds to user inquiries using a generative AI model. For example, if a user enters the prompt "Is this expense approved?", the server will refer to relevant guidelines and quickly generate an answer. Specifically, this involves the generative AI querying a rules database and providing the appropriate information. The output of this process is the response to the user.

[0328] Step 8:

[0329] The server converts the final completed documents and data into a format compatible with the electronic filing system. The server uses a dedicated API to convert the data format to a suitable format. Specifically, it reconstructs each data item to match the electronic filing format. The output of this process is a data file compatible with the electronic filing system.

[0330] Step 9:

[0331] The user uses their terminal to perform a final check of the data required for electronic filing, and if there are no changes, completes the filing. Specific actions include previewing the data on the terminal screen and pressing the submit button to complete the final submission. The output of the process is the status of filing completion.

[0332] (Application Example 1)

[0333] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0334] In today's world of widespread electronic payments, there is a need to efficiently utilize information obtained from everyday transactions conducted by individuals and businesses to enable accurate and convenient tax filing. However, current systems make it difficult to manage this information comprehensively and automate the process in a manner compliant with the law. Furthermore, there is a lack of mechanisms to quickly obtain answers when users have questions, which contributes to the problem of the tax filing process being easily complicated.

[0335] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0336] In this invention, the server includes means for receiving input information and converting that information into structured data, means for performing tax calculations and automatically generating necessary documents, and support means for aggregating the user's payment history and organizing it by category. This enables the user to effectively utilize data obtained from electronic payments and file tax returns efficiently in compliance with the law. Furthermore, by responding to inquiries in real time, questions that arise during the filing process can be resolved quickly.

[0337] "Input information" refers to data on income and expenses provided by the user.

[0338] "Structured data" refers to data in which input information is organized according to categories and formats.

[0339] "Tax calculation" is the process of calculating the amount of tax using income and expense data in accordance with tax laws.

[0340] "Documents" refers to official documents required for tax filing.

[0341] "Legal compliance" means that the generated documents and data conform to current laws and regulations.

[0342] "Feedback" refers to information provided to users for verification and improvement.

[0343] "Real-time response" refers to providing instant answers to user inquiries.

[0344] A "generative model" is an algorithm that uses artificial intelligence technology to generate appropriate answers to inquiries.

[0345] "Inquiry processing" is a function that responds to questions and requests from users.

[0346] "Settlement history" refers to a record of financial transactions conducted by a user.

[0347] "Support for organizing by category" refers to the process of aggregating and classifying payment history based on its type and purpose.

[0348] "Automatic extraction of transaction information" is a technology that automatically identifies and extracts information necessary for tax filing from payment history.

[0349] The system for implementing this invention consists of the interaction of a server, a terminal, and a user. The user uses the terminal to input their income and expenses. The terminal receives this input information, converts it into structured data, and sends it to the server.

[0350] The server performs tax calculations based on the received structured data and automatically generates the necessary documents. This includes detailed calculations based on tax laws and automatic checks for compliance with the generated documents. The server also aggregates the user's payment history and provides support for organizing expenses and income by category. This makes it possible to quickly extract and classify the transaction information necessary for electronic filing.

[0351] Furthermore, the server has the capability to respond to user inquiries in real time using a generative AI model. This means that users can receive quick and accurate support whenever they have questions. Specifically, inquiries can be made using prompt sentences, and the server will provide answers based on appropriate guidance.

[0352] The hardware used includes devices such as smartphones and desktop computers, and Firebase Firestore is used as the database management system. TensorFlow and BERT are used for AI-based natural language processing. AWS Lambda is a suitable cloud service.

[0353] For example, when a user sends a question to the server such as, "Is this transaction eligible as an expense?", the server uses an AI model to analyze the transaction and provides specific guidelines in real time, such as, "If it is a purchase related to business operations, it may be considered."

[0354] An example of a prompt to a generative AI model is: "For the expense information entered by the user, please answer the question, 'Is this expense tax-deductible?'"

[0355] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0356] Step 1:

[0357] Users enter income and expense data using a terminal. This includes individual transactions and general expense information. The entered data is converted to a specific format on the terminal and prepared for transmission to the database.

[0358] Step 2:

[0359] The terminal converts the input information into structured data and sends it to the server. This structured data is organized by category and designed to clearly distinguish between income and expense items. This data is sent to the server in JSON format and used for analysis.

[0360] Step 3:

[0361] The server analyzes the received data and performs tax calculations based on the rules of the applicable tax laws. This includes calculating total income, deductible expenses, and the final tax amount. The calculation results are recorded internally and used in subsequent document generation processes.

[0362] Step 4:

[0363] The server automatically generates the necessary tax documents based on the analysis results. This includes creating documents in a legally compliant format, along with detailed calculation results. The generated documents are stored in a database and made available for user review.

[0364] Step 5:

[0365] The server checks the legal compliance of the generated documents. This process compares the generated data with the established tax law standards to check for errors or deficiencies. If necessary, data is prepared for sending feedback to the user.

[0366] Step 6:

[0367] In response to user inquiries, the server uses a generative AI model to create a response. Specifically, when a user submits a question through a prompt, the AI ​​refers to the input data and generates the optimal answer. This answer is then sent to the terminal immediately, based on natural language processing technology.

[0368] Step 7:

[0369] The server converts the finalized tax data into a format compatible with the electronic filing system. This process integrates documents and data, and performs data conversion according to the file formats and protocols required for electronic filing. The converted data is then displayed on the user's terminal for final confirmation.

[0370] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0371] This invention is a system for assisting with tax filing, providing more personalized support to users by combining it with an emotion engine that recognizes user emotions. The system functions through interaction between a server, a terminal, and the user.

[0372] In this system, users input income and expense details using a terminal. Since this information forms the basis of the system's processing, clear guidelines are provided for input. The terminal then transmits the entered data to the server.

[0373] The server structures the data, performs tax calculations based on it, and automatically generates the necessary documents. Furthermore, it performs legal checks and provides timely feedback to the user. This feedback is crucial for improving the accuracy of the user's tax filing activities.

[0374] A key feature of this invention is that the server incorporates an emotion engine. The emotion engine detects the user's stress and anxiety and generates feedback based on these. For example, if the user shows signs of stress during input, the engine generates and sends a relaxing message. This function reduces the user's mental burden and supports a smooth reporting process.

[0375] Furthermore, the server has the capability to respond to user questions in real time. Here, the emotion engine grasps the emotional nuances of the question and provides an answer in an appropriate tone. For example, an anxious question will receive a reassuring response.

[0376] In the final stage, the server converts all necessary documents into an electronic filing format and prompts the user to make a final confirmation of the filing. The user then completes the filing process using their terminal. By streamlining this entire process, the system provides a higher quality user experience.

[0377] For example, when a sole proprietor has to settle many expenses at the end of the fiscal year, the emotional engine's support can reduce stress and allow them to complete their tax filing quickly and accurately. In this process, users can enter data with confidence and resolve any questions immediately.

[0378] The following describes the processing flow.

[0379] Step 1:

[0380] The user uses the terminal to enter income and expense details. During this process, the user is prompted to follow the terminal's guide and enter more accurate data.

[0381] Step 2:

[0382] The terminal sends the input information to the server. The transmitted information includes the necessary fields for processing as structured data.

[0383] Step 3:

[0384] The server analyzes the received information and categorizes income and expenses appropriately. This categorization makes the data easier to process.

[0385] Step 4:

[0386] The server performs tax calculations based on the categorized data. This calculation accurately reflects all income and expenses, and determines the tax amount relevant to the user.

[0387] Step 5:

[0388] The server automatically generates the necessary tax documents, saving users the trouble of tedious paperwork.

[0389] Step 6:

[0390] The server automatically checks whether the generated documents comply with the law. This process helps prevent errors during filing.

[0391] Step 7:

[0392] The server uses an emotion engine to analyze user input and responses. For example, it analyzes input time and key typing speed to detect if the user may be experiencing stress.

[0393] Step 8:

[0394] The server provides feedback to the user based on the results of the sentiment analysis. This feedback may include reassuring messages or advice to help the user proceed smoothly.

[0395] Step 9:

[0396] Users can check feedback from the server on their devices and make corrections as needed. This allows users to confidently move on to the next step.

[0397] Step 10:

[0398] Once all the documents are ready, the server converts the data into an electronic filing format.

[0399] Step 11:

[0400] The user performs a final check and submits the electronic filing from their terminal. This action transmits the tax return to the tax authority's system.

[0401] Step 12:

[0402] The server confirms receipt of the declaration and terminates the declaration process by sending a completion notification to the user via the terminal.

[0403] (Example 2)

[0404] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0405] Current tax filing support systems only structure user-entered data, perform tax calculations, and automatically generate documents, making it difficult to provide support that addresses the user's emotional state. Furthermore, deficiencies in compliance checks and real-time responses to questions can increase the user's mental burden and potentially delay the filing process.

[0406] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0407] In this invention, the server includes means for structuring input information, means for performing calculations and automatically generating necessary information, means for automatically verifying legal compliance, means for responding to questions in real time using a generative model, and means for adjusting feedback according to the user's mental state using emotion recognition technology. This enables a smooth and legally compliant tax filing process while providing support tailored to the user's individual emotional state.

[0408] "Input information" refers to data about transactions and expenses provided by the user.

[0409] "Structuring" refers to the process of organizing received information into a certain format or style, making it easier to process.

[0410] A "generative model" refers to an algorithm or system that creates optimal feedback or responses based on input data and the user's state.

[0411] "Legal compliance" refers to the state in which the information or data created conforms to the relevant laws and regulations.

[0412] "Feedback" refers to advice and suggestions for improvement provided to users, and is used to enhance the user experience.

[0413] "Real-time response" refers to the process of providing immediate answers to user questions and inquiries.

[0414] "Emotion recognition technology" refers to methods for inferring a user's emotional state from their digital behavior and input data, and determining appropriate responses.

[0415] This invention is a system for assisting with tax filing and has the ability to recognize user emotions. This allows it to provide personalized support to the user.

[0416] Users use a terminal to enter detailed data about their transactions and expenses for the year. This terminal refers to a general computer or mobile device, and the interface is provided through a web browser or a dedicated application. The entered information is encrypted according to a predetermined security protocol and sent to the server.

[0417] The server structures the received data using specialized software. This organizes the data and puts it in a format suitable for processing by computations and generative models. This process incorporates algorithms that refer to the latest tax law database, automatically verifying that the generated data complies with the law.

[0418] The server also features a generative AI model that uses prompt messages to respond to user inquiries in real time. For example, a prompt message might ask, "Are there any points to be careful about when entering this month's expenses?" By using emotion recognition technology, the system estimates the user's stress level based on input speed and error rate, and sends messages to encourage relaxation as needed.

[0419] This allows users to continue their tax filing process with peace of mind, and any questions are answered immediately. As a result, it becomes possible to complete tax filing accurately and quickly while reducing stress.

[0420] This system is designed to make tax filing more efficient for sole proprietors and small and medium-sized enterprises, and its adaptability and accuracy are expected to lead to widespread use in many fields.

[0421] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0422] Step 1:

[0423] Users enter transaction and expense details using a terminal. The input interface is provided via a web browser or a dedicated application, and users enter each income and expense item according to the guidelines. This input data becomes the initial input to the system. The entered information is encrypted and sent to the server via a communication protocol.

[0424] Step 2:

[0425] The terminal uses the SSL / TLS protocol to ensure data security when sending entered information to the server. It checks the integrity of the transmitted data, verifying that there are no missing or incorrect entries. If the data is valid, it is forwarded to the server.

[0426] Step 3:

[0427] The server structures the received data using specialized software. The data is normalized and converted into a format that can be stored in the database. Data cleansing is applied to correct unnecessary whitespace and inconsistent data. This results in the output of normalized structured data.

[0428] Step 4:

[0429] The server performs calculations using structured data. This process utilizes tax-based calculation algorithms to calculate income tax and expense deductions. As a result of the calculations, the necessary tax documents are automatically generated and output.

[0430] Step 5:

[0431] The server verifies the legal compliance of the generated documents. It consults relevant legal databases to check if the content is appropriate. Based on the verification results, it generates feedback for the user. This feedback is sent to the user's terminal in a format that the user can review.

[0432] Step 6:

[0433] The server uses a generative AI model to respond to user questions in real time. When a user submits a question, an appropriate answer is generated using a prompt. Emotion recognition technology is used to provide feedback in a tone that matches the user's emotional state.

[0434] Step 7:

[0435] The server converts the final data into an electronic filing format and requests the user for final confirmation. The user reviews the content on their terminal and presses the approval button, at which point the data is securely transmitted to the tax authorities. This is the system's final output.

[0436] (Application Example 2)

[0437] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0438] The goal is to reduce the stress and anxiety users experience when filing financial statements or making electronic payments, and to provide a smoother and more secure process.

[0439] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0440] In this invention, the server includes means for receiving input information and converting that information into structured data, means for performing financial calculations and automatically generating necessary documents, and means for analyzing the user's emotional state in real time and providing support. This allows the user to proceed with procedures quickly and accurately while feeling secure.

[0441] "Input information" refers to detailed data about income and expenses that users provide when performing a procedure.

[0442] "Structured data" refers to data that has been transformed into a unified format based on input information, making it easier to analyze and process.

[0443] "Financial calculation" refers to the process of performing necessary financial calculations based on structured data and preparing appropriate financial statements.

[0444] A "document" is an official document that contains information necessary for procedures or declarations.

[0445] "Compliance with regulations" refers to the standard used to ensure that generated documents and procedures properly adhere to relevant laws and regulations.

[0446] "Feedback" refers to the provision of information that allows users to receive feedback on the accuracy of procedures and suggestions for improvement during the process.

[0447] "Data for electronic submission" refers to a dataset prepared for electronic application and reporting.

[0448] A "generative model" is an artificial intelligence-based program or algorithm used to create appropriate responses to user inquiries in real time.

[0449] "Emotional state" refers to the psychological conditions, such as stress and anxiety, that a user exhibits during the process.

[0450] "Providing support" means offering technical and psychological assistance to users so that they can proceed with the process smoothly.

[0451] This invention is implemented by a system in which a server, terminal, and user work together. The server receives input information provided by the user and converts it into structured data. In this process, the user directly inputs data using a terminal such as a smartphone or computer. The structured data is stored in a well-known database system such as MySQL or PostgreSQL.

[0452] The server then performs financial calculations based on the structured data and automatically generates the necessary documents. This calculation process is carried out using programming languages ​​such as Python and R, and data analysis libraries such as NumPy and Pandas. The generated documents are converted to PDF format using Adobe PDF Library or similar services and provided to the user for review.

[0453] The server then automatically checks for compliance with legal regulations. This uses rule engines such as Drools or OpenRules. Feedback is provided to the user in real time, and data for electronic submission is prepared.

[0454] The server is equipped with sentiment analysis models using Google Cloud Vision and Amazon Rekognition. This allows it to analyze the user's emotional state and provide appropriate support. When stress or anxiety is detected in the user, automatically generated calming messages are sent to the user's device.

[0455] As a concrete example, when a user makes a large online payment, the terminal's camera captures the user's facial expression, which is then analyzed by a server. If the user expresses concern, a reassuring message is displayed, such as, "This seller has achieved 100% customer satisfaction in the past 100 transactions."

[0456] An example of a prompt message generated using an AI model is: "The user is feeling uneasy on the payment screen. Please suggest ways to reassure them using past successful transaction data." This allows the user to proceed with the transaction with confidence.

[0457] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0458] Step 1:

[0459] Users use a terminal to enter details about their income and expenses. The input data is organized by field and sent from the terminal to the server. This allows the server to receive the input information to create structured data.

[0460] Step 2:

[0461] The server converts the received input information into structured data. Here, a database system (such as MySQL or PostgreSQL) is used to systematically store the data and format it for easier use in subsequent processing. The output of this process forms the dataset that underlies financial calculations.

[0462] Step 3:

[0463] The server performs financial calculations using structured data. It uses programming languages ​​such as Python and R, along with data analysis libraries like NumPy and Pandas, to calculate necessary financial indicators. The results of these calculations generate financial documents to be presented to the user, and these documents are converted to PDF format using Adobe PDF Library or similar tools.

[0464] Step 4:

[0465] The server verifies the compliance of the generated documents. This is done using rule engines such as Drools or OpenRules. The input is laws and regulations, and the output is a compliance status report.

[0466] Step 5:

[0467] The server analyzes the user's emotional state in real time. It analyzes facial image data acquired from the device's camera using APIs such as Google Cloud Vision and Amazon Rekognition. If user stress or anxiety is detected, a support message is automatically generated and sent to the user based on the results.

[0468] Step 6:

[0469] The server sends prompt sentences based on the sentiment analysis results to an AI model that generates appropriate feedback messages. For example, a prompt such as "The user is feeling anxious on the payment screen. Use past successful transaction data to suggest ways to reassure them" might be used. The output would be a specific message designed to alleviate the user's anxiety.

[0470] Step 7:

[0471] Users review the data for electronic submission via their terminal and then perform the final submission operation. This completes the entire process, enabling smooth tax filing and settlement.

[0472] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0473] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0474] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0475] [Third Embodiment]

[0476] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0477] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0478] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0479] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0480] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0481] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0482] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0483] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0484] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0485] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0486] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0487] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0488] This invention is a system that supports efficient and accurate tax filing, and mainly consists of a server, terminals, and user operations. The system aims to input the user's tax information, process that information automatically, and ultimately complete the electronic filing.

[0489] First, the user uses a terminal to input their income and expenses. For example, the user can input detailed information such as being a freelancer and having income that varies from project to project. The terminal then sends this data to the server.

[0490] Next, the server structures the received data, categorizes expenses and income, and performs tax calculations according to tax laws. These calculations include, for example, detailed tax calculations based on the type of income and the attributes of expenses. Once the calculations are complete, the server automatically generates the necessary tax documents.

[0491] The generated documents are automatically checked for legal compliance by the server, and if there are any problems, feedback is provided to the user. The user can then make the necessary corrections from their device based on this feedback.

[0492] Furthermore, the server uses a generative AI model to respond to user questions in real time. For example, if a user asks, "Is a specific expense deductible?", the server will immediately provide an answer based on appropriate guidelines.

[0493] Finally, once all documents and data are complete, the server converts them into a format compatible with the electronic filing system. The user then performs a final check of this data via their terminal and officially completes the filing process.

[0494] Thus, the present invention integrates the entire process from collecting input information, structuring data, generating and checking documents, to electronic filing, enabling users to file tax returns more efficiently and reliably. Specifically, it can support a designer user in classifying their annual income by project, inputting corresponding expenses, and ultimately filing an accurate tax return.

[0495] The following describes the processing flow.

[0496] Step 1:

[0497] Users enter their income and expense information into the terminal. This information includes the amount of income, its source, and the type and amount of expenses. This input is guided to ensure that users provide reliable data.

[0498] Step 2:

[0499] The terminal sends the data entered by the user to the server. This transmission is performed using a secure communication protocol, ensuring the confidentiality of the information.

[0500] Step 3:

[0501] The server analyzes the received data and categorizes income and expenses accordingly. Income is separated by source, and expenses are categorized by type. This structures the data, enabling accurate tax calculations.

[0502] Step 4:

[0503] The server performs tax calculations based on the classified data. Here, applicable expenses are deducted from each income to determine the taxable amount. Based on the calculation results, the necessary tax return documents (e.g., Income Tax Return Form B) are automatically generated.

[0504] Step 5:

[0505] The server checks whether the generated documents comply with the latest tax laws. This check verifies legal compliance, and if there are any errors, the user is immediately provided with feedback for correction.

[0506] Step 6:

[0507] Users can review feedback from the server via their devices and make necessary corrections. This improves the accuracy of their declarations.

[0508] Step 7:

[0509] If a user has questions about the information they have provided, they can send an inquiry to the server via their device. The server uses an AI model to answer the user's questions in real time. This service aims to quickly resolve any ambiguities the user may have.

[0510] Step 8:

[0511] Once all data and documents have been verified and are in order, the server converts them into a format for electronic filing. The converted data is used in the final step of the filing process.

[0512] Step 9:

[0513] The user reviews the final declaration details on their device and performs the "Submit" action to complete the electronic filing process. This action causes the server to send the declaration details to the tax authority's electronic filing system.

[0514] Step 10:

[0515] The server confirms that the declaration has been successfully received and sends a completion notification to the user via the terminal. This allows the user to confirm that the declaration has been officially completed.

[0516] (Example 1)

[0517] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0518] Tax filing requires accurately digitizing income and expense information, performing calculations in accordance with the latest laws and regulations, and preparing appropriate documents. However, these processes are time-consuming and laborious, and checking for legal compliance in particular requires specialized knowledge, making errors common. Furthermore, there is a lack of systems that can immediately respond to users' questions that arise in real time. These challenges place a significant burden on sole proprietors and small and medium-sized enterprises in particular.

[0519] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0520] In this invention, the server includes means for converting input information into a data structure, means for performing financial calculations and automatically generating necessary documents, and means for automatically checking legal compliance. This enables the rapid and accurate processing of user data and the creation of documents that comply with the law. Furthermore, by enabling real-time question answering, users can proceed with tax filing with peace of mind.

[0521] "Input information" refers to data such as details of income and expenses provided by the user.

[0522] A "data structure" is a method of systematically organizing input information and converting it into a format suitable for computation and document generation.

[0523] "Financial calculation" refers to the process of calculating tax amounts based on income and expense data.

[0524] A "document" refers to a document or report containing information necessary for filing a tax return.

[0525] "Legal compliance" refers to the characteristic of ensuring that generated documents and data conform to current laws and regulations.

[0526] "Confirmation information" refers to feedback provided by the server to the user, prompting them to correct or add to the input information.

[0527] "Real-time" refers to the temporal characteristic of providing information in an immediate response to user requests.

[0528] A "generative model" is an artificial intelligence technology that generates appropriate answers in response to inquiries from users.

[0529] A "user" is an individual or organization that uses the system to perform tax filing tasks.

[0530] An "information processing device" is an electronic device used to transmit and receive data.

[0531] "Encryption" is an information transformation process performed to protect data.

[0532] This invention is a system for simplifying tax filing procedures, operating primarily through the interaction of a server, terminals, and users. The system aims to efficiently process input tax-related data and generate legally compliant documents. Specific embodiments of this system are described below.

[0533] Users first use a terminal to input their income and expense information. This information includes income sources and receipts that vary for each project. Accuracy of the information entered by users is essential for the system's success.

[0534] The terminal is responsible for sending information entered by the user to the server. To ensure data security, the terminal encrypts the communication content. For example, the TLS protocol can be used.

[0535] The server uses the Python Pandas library to convert received data into data structures. It also uses NumPy to perform financial calculations and calculate accurate tax amounts based on income and expenses. When generating necessary documents based on calculations in accordance with tax laws, the server uses the ReportLab library to generate documents in PDF format.

[0536] The generated documents are automatically checked for legal compliance. At this stage, a Python script is used with a rule-based checklist to verify that the documents meet legal requirements.

[0537] Furthermore, the server uses a generative AI model to provide real-time question-and-answer functionality. When a user asks a prompt such as, "Can I claim this specific expense?", the server provides an immediate answer based on appropriate guidelines.

[0538] Finally, the server converts the completed documents and data into a format suitable for the electronic filing system. The user can then review the data via their terminal and complete the electronic filing. This streamlines the entire filing process and enables users to file their tax returns accurately.

[0539] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0540] Step 1:

[0541] The user uses a terminal to input information related to income and expenses. The input data includes detailed income and expense information for each project. Specifically, the user enters information into input fields on the interface and confirms the data by pressing a confirmation button. The output of the process is the raw data entered by the user.

[0542] Step 2:

[0543] The terminal sends the data entered by the user to the server. To maintain data security, the terminal encrypts the data before transmission. Specifically, this process involves converting the data into packets using a secure communication method utilizing the TLS protocol and sending them to the server. The output of this process is the encrypted data received by the server.

[0544] Step 3:

[0545] The server decrypts the encrypted data received from the terminal and converts it into a data structure. The server uses the Python Pandas library to organize the received data into a data frame. Specifically, it maps each data item to its corresponding field and classifies income and expenses into their respective categories. The output of the process is a structured data frame.

[0546] Step 4:

[0547] The server performs tax calculations based on structured data. It uses the NumPy library to calculate the accurate tax amount from income and expenses. Specifically, it calculates the tax amount by applying the tax rate to the income. The output of the process is the calculated tax information.

[0548] Step 5:

[0549] The server automatically generates the necessary documents based on the calculation results. Using the ReportLab library, it creates PDF documents for tax filing. Specifically, it generates documents containing a table and explanatory text detailing the calculated tax amount. The output of the process is a completed PDF document.

[0550] Step 6:

[0551] The server checks the legal compliance of the generated documents. It uses a Python script to run a rule-based checklist to verify that the documents conform to the law. Specifically, it performs a process of cross-referencing with an existing legal dataset. The output of this process is the compliance verification result.

[0552] Step 7:

[0553] The server responds to user inquiries using a generative AI model. For example, if a user enters the prompt "Is this expense approved?", the server will refer to relevant guidelines and quickly generate an answer. Specifically, this involves the generative AI querying a rules database and providing the appropriate information. The output of this process is the response to the user.

[0554] Step 8:

[0555] The server converts the final completed documents and data into a format compatible with the electronic filing system. The server uses a dedicated API to convert the data format to a suitable format. Specifically, it reconstructs each data item to match the electronic filing format. The output of this process is a data file compatible with the electronic filing system.

[0556] Step 9:

[0557] The user uses their terminal to perform a final check of the data required for electronic filing, and if there are no changes, completes the filing. Specific actions include previewing the data on the terminal screen and pressing the submit button to complete the final submission. The output of the process is the status of filing completion.

[0558] (Application Example 1)

[0559] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0560] In today's world of widespread electronic payments, there is a need to efficiently utilize information obtained from everyday transactions conducted by individuals and businesses to enable accurate and convenient tax filing. However, current systems make it difficult to manage this information comprehensively and automate the process in a manner compliant with the law. Furthermore, there is a lack of mechanisms to quickly obtain answers when users have questions, which contributes to the problem of the tax filing process being easily complicated.

[0561] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0562] In this invention, the server includes means for receiving input information and converting that information into structured data, means for performing tax calculations and automatically generating necessary documents, and support means for aggregating the user's payment history and organizing it by category. This enables the user to effectively utilize data obtained from electronic payments and file tax returns efficiently in compliance with the law. Furthermore, by responding to inquiries in real time, questions that arise during the filing process can be resolved quickly.

[0563] "Input information" refers to data on income and expenses provided by the user.

[0564] "Structured data" refers to data in which input information is organized according to categories and formats.

[0565] "Tax calculation" is the process of calculating the amount of tax using income and expense data in accordance with tax laws.

[0566] "Documents" refers to official documents required for tax filing.

[0567] "Legal compliance" means that the generated documents and data conform to current laws and regulations.

[0568] "Feedback" refers to information provided to users for verification and improvement.

[0569] "Real-time response" refers to providing instant answers to user inquiries.

[0570] A "generative model" is an algorithm that uses artificial intelligence technology to generate appropriate answers to inquiries.

[0571] "Inquiry processing" is a function that responds to questions and requests from users.

[0572] "Settlement history" refers to a record of financial transactions conducted by a user.

[0573] "Support for organizing by category" refers to the process of aggregating and classifying payment history based on its type and purpose.

[0574] "Automatic extraction of transaction information" is a technology that automatically identifies and extracts information necessary for tax filing from payment history.

[0575] The system for implementing this invention consists of the interaction of a server, a terminal, and a user. The user uses the terminal to input their income and expenses. The terminal receives this input information, converts it into structured data, and sends it to the server.

[0576] The server performs tax calculations based on the received structured data and automatically generates the necessary documents. This includes detailed calculations based on tax laws and automatic checks for compliance with the generated documents. The server also aggregates the user's payment history and provides support for organizing expenses and income by category. This makes it possible to quickly extract and classify the transaction information necessary for electronic filing.

[0577] Furthermore, the server has the capability to respond to user inquiries in real time using a generative AI model. This means that users can receive quick and accurate support whenever they have questions. Specifically, inquiries can be made using prompt sentences, and the server will provide answers based on appropriate guidance.

[0578] The hardware used includes devices such as smartphones and desktop computers, and Firebase Firestore is used as the database management system. TensorFlow and BERT are used for AI-based natural language processing. AWS Lambda is a suitable cloud service.

[0579] For example, when a user sends a question to the server such as, "Is this transaction eligible as an expense?", the server uses an AI model to analyze the transaction and provides specific guidelines in real time, such as, "If it is a purchase related to business operations, it may be considered."

[0580] An example of a prompt to a generative AI model is: "For the expense information entered by the user, please answer the question, 'Is this expense tax-deductible?'"

[0581] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0582] Step 1:

[0583] Users enter income and expense data using a terminal. This includes individual transactions and general expense information. The entered data is converted to a specific format on the terminal and prepared for transmission to the database.

[0584] Step 2:

[0585] The terminal converts the input information into structured data and sends it to the server. This structured data is organized by category and designed to clearly distinguish between income and expense items. This data is sent to the server in JSON format and used for analysis.

[0586] Step 3:

[0587] The server analyzes the received data and performs tax calculations based on the rules of the applicable tax laws. This includes calculating total income, deductible expenses, and the final tax amount. The calculation results are recorded internally and used in subsequent document generation processes.

[0588] Step 4:

[0589] The server automatically generates the necessary tax documents based on the analysis results. This includes creating documents in a legally compliant format, along with detailed calculation results. The generated documents are stored in a database and made available for user review.

[0590] Step 5:

[0591] The server checks the legal compliance of the generated documents. This process compares the generated data with the established tax law standards to check for errors or deficiencies. If necessary, data is prepared for sending feedback to the user.

[0592] Step 6:

[0593] In response to user inquiries, the server uses a generative AI model to create a response. Specifically, when a user submits a question through a prompt, the AI ​​refers to the input data and generates the optimal answer. This answer is then sent to the terminal immediately, based on natural language processing technology.

[0594] Step 7:

[0595] The server converts the finalized tax data into a format compatible with the electronic filing system. This process integrates documents and data, and performs data conversion according to the file formats and protocols required for electronic filing. The converted data is then displayed on the user's terminal for final confirmation.

[0596] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0597] This invention is a system for assisting with tax filing, providing more personalized support to users by combining it with an emotion engine that recognizes user emotions. The system functions through interaction between a server, a terminal, and the user.

[0598] In this system, users input income and expense details using a terminal. Since this information forms the basis of the system's processing, clear guidelines are provided for input. The terminal then transmits the entered data to the server.

[0599] The server structures the data, performs tax calculations based on it, and automatically generates the necessary documents. Furthermore, it performs legal checks and provides timely feedback to the user. This feedback is crucial for improving the accuracy of the user's tax filing activities.

[0600] A key feature of this invention is that the server incorporates an emotion engine. The emotion engine detects the user's stress and anxiety and generates feedback based on these. For example, if the user shows signs of stress during input, the engine generates and sends a relaxing message. This function reduces the user's mental burden and supports a smooth reporting process.

[0601] Furthermore, the server has the capability to respond to user questions in real time. Here, the emotion engine grasps the emotional nuances of the question and provides an answer in an appropriate tone. For example, an anxious question will receive a reassuring response.

[0602] In the final stage, the server converts all necessary documents into an electronic filing format and prompts the user to make a final confirmation of the filing. The user then completes the filing process using their terminal. By streamlining this entire process, the system provides a higher quality user experience.

[0603] For example, when a sole proprietor has to settle many expenses at the end of the fiscal year, the emotional engine's support can reduce stress and allow them to complete their tax filing quickly and accurately. In this process, users can enter data with confidence and resolve any questions immediately.

[0604] The following describes the processing flow.

[0605] Step 1:

[0606] The user uses the terminal to enter income and expense details. During this process, the user is prompted to follow the terminal's guide and enter more accurate data.

[0607] Step 2:

[0608] The terminal sends the input information to the server. The transmitted information includes the necessary fields for processing as structured data.

[0609] Step 3:

[0610] The server analyzes the received information and categorizes income and expenses appropriately. This categorization makes the data easier to process.

[0611] Step 4:

[0612] The server performs tax calculations based on the categorized data. This calculation accurately reflects all income and expenses, and determines the tax amount relevant to the user.

[0613] Step 5:

[0614] The server automatically generates the necessary tax documents, saving users the trouble of tedious paperwork.

[0615] Step 6:

[0616] The server automatically checks whether the generated documents comply with the law. This process helps prevent errors during filing.

[0617] Step 7:

[0618] The server uses an emotion engine to analyze user input and responses. For example, it analyzes input time and key typing speed to detect if the user may be experiencing stress.

[0619] Step 8:

[0620] The server provides feedback to the user based on the results of the sentiment analysis. This feedback may include reassuring messages or advice to help the user proceed smoothly.

[0621] Step 9:

[0622] Users can check feedback from the server on their devices and make corrections as needed. This allows users to confidently move on to the next step.

[0623] Step 10:

[0624] Once all the documents are ready, the server converts the data into an electronic filing format.

[0625] Step 11:

[0626] The user performs a final check and submits the electronic filing from their terminal. This action transmits the tax return to the tax authority's system.

[0627] Step 12:

[0628] The server confirms receipt of the declaration and terminates the declaration process by sending a completion notification to the user via the terminal.

[0629] (Example 2)

[0630] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0631] Current tax filing support systems only structure user-entered data, perform tax calculations, and automatically generate documents, making it difficult to provide support that addresses the user's emotional state. Furthermore, deficiencies in compliance checks and real-time responses to questions can increase the user's mental burden and potentially delay the filing process.

[0632] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0633] In this invention, the server includes means for structuring input information, means for performing calculations and automatically generating necessary information, means for automatically verifying legal compliance, means for responding to questions in real time using a generative model, and means for adjusting feedback according to the user's mental state using emotion recognition technology. This enables a smooth and legally compliant tax filing process while providing support tailored to the user's individual emotional state.

[0634] "Input information" refers to data about transactions and expenses provided by the user.

[0635] "Structuring" refers to the process of organizing received information into a certain format or style, making it easier to process.

[0636] A "generative model" refers to an algorithm or system that creates optimal feedback or responses based on input data and the user's state.

[0637] "Legal compliance" refers to the state in which the information or data created conforms to the relevant laws and regulations.

[0638] "Feedback" refers to advice and suggestions for improvement provided to users, and is used to enhance the user experience.

[0639] "Real-time response" refers to the process of providing immediate answers to user questions and inquiries.

[0640] "Emotion recognition technology" refers to methods for inferring a user's emotional state from their digital behavior and input data, and determining appropriate responses.

[0641] This invention is a system for assisting with tax filing and has the ability to recognize user emotions. This allows it to provide personalized support to the user.

[0642] Users use a terminal to enter detailed data about their transactions and expenses for the year. This terminal refers to a general computer or mobile device, and the interface is provided through a web browser or a dedicated application. The entered information is encrypted according to a predetermined security protocol and sent to the server.

[0643] The server structures the received data using specialized software. This organizes the data and puts it in a format suitable for processing by computations and generative models. This process incorporates algorithms that refer to the latest tax law database, automatically verifying that the generated data complies with the law.

[0644] The server also features a generative AI model that uses prompt messages to respond to user inquiries in real time. For example, a prompt message might ask, "Are there any points to be careful about when entering this month's expenses?" By using emotion recognition technology, the system estimates the user's stress level based on input speed and error rate, and sends messages to encourage relaxation as needed.

[0645] This allows users to continue their tax filing process with peace of mind, and any questions are answered immediately. As a result, it becomes possible to complete tax filing accurately and quickly while reducing stress.

[0646] This system is designed to make tax filing more efficient for sole proprietors and small and medium-sized enterprises, and its adaptability and accuracy are expected to lead to widespread use in many fields.

[0647] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0648] Step 1:

[0649] Users enter transaction and expense details using a terminal. The input interface is provided via a web browser or a dedicated application, and users enter each income and expense item according to the guidelines. This input data becomes the initial input to the system. The entered information is encrypted and sent to the server via a communication protocol.

[0650] Step 2:

[0651] The terminal uses the SSL / TLS protocol to ensure data security when sending entered information to the server. It checks the integrity of the transmitted data, verifying that there are no missing or incorrect entries. If the data is valid, it is forwarded to the server.

[0652] Step 3:

[0653] The server structures the received data using specialized software. The data is normalized and converted into a format that can be stored in the database. Data cleansing is applied to correct unnecessary whitespace and inconsistent data. This results in the output of normalized structured data.

[0654] Step 4:

[0655] The server performs calculations using structured data. This process utilizes tax-based calculation algorithms to calculate income tax and expense deductions. As a result of the calculations, the necessary tax documents are automatically generated and output.

[0656] Step 5:

[0657] The server verifies the legal compliance of the generated documents. It consults relevant legal databases to check if the content is appropriate. Based on the verification results, it generates feedback for the user. This feedback is sent to the user's terminal in a format that the user can review.

[0658] Step 6:

[0659] The server uses a generative AI model to respond to user questions in real time. When a user submits a question, an appropriate answer is generated using a prompt. Emotion recognition technology is used to provide feedback in a tone that matches the user's emotional state.

[0660] Step 7:

[0661] The server converts the final data into an electronic filing format and requests the user for final confirmation. The user reviews the content on their terminal and presses the approval button, at which point the data is securely transmitted to the tax authorities. This is the system's final output.

[0662] (Application Example 2)

[0663] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0664] The goal is to reduce the stress and anxiety users experience when filing financial statements or making electronic payments, and to provide a smoother and more secure process.

[0665] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0666] In this invention, the server includes means for receiving input information and converting that information into structured data, means for performing financial calculations and automatically generating necessary documents, and means for analyzing the user's emotional state in real time and providing support. This allows the user to proceed with procedures quickly and accurately while feeling secure.

[0667] "Input information" refers to detailed data about income and expenses that users provide when performing a procedure.

[0668] "Structured data" refers to data that has been transformed into a unified format based on input information, making it easier to analyze and process.

[0669] "Financial calculation" refers to the process of performing necessary financial calculations based on structured data and preparing appropriate financial statements.

[0670] A "document" is an official document that contains information necessary for procedures or declarations.

[0671] "Compliance with regulations" refers to the standard used to ensure that generated documents and procedures properly adhere to relevant laws and regulations.

[0672] "Feedback" refers to the provision of information that allows users to receive feedback on the accuracy of procedures and suggestions for improvement during the process.

[0673] "Data for electronic submission" refers to a dataset prepared for electronic application and reporting.

[0674] A "generative model" is an artificial intelligence-based program or algorithm used to create appropriate responses to user inquiries in real time.

[0675] "Emotional state" refers to the psychological conditions, such as stress and anxiety, that a user exhibits during the process.

[0676] "Providing support" means offering technical and psychological assistance to users so that they can proceed with the process smoothly.

[0677] This invention is implemented by a system in which a server, terminal, and user work together. The server receives input information provided by the user and converts it into structured data. In this process, the user directly inputs data using a terminal such as a smartphone or computer. The structured data is stored in a well-known database system such as MySQL or PostgreSQL.

[0678] The server then performs financial calculations based on the structured data and automatically generates the necessary documents. This calculation process is carried out using programming languages ​​such as Python and R, and data analysis libraries such as NumPy and Pandas. The generated documents are converted to PDF format using Adobe PDF Library or similar services and provided to the user for review.

[0679] The server then automatically checks for compliance with legal regulations. This uses rule engines such as Drools or OpenRules. Feedback is provided to the user in real time, and data for electronic submission is prepared.

[0680] The server is equipped with sentiment analysis models using Google Cloud Vision and Amazon Rekognition. This allows it to analyze the user's emotional state and provide appropriate support. When stress or anxiety is detected in the user, automatically generated calming messages are sent to the user's device.

[0681] As a concrete example, when a user makes a large online payment, the terminal's camera captures the user's facial expression, which is then analyzed by a server. If the user expresses concern, a reassuring message is displayed, such as, "This seller has achieved 100% customer satisfaction in the past 100 transactions."

[0682] An example of a prompt message generated using an AI model is: "The user is feeling uneasy on the payment screen. Please suggest ways to reassure them using past successful transaction data." This allows the user to proceed with the transaction with confidence.

[0683] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0684] Step 1:

[0685] Users use a terminal to enter details about their income and expenses. The input data is organized by field and sent from the terminal to the server. This allows the server to receive the input information to create structured data.

[0686] Step 2:

[0687] The server converts the received input information into structured data. Here, a database system (such as MySQL or PostgreSQL) is used to systematically store the data and format it for easier use in subsequent processing. The output of this process forms the dataset that underlies financial calculations.

[0688] Step 3:

[0689] The server performs financial calculations using structured data. It uses programming languages ​​such as Python and R, along with data analysis libraries like NumPy and Pandas, to calculate necessary financial indicators. The results of these calculations generate financial documents to be presented to the user, and these documents are converted to PDF format using Adobe PDF Library or similar tools.

[0690] Step 4:

[0691] The server verifies the compliance of the generated documents. This is done using rule engines such as Drools or OpenRules. The input is laws and regulations, and the output is a compliance status report.

[0692] Step 5:

[0693] The server analyzes the user's emotional state in real time. It analyzes facial image data acquired from the device's camera using APIs such as Google Cloud Vision and Amazon Rekognition. If user stress or anxiety is detected, a support message is automatically generated and sent to the user based on the results.

[0694] Step 6:

[0695] The server sends prompt sentences based on the sentiment analysis results to an AI model that generates appropriate feedback messages. For example, a prompt such as "The user is feeling anxious on the payment screen. Use past successful transaction data to suggest ways to reassure them" might be used. The output would be a specific message designed to alleviate the user's anxiety.

[0696] Step 7:

[0697] Users review the data for electronic submission via their terminal and then perform the final submission operation. This completes the entire process, enabling smooth tax filing and settlement.

[0698] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0699] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0700] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0701] [Fourth Embodiment]

[0702] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0703] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0704] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0705] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0706] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0707] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0708] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0709] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0710] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0711] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0712] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0713] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0714] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0715] This invention is a system that supports efficient and accurate tax filing, and mainly consists of a server, terminals, and user operations. The system aims to input the user's tax information, process that information automatically, and ultimately complete the electronic filing.

[0716] First, the user uses a terminal to input their income and expenses. For example, the user can input detailed information such as being a freelancer and having income that varies from project to project. The terminal then sends this data to the server.

[0717] Next, the server structures the received data, categorizes expenses and income, and performs tax calculations according to tax laws. These calculations include, for example, detailed tax calculations based on the type of income and the attributes of expenses. Once the calculations are complete, the server automatically generates the necessary tax documents.

[0718] The generated documents are automatically checked for legal compliance by the server, and if there are any problems, feedback is provided to the user. The user can then make the necessary corrections from their device based on this feedback.

[0719] Furthermore, the server uses a generative AI model to respond to user questions in real time. For example, if a user asks, "Is a specific expense deductible?", the server will immediately provide an answer based on appropriate guidelines.

[0720] Finally, once all documents and data are complete, the server converts them into a format compatible with the electronic filing system. The user then performs a final check of this data via their terminal and officially completes the filing process.

[0721] Thus, the present invention integrates the entire process from collecting input information, structuring data, generating and checking documents, to electronic filing, enabling users to file tax returns more efficiently and reliably. Specifically, it can support a designer user in classifying their annual income by project, inputting corresponding expenses, and ultimately filing an accurate tax return.

[0722] The following describes the processing flow.

[0723] Step 1:

[0724] Users enter their income and expense information into the terminal. This information includes the amount of income, its source, and the type and amount of expenses. This input is guided to ensure that users provide reliable data.

[0725] Step 2:

[0726] The terminal sends the data entered by the user to the server. This transmission is performed using a secure communication protocol, ensuring the confidentiality of the information.

[0727] Step 3:

[0728] The server analyzes the received data and categorizes income and expenses accordingly. Income is separated by source, and expenses are categorized by type. This structures the data, enabling accurate tax calculations.

[0729] Step 4:

[0730] The server performs tax calculations based on the classified data. Here, applicable expenses are deducted from each income to determine the taxable amount. Based on the calculation results, the necessary tax return documents (e.g., Income Tax Return Form B) are automatically generated.

[0731] Step 5:

[0732] The server checks whether the generated documents comply with the latest tax laws. This check verifies legal compliance, and if there are any errors, the user is immediately provided with feedback for correction.

[0733] Step 6:

[0734] Users can review feedback from the server via their devices and make necessary corrections. This improves the accuracy of their declarations.

[0735] Step 7:

[0736] If a user has questions about the information they have provided, they can send an inquiry to the server via their device. The server uses an AI model to answer the user's questions in real time. This service aims to quickly resolve any ambiguities the user may have.

[0737] Step 8:

[0738] Once all data and documents have been verified and are in order, the server converts them into a format for electronic filing. The converted data is used in the final step of the filing process.

[0739] Step 9:

[0740] The user reviews the final declaration details on their device and performs the "Submit" action to complete the electronic filing process. This action causes the server to send the declaration details to the tax authority's electronic filing system.

[0741] Step 10:

[0742] The server confirms that the declaration has been successfully received and sends a completion notification to the user via the terminal. This allows the user to confirm that the declaration has been officially completed.

[0743] (Example 1)

[0744] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0745] Tax filing requires accurately digitizing income and expense information, performing calculations in accordance with the latest laws and regulations, and preparing appropriate documents. However, these processes are time-consuming and laborious, and checking for legal compliance in particular requires specialized knowledge, making errors common. Furthermore, there is a lack of systems that can immediately respond to users' questions that arise in real time. These challenges place a significant burden on sole proprietors and small and medium-sized enterprises in particular.

[0746] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0747] In this invention, the server includes means for converting input information into a data structure, means for performing financial calculations and automatically generating necessary documents, and means for automatically checking legal compliance. This enables the rapid and accurate processing of user data and the creation of documents that comply with the law. Furthermore, by enabling real-time question answering, users can proceed with tax filing with peace of mind.

[0748] "Input information" refers to data such as details of income and expenses provided by the user.

[0749] A "data structure" is a method of systematically organizing input information and converting it into a format suitable for computation and document generation.

[0750] "Financial calculation" refers to the process of calculating tax amounts based on income and expense data.

[0751] A "document" refers to a document or report containing information necessary for filing a tax return.

[0752] "Legal compliance" refers to the characteristic of ensuring that generated documents and data conform to current laws and regulations.

[0753] "Confirmation information" refers to feedback provided by the server to the user, prompting them to correct or add to the input information.

[0754] "Real-time" refers to the temporal characteristic of providing information in an immediate response to user requests.

[0755] A "generative model" is an artificial intelligence technology that generates appropriate answers in response to inquiries from users.

[0756] A "user" is an individual or organization that uses the system to perform tax filing tasks.

[0757] An "information processing device" is an electronic device used to transmit and receive data.

[0758] "Encryption" is an information transformation process performed to protect data.

[0759] This invention is a system for simplifying tax filing procedures, operating primarily through the interaction of a server, terminals, and users. The system aims to efficiently process input tax-related data and generate legally compliant documents. Specific embodiments of this system are described below.

[0760] Users first use a terminal to input their income and expense information. This information includes income sources and receipts that vary for each project. Accuracy of the information entered by users is essential for the system's success.

[0761] The terminal is responsible for sending information entered by the user to the server. To ensure data security, the terminal encrypts the communication content. For example, the TLS protocol can be used.

[0762] The server uses the Python Pandas library to convert received data into data structures. It also uses NumPy to perform financial calculations and calculate accurate tax amounts based on income and expenses. When generating necessary documents based on calculations in accordance with tax laws, the server uses the ReportLab library to generate documents in PDF format.

[0763] The generated documents are automatically checked for legal compliance. At this stage, a Python script is used with a rule-based checklist to verify that the documents meet legal requirements.

[0764] Furthermore, the server uses a generative AI model to provide real-time question-and-answer functionality. When a user asks a prompt such as, "Can I claim this specific expense?", the server provides an immediate answer based on appropriate guidelines.

[0765] Finally, the server converts the completed documents and data into a format suitable for the electronic filing system. The user can then review the data via their terminal and complete the electronic filing. This streamlines the entire filing process and enables users to file their tax returns accurately.

[0766] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0767] Step 1:

[0768] The user uses a terminal to input information related to income and expenses. The input data includes detailed income and expense information for each project. Specifically, the user enters information into input fields on the interface and confirms the data by pressing a confirmation button. The output of the process is the raw data entered by the user.

[0769] Step 2:

[0770] The terminal sends the data entered by the user to the server. To maintain data security, the terminal encrypts the data before transmission. Specifically, this process involves converting the data into packets using a secure communication method utilizing the TLS protocol and sending them to the server. The output of this process is the encrypted data received by the server.

[0771] Step 3:

[0772] The server decrypts the encrypted data received from the terminal and converts it into a data structure. The server uses the Python Pandas library to organize the received data into a data frame. Specifically, it maps each data item to its corresponding field and classifies income and expenses into their respective categories. The output of the process is a structured data frame.

[0773] Step 4:

[0774] The server performs tax calculations based on structured data. It uses the NumPy library to calculate the accurate tax amount from income and expenses. Specifically, it calculates the tax amount by applying the tax rate to the income. The output of the process is the calculated tax information.

[0775] Step 5:

[0776] The server automatically generates the necessary documents based on the calculation results. Using the ReportLab library, it creates PDF documents for tax filing. Specifically, it generates documents containing a table and explanatory text detailing the calculated tax amount. The output of the process is a completed PDF document.

[0777] Step 6:

[0778] The server checks the legal compliance of the generated documents. It uses a Python script to run a rule-based checklist to verify that the documents conform to the law. Specifically, it performs a process of cross-referencing with an existing legal dataset. The output of this process is the compliance verification result.

[0779] Step 7:

[0780] The server responds to user inquiries using a generative AI model. For example, if a user enters the prompt "Is this expense approved?", the server will refer to relevant guidelines and quickly generate an answer. Specifically, this involves the generative AI querying a rules database and providing the appropriate information. The output of this process is the response to the user.

[0781] Step 8:

[0782] The server converts the final completed documents and data into a format compatible with the electronic filing system. The server uses a dedicated API to convert the data format to a suitable format. Specifically, it reconstructs each data item to match the electronic filing format. The output of this process is a data file compatible with the electronic filing system.

[0783] Step 9:

[0784] The user uses their terminal to perform a final check of the data required for electronic filing, and if there are no changes, completes the filing. Specific actions include previewing the data on the terminal screen and pressing the submit button to complete the final submission. The output of the process is the status of filing completion.

[0785] (Application Example 1)

[0786] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0787] In today's world of widespread electronic payments, there is a need to efficiently utilize information obtained from everyday transactions conducted by individuals and businesses to enable accurate and convenient tax filing. However, current systems make it difficult to manage this information comprehensively and automate the process in a manner compliant with the law. Furthermore, there is a lack of mechanisms to quickly obtain answers when users have questions, which contributes to the problem of the tax filing process being easily complicated.

[0788] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0789] In this invention, the server includes means for receiving input information and converting that information into structured data, means for performing tax calculations and automatically generating necessary documents, and support means for aggregating the user's payment history and organizing it by category. This enables the user to effectively utilize data obtained from electronic payments and file tax returns efficiently in compliance with the law. Furthermore, by responding to inquiries in real time, questions that arise during the filing process can be resolved quickly.

[0790] "Input information" refers to data on income and expenses provided by the user.

[0791] "Structured data" refers to data in which input information is organized according to categories and formats.

[0792] "Tax calculation" is the process of calculating the amount of tax using income and expense data in accordance with tax laws.

[0793] "Documents" refers to official documents required for tax filing.

[0794] "Legal compliance" means that the generated documents and data conform to current laws and regulations.

[0795] "Feedback" refers to information provided to users for verification and improvement.

[0796] "Real-time response" refers to providing instant answers to user inquiries.

[0797] A "generative model" is an algorithm that uses artificial intelligence technology to generate appropriate answers to inquiries.

[0798] "Inquiry processing" is a function that responds to questions and requests from users.

[0799] "Settlement history" refers to a record of financial transactions conducted by a user.

[0800] "Support for organizing by category" refers to the process of aggregating and classifying payment history based on its type and purpose.

[0801] "Automatic extraction of transaction information" is a technology that automatically identifies and extracts information necessary for tax filing from payment history.

[0802] The system for implementing this invention consists of the interaction of a server, a terminal, and a user. The user uses the terminal to input their income and expenses. The terminal receives this input information, converts it into structured data, and sends it to the server.

[0803] The server performs tax calculations based on the received structured data and automatically generates the necessary documents. This includes detailed calculations based on tax laws and automatic checks for compliance with the generated documents. The server also aggregates the user's payment history and provides support for organizing expenses and income by category. This makes it possible to quickly extract and classify the transaction information necessary for electronic filing.

[0804] Furthermore, the server has the capability to respond to user inquiries in real time using a generative AI model. This means that users can receive quick and accurate support whenever they have questions. Specifically, inquiries can be made using prompt sentences, and the server will provide answers based on appropriate guidance.

[0805] The hardware used includes devices such as smartphones and desktop computers, and Firebase Firestore is used as the database management system. TensorFlow and BERT are used for AI-based natural language processing. AWS Lambda is a suitable cloud service.

[0806] For example, when a user sends a question to the server such as, "Is this transaction eligible as an expense?", the server uses an AI model to analyze the transaction and provides specific guidelines in real time, such as, "If it is a purchase related to business operations, it may be considered."

[0807] An example of a prompt to a generative AI model is: "For the expense information entered by the user, please answer the question, 'Is this expense tax-deductible?'"

[0808] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0809] Step 1:

[0810] Users enter income and expense data using a terminal. This includes individual transactions and general expense information. The entered data is converted to a specific format on the terminal and prepared for transmission to the database.

[0811] Step 2:

[0812] The terminal converts the input information into structured data and sends it to the server. This structured data is organized by category and designed to clearly distinguish between income and expense items. This data is sent to the server in JSON format and used for analysis.

[0813] Step 3:

[0814] The server analyzes the received data and performs tax calculations based on the rules of the applicable tax laws. This includes calculating total income, deductible expenses, and the final tax amount. The calculation results are recorded internally and used in subsequent document generation processes.

[0815] Step 4:

[0816] The server automatically generates the necessary tax documents based on the analysis results. This includes creating documents in a legally compliant format, along with detailed calculation results. The generated documents are stored in a database and made available for user review.

[0817] Step 5:

[0818] The server checks the legal compliance of the generated documents. This process compares the generated data with the established tax law standards to check for errors or deficiencies. If necessary, data is prepared for sending feedback to the user.

[0819] Step 6:

[0820] In response to user inquiries, the server uses a generative AI model to create a response. Specifically, when a user submits a question through a prompt, the AI ​​refers to the input data and generates the optimal answer. This answer is then sent to the terminal immediately, based on natural language processing technology.

[0821] Step 7:

[0822] The server converts the finalized tax data into a format compatible with the electronic filing system. This process integrates documents and data, and performs data conversion according to the file formats and protocols required for electronic filing. The converted data is then displayed on the user's terminal for final confirmation.

[0823] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0824] This invention is a system for assisting with tax filing, providing more personalized support to users by combining it with an emotion engine that recognizes user emotions. The system functions through interaction between a server, a terminal, and the user.

[0825] In this system, users input income and expense details using a terminal. Since this information forms the basis of the system's processing, clear guidelines are provided for input. The terminal then transmits the entered data to the server.

[0826] The server structures the data, performs tax calculations based on it, and automatically generates the necessary documents. Furthermore, it performs legal checks and provides timely feedback to the user. This feedback is crucial for improving the accuracy of the user's tax filing activities.

[0827] A key feature of this invention is that the server incorporates an emotion engine. The emotion engine detects the user's stress and anxiety and generates feedback based on these. For example, if the user shows signs of stress during input, the engine generates and sends a relaxing message. This function reduces the user's mental burden and supports a smooth reporting process.

[0828] Furthermore, the server has the capability to respond to user questions in real time. Here, the emotion engine grasps the emotional nuances of the question and provides an answer in an appropriate tone. For example, an anxious question will receive a reassuring response.

[0829] In the final stage, the server converts all necessary documents into an electronic filing format and prompts the user to make a final confirmation of the filing. The user then completes the filing process using their terminal. By streamlining this entire process, the system provides a higher quality user experience.

[0830] For example, when a sole proprietor has to settle many expenses at the end of the fiscal year, the emotional engine's support can reduce stress and allow them to complete their tax filing quickly and accurately. In this process, users can enter data with confidence and resolve any questions immediately.

[0831] The following describes the processing flow.

[0832] Step 1:

[0833] The user uses the terminal to enter income and expense details. During this process, the user is prompted to follow the terminal's guide and enter more accurate data.

[0834] Step 2:

[0835] The terminal sends the input information to the server. The transmitted information includes the necessary fields for processing as structured data.

[0836] Step 3:

[0837] The server analyzes the received information and categorizes income and expenses appropriately. This categorization makes the data easier to process.

[0838] Step 4:

[0839] The server performs tax calculations based on the categorized data. This calculation accurately reflects all income and expenses, and determines the tax amount relevant to the user.

[0840] Step 5:

[0841] The server automatically generates the necessary tax documents, saving users the trouble of tedious paperwork.

[0842] Step 6:

[0843] The server automatically checks whether the generated documents comply with the law. This process helps prevent errors during filing.

[0844] Step 7:

[0845] The server uses an emotion engine to analyze user input and responses. For example, it analyzes input time and key typing speed to detect if the user may be experiencing stress.

[0846] Step 8:

[0847] The server provides feedback to the user based on the results of the sentiment analysis. This feedback may include reassuring messages or advice to help the user proceed smoothly.

[0848] Step 9:

[0849] Users can check feedback from the server on their devices and make corrections as needed. This allows users to confidently move on to the next step.

[0850] Step 10:

[0851] Once all the documents are ready, the server converts the data into an electronic filing format.

[0852] Step 11:

[0853] The user performs a final check and submits the electronic filing from their terminal. This action transmits the tax return to the tax authority's system.

[0854] Step 12:

[0855] The server confirms receipt of the declaration and terminates the declaration process by sending a completion notification to the user via the terminal.

[0856] (Example 2)

[0857] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0858] Current tax filing support systems only structure user-entered data, perform tax calculations, and automatically generate documents, making it difficult to provide support that addresses the user's emotional state. Furthermore, deficiencies in compliance checks and real-time responses to questions can increase the user's mental burden and potentially delay the filing process.

[0859] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0860] In this invention, the server includes means for structuring input information, means for performing calculations and automatically generating necessary information, means for automatically verifying legal compliance, means for responding to questions in real time using a generative model, and means for adjusting feedback according to the user's mental state using emotion recognition technology. This enables a smooth and legally compliant tax filing process while providing support tailored to the user's individual emotional state.

[0861] "Input information" refers to data about transactions and expenses provided by the user.

[0862] "Structuring" refers to the process of organizing received information into a certain format or style, making it easier to process.

[0863] A "generative model" refers to an algorithm or system that creates optimal feedback or responses based on input data and the user's state.

[0864] "Legal compliance" refers to the state in which the information or data created conforms to the relevant laws and regulations.

[0865] "Feedback" refers to advice and suggestions for improvement provided to users, and is used to enhance the user experience.

[0866] "Real-time response" refers to the process of providing immediate answers to user questions and inquiries.

[0867] "Emotion recognition technology" refers to methods for inferring a user's emotional state from their digital behavior and input data, and determining appropriate responses.

[0868] This invention is a system for assisting with tax filing and has the ability to recognize user emotions. This allows it to provide personalized support to the user.

[0869] Users use a terminal to enter detailed data about their transactions and expenses for the year. This terminal refers to a general computer or mobile device, and the interface is provided through a web browser or a dedicated application. The entered information is encrypted according to a predetermined security protocol and sent to the server.

[0870] The server structures the received data using specialized software. This organizes the data and puts it in a format suitable for processing by computations and generative models. This process incorporates algorithms that refer to the latest tax law database, automatically verifying that the generated data complies with the law.

[0871] The server also features a generative AI model that uses prompt messages to respond to user inquiries in real time. For example, a prompt message might ask, "Are there any points to be careful about when entering this month's expenses?" By using emotion recognition technology, the system estimates the user's stress level based on input speed and error rate, and sends messages to encourage relaxation as needed.

[0872] This allows users to continue their tax filing process with peace of mind, and any questions are answered immediately. As a result, it becomes possible to complete tax filing accurately and quickly while reducing stress.

[0873] This system is designed to make tax filing more efficient for sole proprietors and small and medium-sized enterprises, and its adaptability and accuracy are expected to lead to widespread use in many fields.

[0874] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0875] Step 1:

[0876] Users enter transaction and expense details using a terminal. The input interface is provided via a web browser or a dedicated application, and users enter each income and expense item according to the guidelines. This input data becomes the initial input to the system. The entered information is encrypted and sent to the server via a communication protocol.

[0877] Step 2:

[0878] The terminal uses the SSL / TLS protocol to ensure data security when sending entered information to the server. It checks the integrity of the transmitted data, verifying that there are no missing or incorrect entries. If the data is valid, it is forwarded to the server.

[0879] Step 3:

[0880] The server structures the received data using specialized software. The data is normalized and converted into a format that can be stored in the database. Data cleansing is applied to correct unnecessary whitespace and inconsistent data. This results in the output of normalized structured data.

[0881] Step 4:

[0882] The server performs calculations using structured data. This process utilizes tax-based calculation algorithms to calculate income tax and expense deductions. As a result of the calculations, the necessary tax documents are automatically generated and output.

[0883] Step 5:

[0884] The server verifies the legal compliance of the generated documents. It consults relevant legal databases to check if the content is appropriate. Based on the verification results, it generates feedback for the user. This feedback is sent to the user's terminal in a format that the user can review.

[0885] Step 6:

[0886] The server uses a generative AI model to respond to user questions in real time. When a user submits a question, an appropriate answer is generated using a prompt. Emotion recognition technology is used to provide feedback in a tone that matches the user's emotional state.

[0887] Step 7:

[0888] The server converts the final data into an electronic filing format and requests the user for final confirmation. The user reviews the content on their terminal and presses the approval button, at which point the data is securely transmitted to the tax authorities. This is the system's final output.

[0889] (Application Example 2)

[0890] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0891] The goal is to reduce the stress and anxiety users experience when filing financial statements or making electronic payments, and to provide a smoother and more secure process.

[0892] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0893] In this invention, the server includes means for receiving input information and converting that information into structured data, means for performing financial calculations and automatically generating necessary documents, and means for analyzing the user's emotional state in real time and providing support. This allows the user to proceed with procedures quickly and accurately while feeling secure.

[0894] "Input information" refers to detailed data about income and expenses that users provide when performing a procedure.

[0895] "Structured data" refers to data that has been transformed into a unified format based on input information, making it easier to analyze and process.

[0896] "Financial calculation" refers to the process of performing necessary financial calculations based on structured data and preparing appropriate financial statements.

[0897] A "document" is an official document that contains information necessary for procedures or declarations.

[0898] "Compliance with regulations" refers to the standard used to ensure that generated documents and procedures properly adhere to relevant laws and regulations.

[0899] "Feedback" refers to the provision of information that allows users to receive feedback on the accuracy of procedures and suggestions for improvement during the process.

[0900] "Data for electronic submission" refers to a dataset prepared for electronic application and reporting.

[0901] A "generative model" is an artificial intelligence-based program or algorithm used to create appropriate responses to user inquiries in real time.

[0902] "Emotional state" refers to the psychological conditions, such as stress and anxiety, that a user exhibits during the process.

[0903] "Providing support" means offering technical and psychological assistance to users so that they can proceed with the process smoothly.

[0904] This invention is implemented by a system in which a server, terminal, and user work together. The server receives input information provided by the user and converts it into structured data. In this process, the user directly inputs data using a terminal such as a smartphone or computer. The structured data is stored in a well-known database system such as MySQL or PostgreSQL.

[0905] The server then performs financial calculations based on the structured data and automatically generates the necessary documents. This calculation process is carried out using programming languages ​​such as Python and R, and data analysis libraries such as NumPy and Pandas. The generated documents are converted to PDF format using Adobe PDF Library or similar services and provided to the user for review.

[0906] The server then automatically checks for compliance with legal regulations. This uses rule engines such as Drools or OpenRules. Feedback is provided to the user in real time, and data for electronic submission is prepared.

[0907] The server is equipped with sentiment analysis models using Google Cloud Vision and Amazon Rekognition. This allows it to analyze the user's emotional state and provide appropriate support. When stress or anxiety is detected in the user, automatically generated calming messages are sent to the user's device.

[0908] As a concrete example, when a user makes a large online payment, the terminal's camera captures the user's facial expression, which is then analyzed by a server. If the user expresses concern, a reassuring message is displayed, such as, "This seller has achieved 100% customer satisfaction in the past 100 transactions."

[0909] An example of a prompt message generated using an AI model is: "The user is feeling uneasy on the payment screen. Please suggest ways to reassure them using past successful transaction data." This allows the user to proceed with the transaction with confidence.

[0910] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0911] Step 1:

[0912] Users use a terminal to enter details about their income and expenses. The input data is organized by field and sent from the terminal to the server. This allows the server to receive the input information to create structured data.

[0913] Step 2:

[0914] The server converts the received input information into structured data. Here, a database system (such as MySQL or PostgreSQL) is used to systematically store the data and format it for easier use in subsequent processing. The output of this process forms the dataset that underlies financial calculations.

[0915] Step 3:

[0916] The server performs financial calculations using structured data. It uses programming languages ​​such as Python and R, along with data analysis libraries like NumPy and Pandas, to calculate necessary financial indicators. The results of these calculations generate financial documents to be presented to the user, and these documents are converted to PDF format using Adobe PDF Library or similar tools.

[0917] Step 4:

[0918] The server verifies the compliance of the generated documents. This is done using rule engines such as Drools or OpenRules. The input is laws and regulations, and the output is a compliance status report.

[0919] Step 5:

[0920] The server analyzes the user's emotional state in real time. It analyzes facial image data acquired from the device's camera using APIs such as Google Cloud Vision and Amazon Rekognition. If user stress or anxiety is detected, a support message is automatically generated and sent to the user based on the results.

[0921] Step 6:

[0922] The server sends prompt sentences based on the sentiment analysis results to an AI model that generates appropriate feedback messages. For example, a prompt such as "The user is feeling anxious on the payment screen. Use past successful transaction data to suggest ways to reassure them" might be used. The output would be a specific message designed to alleviate the user's anxiety.

[0923] Step 7:

[0924] Users review the data for electronic submission via their terminal and then perform the final submission operation. This completes the entire process, enabling smooth tax filing and settlement.

[0925] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0926] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0927] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0928] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0929] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0930] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0931] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0932] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0933] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0934] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0935] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0936] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0937] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0938] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0939] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0940] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0941] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0942] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0943] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0944] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0945] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0946] The following is further disclosed regarding the embodiments described above.

[0947] (Claim 1)

[0948] A means for receiving input information and converting that information into structured data,

[0949] A means for performing tax calculations and automatically generating necessary documents based on the aforementioned structured data,

[0950] A means to automatically check the legal compliance of the generated documents,

[0951] A means of providing feedback to users and preparing data for electronic filing,

[0952] A query processing method using a generative model that responds to user questions in real time,

[0953] A system that includes this.

[0954] (Claim 2)

[0955] The system according to claim 1, wherein the input information includes details of income and expenses.

[0956] (Claim 3)

[0957] The system according to claim 1, which performs conversion to a format compatible with the electronic filing system.

[0958] "Example 1"

[0959] (Claim 1)

[0960] A means for receiving input information and converting that information into a data structure,

[0961] A means for performing financial calculations and automatically generating necessary documents based on the aforementioned data structure,

[0962] A means to automatically check the legal compliance of the generated documents,

[0963] A means of providing confirmation information to users and preparing data for electronic reporting,

[0964] A query processing method using a generative model that responds to user questions in real time,

[0965] A means for transmitting user input data to an information processing device,

[0966] A means by which an information processing device encrypts and protects data,

[0967] A system that includes this.

[0968] (Claim 2)

[0969] The system according to claim 1, wherein the input information includes details of income and expenses.

[0970] (Claim 3)

[0971] The system according to claim 1, which converts to a format suitable for an electronic reporting system.

[0972] "Application Example 1"

[0973] (Claim 1)

[0974] A means for receiving input information and converting that information into structured data,

[0975] A means for performing tax calculations and automatically generating necessary documents based on the aforementioned structured data,

[0976] A means to automatically check the legal compliance of the generated documents,

[0977] A means of providing feedback to users and preparing data for electronic filing,

[0978] A query processing method using a generative model that responds to user questions in real time,

[0979] A support tool for aggregating and categorizing users' payment history,

[0980] A means of automatically extracting and classifying transaction information necessary for electronic filing,

[0981] A system that includes this.

[0982] (Claim 2)

[0983] The system according to claim 1, wherein the input information includes details of income and expenses.

[0984] (Claim 3)

[0985] The system according to claim 1, which converts data into a data format compatible with an electronic filing system.

[0986] "Example 2 of combining an emotion engine"

[0987] (Claim 1)

[0988] A means of receiving input information and structuring that information,

[0989] A means for performing calculations based on the aforementioned structured information and automatically generating the necessary information,

[0990] A means to automatically verify legal compliance for the generated information,

[0991] A means of providing feedback to users and preparing data for electronic transmission,

[0992] A means of responding to user questions in real time using a generative model and generating feedback through prompt statements,

[0993] A means of using emotion recognition technology to adjust the feedback according to the user's mental state,

[0994] A system that includes this.

[0995] (Claim 2)

[0996] The system according to claim 1, wherein the input information includes details of transactions and expenditures.

[0997] (Claim 3)

[0998] The system according to claim 1, which performs conversion to a format compatible with an electronic transmission system.

[0999] "Application example 2 when combining with an emotional engine"

[1000] (Claim 1)

[1001] A means for receiving input information and converting that information into structured data,

[1002] A means for performing financial calculations and automatically generating necessary documents based on the aforementioned structured data,

[1003] A means of automatically checking the compliance of generated documents with respect to rules,

[1004] A means of providing feedback to users and preparing data for electronic submission,

[1005] A query processing method using a generative model that responds to user questions in real time,

[1006] A means of analyzing the emotional state of users and providing support,

[1007] A system that includes this.

[1008] (Claim 2)

[1009] The system according to claim 1, wherein the input information includes details of income and expenses.

[1010] (Claim 3)

[1011] The system according to claim 1, which converts to a format compatible with an electronic submission system. [Explanation of symbols]

[1012] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for receiving input information and converting that information into structured data, A means for performing tax calculations and automatically generating necessary documents based on the aforementioned structured data, A means to automatically check the legal compliance of the generated documents, A means of providing feedback to users and preparing data for electronic filing, A query processing method using a generative model that responds to user questions in real time, A support tool for aggregating and categorizing users' payment history, A means of automatically extracting and classifying transaction information necessary for electronic filing, A system that includes this.

2. The system according to claim 1, wherein the input information includes details of income and expenses.

3. The system according to claim 1, which performs conversion to a data format compatible with an electronic filing system.

Images