system

Abstract

We provide the system. [Solution] A means of reading code information on the user's terminal, Means for transmitting code information to an information processing device, A means for identifying a target product by referring to a product information database using code information received in an information processing device, A means for recording the purchase price and purchase date in a user information database, A means of automatically generating a declaration document based on the user's purchase history in response to their declaration request, A means of sending the declaration document to the user's terminal, allowing for confirmation and correction, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The current self-medication tax system provides an income deduction for the purchase of specific pharmaceuticals. However, many consumers cannot effectively utilize this system due to the complexity of the application procedures, and there are problems such as difficulty in discriminating target pharmaceuticals and managing purchase histories. As a result, a situation has occurred where the benefits of the tax system cannot be fully enjoyed.

Means for Solving the Problems

[0005] This invention solves the problem by providing a system that reads the barcode of a pharmaceutical product using a user terminal and transmits that information to a server. Based on the received information, the server refers to a pharmaceutical database to identify the target product and records the purchase price and purchase date in the user database. Furthermore, it automatically generates a declaration form based on the purchase history according to the user's request, thereby streamlining the application process.

[0006] A "user terminal" is a device operated by a user, equipped with the functionality to execute application programs and read barcodes.

[0007] A "barcode" is a pattern that encodes information associated with a product, and is converted into digital data when read by an optical scanner.

[0008] A "server" is a computer system that exchanges data with user terminals via a network and has the function of referencing a database based on barcode information.

[0009] A "pharmaceutical database" is a collection of information that holds detailed information about pharmaceuticals based on specific identification information, and is used to help identify the target product.

[0010] "Eligible products" refer to pharmaceuticals that are eligible for deductions under the self-medication tax system and that meet specific criteria.

[0011] "Purchase amount" refers to information indicating the total amount of money a user paid when purchasing pharmaceuticals.

[0012] "Purchase date" refers to information indicating the specific date on which the user purchased the medication.

[0013] A "user database" is a type of data storage used to store each user's purchase history and related information.

[0014] A "declaration form" is a document submitted by a user for tax purposes, and is particularly used to apply for the self-medication tax deduction based on the purchase history of pharmaceuticals. [Brief explanation of the drawing]

[0015] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when combined with an emotion engine.

Embodiments for Carrying Out the Invention

[0016] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), etc.

[0019] In the following embodiments, a labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0020] In the following embodiments, a labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0021] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0023] [First Embodiment]

[0024] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0025] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0028] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0031] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0035] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0036] This invention relates to a system that supports users in filing self-medication tax returns based on their purchase of pharmaceuticals. First, when a user purchases pharmaceuticals, they launch a dedicated application on their terminal and scan the barcode of the medication. The terminal uses its camera to read the barcode information and transmits that information to a server.

[0037] Based on the received barcode information, the server consults a pharmaceutical database to determine if the medication is eligible for the self-medication tax deduction. If it is determined to be eligible, the server then receives information from the user regarding the purchase price and date, and records this information in the user database. This database management ensures that each user's purchase history is accurately maintained.

[0038] In particular, during the filing process, users can use their terminal to request the server to automatically generate a tax return. The server then compiles the necessary information based on the user's purchase history and automatically generates the income deduction tax return. The generated return is sent to the terminal in electronic format, allowing the user to review and correct it. The user then finalizes the return and, if necessary, prints it or submits it electronically to the tax authorities. This entire process allows users to apply for the self-medication tax deduction accurately and quickly, without any hassle.

[0039] As a concrete example, suppose a user purchases medicine at a store and scans the barcode of the medicine with the camera on their terminal. The terminal sends the barcode data to a server, which identifies it as the target medicine. The user then enters the purchase amount, and the server records this information in a database. Later, when it is time to submit an application, the user requests the creation of a declaration form through the system. An automatically generated declaration form is sent to the terminal, and the user can review it and formally submit their application.

[0040] The following describes the processing flow.

[0041] Step 1:

[0042] When a user purchases medication, they open an application on their device and activate the barcode scanning function. The device uses its camera to read the barcode.

[0043] Step 2:

[0044] The terminal converts the scanned barcode information into text data and sends it to the server.

[0045] Step 3:

[0046] The server uses the received barcode data to search the pharmaceutical database and determines whether the product is eligible for the self-medication tax deduction.

[0047] Step 4:

[0048] Once the server determines that the item is the target product, it sends a confirmation message to the terminal. The user then enters the purchase price into the terminal.

[0049] Step 5:

[0050] The terminal sends the purchase amount and date / time entered by the user to the server. The server then records this information in the user database.

[0051] Step 6:

[0052] The user requests the server to generate the tax return from their terminal at the time the tax return is generated.

[0053] Step 7:

[0054] The server aggregates purchase history data for each user and automatically generates a declaration form based on that data. The generated declaration form is then converted into an electronic format and sent to the terminal.

[0055] Step 8:

[0056] The user reviews the tax return generated on their device and makes any necessary corrections. Once the corrections are complete, they finalize the return and submit it to the tax authorities as electronic data or a printed copy.

[0057] (Example 1)

[0058] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0059] The traditional self-medication tax declaration process was cumbersome, requiring users to manage purchase history and prepare declaration forms, thus demanding a significant amount of effort. Furthermore, manual management raised concerns about human error, highlighting the need for a more efficient and accurate method.

[0060] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0061] In this invention, the server includes means for identifying the target item by referring to an information storage device using received identification information, means for recording the transaction amount and transaction date in a user information storage device, and means for automatically generating a declaration document based on the transaction history according to the declaration request. This enables the user to file a self-medication tax return efficiently and accurately.

[0062] A "user device" is an electronic device used for inputting information or displaying received information.

[0063] "Identification information" refers to data that represents information specific to each item, and by using this information, a particular item can be identified.

[0064] An "electronic computing device" is a computer system that receives, processes, and transmits data.

[0065] An "information storage device" is a database or similar storage system for storing and managing various types of data.

[0066] "Target items" refer to products that meet specific conditions and are identified by the system.

[0067] "Transaction amount" refers to information indicating the monetary value of goods in a purchase or transaction.

[0068] "Transaction date" refers to information indicating the date on which a particular transaction was executed.

[0069] A "user information storage device" is a system that stores and manages individual transaction information and data related to users.

[0070] A "tax declaration document" is a formal document that contains information necessary primarily for tax purposes.

[0071] "Encrypted communication" refers to a communication method that uses technology to transform data in order to securely send and receive information.

[0072] This invention is a system for efficiently filing self-medication tax returns. The system aims to easily and accurately manage information about purchased medications and automatically generate tax returns. First, the user launches a dedicated application on a device such as a smartphone or tablet and scans the barcode of the medication. At this time, the device uses its built-in camera to acquire identification information from the barcode.

[0073] The terminal sends the generated identification information to the server. The server functions as a computer and uses the received identification information to refer to an information storage device (database) to determine whether the pharmaceutical product is eligible for tax reduction. If it is determined to be eligible, the server receives information about the transaction amount and transaction date from the user and records this in the user information storage device. This ensures that each user's purchase history is accurately maintained.

[0074] Furthermore, during the filing period, users can request the server to automatically generate filing documents via their terminal. The server, in response, generates the necessary filing documents in electronic format based on purchase history data stored in the information storage device and sends them to the terminal. Users can then review the contents of the filing documents on their terminal and make corrections as needed. The finalized filing can then be printed or submitted electronically to the tax authorities.

[0075] As a concrete example, suppose a user purchases a nutritional supplement at a pharmacy and scans the barcode printed on the package using a dedicated app. The terminal sends the barcode data to a server, which uses a database to determine if it is eligible for a tax deduction. The user then enters the purchase amount in the app, and this information is recorded on the server. Later, the user can request the system to create a tax return, receive an automatically generated return, and easily file their tax return.

[0076] The following prompt can be used for the generating AI model: "Design a system that automatically generates income tax deduction forms based on purchase history required for self-medication tax filing. A dedicated app scans the barcode of medicines, and a server refers to a database to identify tax-deductible items."

[0077] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0078] Step 1:

[0079] The user launches a dedicated application on their device and scans the barcode of the purchased medication. Specifically, the device's camera is used to read the barcode, and the digital data is captured within the app. At this stage, the input is the image data of the barcode captured by the camera, and the output is string information based on the barcode.

[0080] Step 2:

[0081] The terminal transmits the acquired barcode information to the server. This communication takes place via an internet connection, ensuring the secure transmission of the barcode information. The input here is the barcode information as string data, and the output is the barcode information received by the server.

[0082] Step 3:

[0083] The server uses the received barcode information to refer to the drug information storage device and determine whether the item is eligible for the self-medication tax deduction. The input is barcode information in string format, and a database query is executed to search for drug records. The output is either a boolean value as the determination result or detailed information about the drug.

[0084] Step 4:

[0085] If the item is identified as a target item, the server will prompt the user to enter the transaction amount and transaction date. The user then enters and submits the necessary data via the app. The input consists of numerical and date data entered by the user into the app, and the output is the corresponding data received by the server.

[0086] Step 5:

[0087] The server records the received transaction amount and transaction date in the user information storage device. This creates a purchase history for each user. The input is numerical and date data obtained from the user, and the output is the updated purchase history record in the database.

[0088] Step 6:

[0089] During the filing period, users request the server to automatically generate filing documents via their device. This operation is performed by clicking a specific button on the app. The input is the request to generate the filing document, and the output is the trigger for the filing document generation process on the server.

[0090] Step 7:

[0091] The server retrieves purchase history from the user information storage device and automatically generates income tax deduction declaration documents. This includes data aggregation and format conversion. The input is the user's purchase history data, and the output is a declaration document in electronic format.

[0092] Step 8:

[0093] The server sends the generated declaration document to the terminal and prompts the user for confirmation. The user can view the declaration document on the app and make corrections as needed. After confirmation and correction, the user saves or submits the finalized declaration. The input is the declaration document, and the output is the user-approved and corrected final declaration document.

[0094] (Application Example 1)

[0095] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0096] For modern consumers, efficiently and accurately identifying which products they purchase daily qualify for tax deductions is difficult. Furthermore, claiming deductions requires accurate tax returns, which are time-consuming and laborious to prepare. Traditional methods involve manual management and record-keeping, leading to delays and errors, highlighting the need for improvement.

[0097] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0098] In this invention, the server includes means for reading code information on a user terminal, means for transmitting the code information to an information processing device, and means for using the received code information in the information processing device to refer to a product information database and identify the target product. This enables the user to efficiently identify products eligible for tax deductions and automatically generate accurate tax returns.

[0099] A "user terminal" is an electronic device that has the function of reading code information and transmitting it to an information processing device.

[0100] "Code information" refers to encoded data used for product identification and information retrieval.

[0101] An "information processing device" is a computer system that processes code information received from a user terminal and identifies the target product by referring to a product information database.

[0102] A "product information database" is a data aggregation system that structures and stores information about various products, enabling searching and identification.

[0103] "Eligible products" refer to products that meet specific conditions when applying for tax deductions.

[0104] "Purchase price" refers to the amount the user paid when purchasing the product.

[0105] "Purchase date" refers to the date on which the user purchased the product.

[0106] A "user information database" is a data aggregation system that manages each user's purchase history and personal information.

[0107] A "declaration document" is a document automatically generated based on the user's purchase history in order to apply for tax deductions.

[0108] The system realizing this invention mainly consists of a user terminal, an information processing device, a product information database, a user information database, and a tax return generation module. The user terminal has a function to read product code information using a camera. This code information is transmitted to the information processing device using wireless communication technology. The information processing device operates on a server and, based on the received code information, refers to the product information database to determine whether the purchased product is eligible for tax deductions.

[0109] If the information processing device determines that a product is eligible for a deduction, it records the purchase price and purchase date in the user information database. This database holds each user's purchase history and personal information and is updated as needed. If a user wishes to file a declaration at any time, they can use the declaration form generation module to automatically generate a declaration document based on their purchase history. This declaration document is sent to the user's terminal, where the user can review and modify it.

[0110] As a concrete example, when a user scans the barcode of a health supplement they regularly purchase with their smartphone camera, the product information is automatically cross-referenced with a database, and it is immediately determined whether or not it is eligible for a tax deduction. If the product is eligible for a deduction, the information is automatically recorded, and at the end of the month, a tax deduction application form is automatically generated and sent to the user's smartphone.

[0111] An example of a prompt is the requirement: "Design a smartphone app to streamline the filing of self-medication tax returns. It will include an algorithm that scans barcodes and matches product information against a database."

[0112] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0113] Step 1:

[0114] The user's terminal reads the product's code information.

[0115] The user scans the product's barcode using the camera on their device. The input is the camera image, and the barcode data is extracted through image processing. The output is the code information.

[0116] Step 2:

[0117] The terminal transmits code information to the information processing device.

[0118] The terminal transmits the extracted barcode data to the server via wireless communication. The input is barcode data, which is converted into digital data according to the communication protocol and then transmitted. The server receives the barcode information as output.

[0119] Step 3:

[0120] The server identifies the target product by referring to the product information database.

[0121] The server queries the product information database based on the received barcode information and retrieves information about the corresponding product. The input is barcode information, and product information is obtained by searching the database. The output is a result that determines whether the product is eligible for tax deductions.

[0122] Step 4:

[0123] The server records the purchase price and purchase date in the user information database.

[0124] The server receives the price and date entered by the user when purchasing a product, and if it is the applicable product, it records it in the user information database. The input consists of the purchase date and price information, and a database write operation is performed. As output, the history is stored in the user information database.

[0125] Step 5:

[0126] The user makes a request to generate a declaration document.

[0127] The user sends instructions to the server via their terminal to create the tax return. The input is the user's request, and the server initiates the corresponding processing. As output, the server executes the tax return generation process.

[0128] Step 6:

[0129] The server automatically generates the declaration document and sends it to the user's terminal.

[0130] The server creates an electronic declaration document based on the purchase history in the user information database and sends it to the user's terminal. The input is the user's purchase history information, and the output document is generated through a data formatting and document creation process. As output, the declaration document is sent to the user's terminal.

[0131] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0132] This invention combines a system that supports users in filing self-medication tax returns based on their purchase of pharmaceuticals with an emotion engine that recognizes the user's emotions. In this system, when a user purchases pharmaceuticals, they first launch a dedicated application on their terminal and scan the drug's barcode. The terminal uses its camera to read the barcode information and transmits this information to a server. The server refers to a pharmaceutical database based on the received barcode information and determines whether the product is eligible for the self-medication tax deduction. If it is determined to be an eligible product, the server receives information from the user regarding the purchase amount and purchase date and records this information in the user database.

[0133] Furthermore, the user terminal is equipped with an emotion engine that collects emotional data from the user's facial expressions and voice during operation. The emotion engine analyzes this data to identify the user's emotional state. This information is used to dynamically adjust the user interface and improve the user experience. For example, if the emotion engine detects stress or anxiety when a user is checking their purchase history, the terminal will display reminders and guides to help the user proceed smoothly.

[0134] During the filing period, the user requests the server to generate a tax return from their device. The server compiles the necessary information based on the user's purchase history and automatically generates the tax return. Even during this process, the emotion engine monitors the user's state and reduces user burden by presenting relaxing messages and options as needed. The generated tax return is sent to the device in electronic format, allowing the user to review and make corrections. The user can then print the finalized tax return or submit it electronically to the tax authorities.

[0135] As a concrete example, suppose a user purchases medication and scans the barcode with the terminal's camera. The terminal recognizes the user's emotion of joy from their facial expression at that moment. Based on this information, the emotion engine changes the user interface to a brighter color scheme and makes adjustments to facilitate smoother operation. Later, if the system detects user stress at the time of application, it suggests simplified procedures and provides support optimized for the user's state. This allows the user to effectively complete the electronic filing process.

[0136] The following describes the processing flow.

[0137] Step 1:

[0138] When a user purchases medication, they launch the application on their device and select barcode scanning mode. The device then activates its camera and accurately reads the barcode.

[0139] Step 2:

[0140] The terminal converts the scanned barcode information into text data and sends this information to the server via the internet.

[0141] Step 3:

[0142] The server analyzes the received barcode information and refers to the pharmaceutical database to determine whether the drug is eligible for the self-medication tax deduction.

[0143] Step 4:

[0144] If the server determines that the product is eligible, it sends the relevant information to the user's terminal. The user enters the purchase price and sends it from the terminal to the server.

[0145] Step 5:

[0146] The server records the submitted purchase amount and purchase date in a database entry for each user. This database is used as administrative information for future reporting.

[0147] Step 6:

[0148] An emotion engine built into the device analyzes the user's facial expressions and voice during operation, and evaluates the user's emotional state in real time.

[0149] Step 7:

[0150] If the emotion engine detects user stress or anxiety, the device will implement interface adjustments to provide the user with messages and procedures to help them relax.

[0151] Step 8:

[0152] When a user wishes to generate a declaration form, they send a request from their device to the server. The server compiles the purchase history and automatically generates the declaration form.

[0153] Step 9:

[0154] The generated declaration is sent to the device, where the user reviews it and makes corrections as needed. The emotion engine monitors the user's state throughout this process and provides appropriate support.

[0155] Step 10:

[0156] After the user has finalized their tax return, the terminal assists them in submitting the return to the tax authorities as electronic data or by printing it out.

[0157] (Example 2)

[0158] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0159] Traditional tax reporting processes for pharmaceutical purchases are complex and burdensome for users due to the manual nature of the work, making efficient and accurate reporting difficult. Furthermore, the stress and anxiety associated with the reporting process detract from the user experience, resulting in delays and errors in reporting. Additionally, the user interface is inadequately adapted to emotional fluctuations.

[0160] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0161] In this invention, the server includes means for referring to a product information collection using identification code information to identify the target product, means for automatically generating documents based on purchase history, and means for dynamically adjusting the user interface using an emotion analysis engine. This makes it possible to streamline tax filing and provide a smooth filing procedure that reduces stress and anxiety by adjusting the interface according to the user's emotional state.

[0162] A "user device" is an electronic device intended for user operation and is responsible for collecting and transmitting data.

[0163] An "identification code" is a machine-readable symbol or number used to identify a product or service.

[0164] An "information processing device" is a central computing device that receives, processes, stores, and transmits data.

[0165] A "product information database" is a collection of data containing information about a wide variety of products, and is particularly used as a database to classify products according to specific criteria.

[0166] A "storage device" is a hardware or software component for recording and storing digital data.

[0167] An "emotion analysis engine" is a software component that analyzes a user's emotional state based on data collected from the user and adjusts the response as needed.

[0168] "User interface" is a general term for the screen layout and operating elements that enable interaction between a user and an electronic device.

[0169] "Electronic notification" is the process of sending information or messages to users in an electronic format.

[0170] "Tax-reduced" refers to goods or services that, under tax law, are eligible for a reduction in tax burden by meeting specific conditions.

[0171] A "document" is an electronic or physical record that formalizes and records information or data.

[0172] This invention is a system that assists users in purchasing pharmaceuticals and efficiently claiming tax benefits. The system includes a user device, an information processing device, and a sentiment analysis engine. Details of each component and their operation are described below.

[0173] User equipment

[0174] Users use a portable digital information terminal (PDCA) when purchasing pharmaceuticals. This terminal is equipped with a camera, which is used to read identification codes (barcodes). Dedicated image processing software is used for barcode scanning. For example, the OpenCV library is used to extract barcode information from image data.

[0175] Information processing device

[0176] The identification code information read by the terminal is transmitted to the information processing device via a secure communication method (e.g., HTTPS protocol). The information processing device receives this information and queries the product information database to determine whether the product is eligible for tax reduction. This database stores detailed information about pharmaceuticals and is managed using a database management system such as SQL.

[0177] Emotion analysis engine

[0178] The user device incorporates an emotion analysis engine that collects and analyzes emotional data through cameras and microphones during user operation. Deep learning models are used for the analysis to identify the user's emotional state. This information is immediately reflected in the user interface, and the visual elements of the interface are dynamically adjusted.

[0179] Specific example

[0180] For example, a user purchases medicine using the system and scans the barcode with the terminal's camera. The terminal communicates with an information processing device to confirm that the product is eligible for tax benefits. An emotion analysis engine detects the user's stress level, changes the interface to a relaxing color scheme, and presents simplified operating instructions.

[0181] Example of a prompt

[0182] "Please describe the process of scanning the barcode of a medication purchased by the user to determine if it is a valid product. Also, demonstrate how the interface dynamically adjusts based on the user's emotional state."

[0183] The system, configured in this way, aims to streamline tax declarations related to pharmaceutical purchases while taking user emotions into consideration.

[0184] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0185] Step 1:

[0186] The user purchases medication and launches a dedicated application on the terminal. The application controls the camera and prepares to scan the barcode. The input is a physical barcode, and the output is barcode data. This data is processed as an identification code and used in the next step.

[0187] Step 2:

[0188] The terminal uses a camera to read barcodes. The read barcode data is decoded using an image processing library. The input is image data captured by the camera, and the output is an identification code in text format. This code is sent to an information processing device for drug identification.

[0189] Step 3:

[0190] The terminal transmits an identification code to the information processing device. The HTTPS protocol is used during transmission to ensure data security. The input is an identification code in text format, and the output is a secure data transmission to the information processing device.

[0191] Step 4:

[0192] The server queries the product information database using the received identification code. The input is the identification code, and the output is the product information retrieved from the database. Here, the server also determines whether the product is eligible for tax reduction.

[0193] Step 5:

[0194] The server stores purchase records in the user database based on product information. Inputs are product information and user purchase details, and output is the addition of new records to the user database. The purchase amount and date are accurately recorded.

[0195] Step 6:

[0196] While the user is interacting with the device, the terminal uses an emotion analysis engine to collect facial expression and audio data. The input is real-time audio and image data, and the output is the analysis result of the user's emotional state. Based on these results, the interface's color scheme and recommended actions are dynamically changed.

[0197] Step 7:

[0198] During the tax filing period, users request to create a tax return from their terminal. The server aggregates the user's purchase history and automatically generates a tax return with the necessary fields filled in. The input is the user's purchase history, and the output is a tax return in electronic format.

[0199] Step 8:

[0200] The generated declaration form is sent to the terminal, where the user reviews and modifies it. The input is the initial declaration form data received from the server, and the output is the final declaration form modified by the user. The user can perform the operation while receiving interface guidance to reduce stress.

[0201] (Application Example 2)

[0202] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0203] Purchasing activities and tax filing procedures for users are often complex, time-consuming, and can be stressful. In particular, when utilizing tax reduction schemes, identifying eligible products and preparing tax returns can be burdensome for users. Furthermore, the lack of consideration for users' emotional states can hinder the smoothness of the process. The payment process itself can also be a source of emotional stress for users.

[0204] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0205] In this invention, the server includes means for referencing a product database using barcode information to identify the target product, means for analyzing the user's emotional state, and means for dynamically adjusting the user interface based on the emotional state to reduce emotional burden during declaration form creation and payment support. As a result, the user can perform the entire process from product purchase to declaration procedures stress-free.

[0206] A "user terminal" is an electronic device used by a user to scan product barcodes, display information, and operate devices.

[0207] "Barcode information" refers to information that contains unique identification data about a product and is transmitted to a server to identify the target product.

[0208] A "server" is a computer system that receives information sent from user terminals and performs database lookups and information processing.

[0209] A "product database" is a data storage system that stores information about various products, allowing a server to refer to it and identify the target product.

[0210] A "user database" is a data storage system that records users' purchase history and declaration information, making it accessible as needed.

[0211] "Automatic generation of declaration forms" refers to the process of automatically compiling necessary information based on the user's purchase history and creating documents for declaration purposes.

[0212] "Emotional state" refers to the user's psychological state, analyzed based on facial expressions and voice observed during user interaction.

[0213] "Analysis means" refers to software and algorithms that use an emotion engine to collect the user's facial expressions and voice, and analyze their emotional state based on that data.

[0214] "Dynamic user interface adjustments" refer to adjustments made to improve the user experience by changing the screen display and operation methods in response to the user's emotions.

[0215] The system for implementing this invention consists of a user terminal, a server, a database, and an emotion analysis engine.

[0216] The user terminal is an electronic device such as a smartphone, which scans the product's barcode with its camera and acquires it as digital data. The acquired barcode information is transmitted to a server via wireless communication. Image recognition software is used in this process.

[0217] The server uses the received barcode information to refer to the product database and determine whether the product is subject to taxation. The server also records relevant information, such as the purchase price and date, in the user database. Data management software and a database management system are used for data processing.

[0218] Furthermore, the user terminal has a built-in emotion analysis engine that analyzes the user's facial expressions and voice to identify their emotional state. Emotion analysis uses machine learning algorithms and voice analysis technology. If the user is experiencing stress, the user interface is adjusted to make it more user-friendly and intuitive to use.

[0219] For example, when a user purchases medication and scans its barcode, if the emotion engine detects a feeling of joy, the background of the displayed screen will change to a brighter color and provide positive feedback to smooth the operation. Also, if the user expresses anxiety while creating a declaration, the server will present simplified instructions.

[0220] Examples of prompts to input into the generating AI model include, "What is a sentiment-based UI optimization method to display to users during payment?" and "Please suggest application features to reduce user stress while shopping."

[0221] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0222] Step 1:

[0223] The user uses a device to scan the product's barcode.

[0224] The input is image data of a barcode acquired through a camera, and the output is digitized data of the barcode information. This data is analyzed by image recognition software, and the barcode information is extracted.

[0225] Step 2:

[0226] The terminal sends the extracted barcode information to the server.

[0227] The input is digitized barcode information, and the output is wireless data transmission to a server. This includes specific actions to transmit information accurately and quickly using a communication protocol.

[0228] Step 3:

[0229] The server uses the received barcode information to refer to the product database and identify the target product.

[0230] The input is barcode information received from a terminal, and the output is whether or not the item is subject to taxation and related information. A database management system is used to execute queries and perform specific data calculations to obtain the desired product information.

[0231] Step 4:

[0232] The server records the user's purchase amount and date in the user database.

[0233] The input is the amount and purchase date information obtained from the buyer, and the output is the result of recording it in the user database. A database management system is used to perform the specific operations to persist the information.

[0234] Step 5:

[0235] The device's emotion analysis engine analyzes the user's emotional state.

[0236] The input is the user's facial expressions and voice data, and the output is the analyzed emotional state. A machine learning algorithm is used to analyze the emotional data and perform specific data calculations to classify the emotions.

[0237] Step 6:

[0238] The device dynamically adjusts the user interface based on the analyzed emotional state.

[0239] The input is the analyzed emotional state, and the output is the display of the adjusted interface. Specific actions are performed to modify the interface elements using UI design software.

[0240] Step 7:

[0241] The server automatically generates a declaration form using the user's purchase history in response to their declaration request, and aggregates information from the user database.

[0242] The input is the purchase history recorded in the user database, and the output is a digital document of the declaration form. A template is used to perform the specific process of filling in the necessary items and generating the document.

[0243] Step 8:

[0244] Users review and correct the declaration forms generated using their devices.

[0245] The input is a digital tax return document received from the server, and the output is the final tax return. The interface allows users to directly modify the content through editing.

[0246] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0247] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0248] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0249] [Second Embodiment]

[0250] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0251] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0252] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0253] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0254] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0255] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0256] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0257] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0258] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0259] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0260] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0261] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0262] This invention relates to a system that supports users in filing self-medication tax returns based on their purchase of pharmaceuticals. First, when a user purchases pharmaceuticals, they launch a dedicated application on their terminal and scan the barcode of the medication. The terminal uses its camera to read the barcode information and transmits that information to a server.

[0263] Based on the received barcode information, the server consults a pharmaceutical database to determine if the medication is eligible for the self-medication tax deduction. If it is determined to be eligible, the server then receives information from the user regarding the purchase price and date, and records this information in the user database. This database management ensures that each user's purchase history is accurately maintained.

[0264] In particular, during the filing process, users can use their terminal to request the server to automatically generate a tax return. The server then compiles the necessary information based on the user's purchase history and automatically generates the income deduction tax return. The generated return is sent to the terminal in electronic format, allowing the user to review and correct it. The user then finalizes the return and, if necessary, prints it or submits it electronically to the tax authorities. This entire process allows users to apply for the self-medication tax deduction accurately and quickly, without any hassle.

[0265] As a concrete example, suppose a user purchases medicine at a store and scans the barcode of the medicine with the camera on their terminal. The terminal sends the barcode data to a server, which identifies it as the target medicine. The user then enters the purchase amount, and the server records this information in a database. Later, when it is time to submit an application, the user requests the creation of a declaration form through the system. An automatically generated declaration form is sent to the terminal, and the user can review it and formally submit their application.

[0266] The following describes the processing flow.

[0267] Step 1:

[0268] When a user purchases medication, they open an application on their device and activate the barcode scanning function. The device uses its camera to read the barcode.

[0269] Step 2:

[0270] The terminal converts the scanned barcode information into text data and sends it to the server.

[0271] Step 3:

[0272] The server uses the received barcode data to search the pharmaceutical database and determines whether the product is eligible for the self-medication tax deduction.

[0273] Step 4:

[0274] Once the server determines that the item is the target product, it sends a confirmation message to the terminal. The user then enters the purchase price into the terminal.

[0275] Step 5:

[0276] The terminal sends the purchase amount and date / time entered by the user to the server. The server then records this information in the user database.

[0277] Step 6:

[0278] The user requests the server to generate the tax return from their terminal at the time the tax return is generated.

[0279] Step 7:

[0280] The server aggregates purchase history data for each user and automatically generates a declaration form based on that data. The generated declaration form is then converted into an electronic format and sent to the terminal.

[0281] Step 8:

[0282] The user reviews the tax return generated on their device and makes any necessary corrections. Once the corrections are complete, they finalize the return and submit it to the tax authorities as electronic data or a printed copy.

[0283] (Example 1)

[0284] Next, Example 1 will be described. In the following description, the data processing device 12 is referred to as a "server", and the smart glasses 214 are referred to as a "terminal".

[0285] The declaration process of the conventional self-medication tax system has problems that the management of purchase history and the creation of declarations are complicated and require a great deal of effort from users. In addition, since the occurrence of human errors is a concern due to manual management, an efficient and accurate method is required.

[0286] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0287] In this invention, the server includes means for referring to an information storage device using the received identification information to discriminate a target article, means for recording a transaction amount and a transaction date in a user information storage device, and means for automatically generating a declaration document based on a transaction history according to a declaration request. As a result, the user can efficiently and accurately declare the self-medication tax system.

[0288] A "user device" is an electronic device for inputting information or displaying received information.

[0289] "Identification information" is data representing information unique to each article, and by using this, a specific article can be identified.

[0290] An "electronic computing device" is a computer system that receives, processes, and transmits data.

[0291] An "information storage device" is a database or a storage system similar thereto for storing and managing various data.

[0292] A "target article" is a product that satisfies specific conditions and is discriminated by the system.

[0293] "Transaction amount" refers to information indicating the monetary value of goods in a purchase or transaction.

[0294] "Transaction date" refers to information indicating the date on which a particular transaction was executed.

[0295] A "user information storage device" is a system that stores and manages individual transaction information and data related to users.

[0296] A "tax declaration document" is a formal document that contains information necessary primarily for tax purposes.

[0297] "Encrypted communication" refers to a communication method that uses technology to transform data in order to securely send and receive information.

[0298] This invention is a system for efficiently filing self-medication tax returns. The system aims to easily and accurately manage information about purchased medications and automatically generate tax returns. First, the user launches a dedicated application on a device such as a smartphone or tablet and scans the barcode of the medication. At this time, the device uses its built-in camera to acquire identification information from the barcode.

[0299] The terminal sends the generated identification information to the server. The server functions as a computer and uses the received identification information to refer to an information storage device (database) to determine whether the pharmaceutical product is eligible for tax reduction. If it is determined to be eligible, the server receives information about the transaction amount and transaction date from the user and records this in the user information storage device. This ensures that each user's purchase history is accurately maintained.

[0300] Furthermore, during the filing period, users can request the server to automatically generate filing documents via their terminal. The server, in response, generates the necessary filing documents in electronic format based on purchase history data stored in the information storage device and sends them to the terminal. Users can then review the contents of the filing documents on their terminal and make corrections as needed. The finalized filing can then be printed or submitted electronically to the tax authorities.

[0301] As a concrete example, suppose a user purchases a nutritional supplement at a pharmacy and scans the barcode printed on the package using a dedicated app. The terminal sends the barcode data to a server, which uses a database to determine if it is eligible for a tax deduction. The user then enters the purchase amount in the app, and this information is recorded on the server. Later, the user can request the system to create a tax return, receive an automatically generated return, and easily file their tax return.

[0302] The following prompt can be used for the generating AI model: "Design a system that automatically generates income tax deduction forms based on purchase history required for self-medication tax filing. A dedicated app scans the barcode of medicines, and a server refers to a database to identify tax-deductible items."

[0303] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0304] Step 1:

[0305] The user launches a dedicated application on their device and scans the barcode of the purchased medication. Specifically, the device's camera is used to read the barcode, and the digital data is captured within the app. At this stage, the input is the image data of the barcode captured by the camera, and the output is string information based on the barcode.

[0306] Step 2:

[0307] The terminal sends the acquired barcode information to the server. This communication is carried out via an Internet connection, and the barcode information is transmitted securely. The input here is the barcode information as string data, and the output is the barcode information received by the server.

[0308] Step 3:

[0309] Based on the received barcode information, the server refers to the pharmaceutical information storage device to determine whether the target item is eligible for self-medication tax reduction. The input is the barcode information in string format, and a database query is executed to search for the record of the pharmaceutical product. The output is a boolean value as the determination result or the detailed information of the target pharmaceutical product.

[0310] Step 4:

[0311] If the target item is identified, the server requests the user to input the transaction amount and transaction date. As a result, the user inputs and sends the necessary data via the app. The input is the numerical and date data entered by the user into the app, and the output is the corresponding data received by the server.

[0312] Step 5:

[0313] The server records the received transaction amount and transaction date in the user information storage device. Thereby, the purchase history for each user is constructed. The input is the numerical and date data obtained from the user, and the output is the updated purchase history record in the database.

[0314] Step 6:

[0315] During the declaration period, the user requests the server to automatically generate a declaration document through the terminal. This operation is executed by clicking a specific button on the app. The input is the declaration document generation request, and the output is the trigger for the declaration document generation process on the server.

[0316] Step 7:

[0317] The server retrieves purchase history from the user information storage device and automatically generates income tax deduction declaration documents. This includes data aggregation and format conversion. The input is the user's purchase history data, and the output is a declaration document in electronic format.

[0318] Step 8:

[0319] The server sends the generated declaration document to the terminal and prompts the user for confirmation. The user can view the declaration document on the app and make corrections as needed. After confirmation and correction, the user saves or submits the finalized declaration. The input is the declaration document, and the output is the user-approved and corrected final declaration document.

[0320] (Application Example 1)

[0321] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0322] For modern consumers, efficiently and accurately identifying which products they purchase daily qualify for tax deductions is difficult. Furthermore, claiming deductions requires accurate tax returns, which are time-consuming and laborious to prepare. Traditional methods involve manual management and record-keeping, leading to delays and errors, highlighting the need for improvement.

[0323] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0324] In this invention, the server includes means for reading code information on a user terminal, means for transmitting the code information to an information processing device, and means for using the received code information in the information processing device to refer to a product information database and identify the target product. This enables the user to efficiently identify products eligible for tax deductions and automatically generate accurate tax returns.

[0325] A "user terminal" is an electronic device that has the function of reading code information and transmitting it to an information processing device.

[0326] "Code information" refers to encoded data used for product identification and information retrieval.

[0327] An "information processing device" is a computer system that processes code information received from a user terminal and identifies the target product by referring to a product information database.

[0328] A "product information database" is a data aggregation system that structures and stores information about various products, enabling searching and identification.

[0329] "Eligible products" refer to products that meet specific conditions when applying for tax deductions.

[0330] "Purchase price" refers to the amount the user paid when purchasing the product.

[0331] "Purchase date" refers to the date on which the user purchased the product.

[0332] A "user information database" is a data aggregation system that manages each user's purchase history and personal information.

[0333] A "declaration document" is a document automatically generated based on the user's purchase history in order to apply for tax deductions.

[0334] The system realizing this invention mainly consists of a user terminal, an information processing device, a product information database, a user information database, and a tax return generation module. The user terminal has a function to read product code information using a camera. This code information is transmitted to the information processing device using wireless communication technology. The information processing device operates on a server and, based on the received code information, refers to the product information database to determine whether the purchased product is eligible for tax deductions.

[0335] If the information processing device determines that a product is eligible for a deduction, it records the purchase price and purchase date in the user information database. This database holds each user's purchase history and personal information and is updated as needed. If a user wishes to file a declaration at any time, they can use the declaration form generation module to automatically generate a declaration document based on their purchase history. This declaration document is sent to the user's terminal, where the user can review and modify it.

[0336] As a concrete example, when a user scans the barcode of a health supplement they regularly purchase with their smartphone camera, the product information is automatically cross-referenced with a database, and it is immediately determined whether or not it is eligible for a tax deduction. If the product is eligible for a deduction, the information is automatically recorded, and at the end of the month, a tax deduction application form is automatically generated and sent to the user's smartphone.

[0337] An example of a prompt is the requirement: "Design a smartphone app to streamline the filing of self-medication tax returns. It will include an algorithm that scans barcodes and matches product information against a database."

[0338] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0339] Step 1:

[0340] The user's terminal reads the product's code information.

[0341] The user scans the product's barcode using the camera on their device. The input is the camera image, and the barcode data is extracted through image processing. The output is the code information.

[0342] Step 2:

[0343] The terminal transmits code information to the information processing device.

[0344] The terminal transmits the extracted barcode data to the server via wireless communication. The input is barcode data, which is converted into digital data according to the communication protocol and then transmitted. The server receives the barcode information as output.

[0345] Step 3:

[0346] The server identifies the target product by referring to the product information database.

[0347] The server queries the product information database based on the received barcode information and retrieves information about the corresponding product. The input is barcode information, and product information is obtained by searching the database. The output is a result that determines whether the product is eligible for tax deductions.

[0348] Step 4:

[0349] The server records the purchase price and purchase date in the user information database.

[0350] The server receives the price and date entered by the user when purchasing a product, and if it is the applicable product, it records it in the user information database. The input consists of the purchase date and price information, and a database write operation is performed. As output, the history is stored in the user information database.

[0351] Step 5:

[0352] The user makes a request to generate a declaration document.

[0353] The user sends instructions to the server via their terminal to create the tax return. The input is the user's request, and the server initiates the corresponding processing. As output, the server executes the tax return generation process.

[0354] Step 6:

[0355] The server automatically generates the declaration document and sends it to the user's terminal.

[0356] The server creates an electronic declaration document based on the purchase history in the user information database and sends it to the user's terminal. The input is the user's purchase history information, and the output document is generated through a data formatting and document creation process. As output, the declaration document is sent to the user's terminal.

[0357] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0358] This invention combines a system that supports users in filing self-medication tax returns based on their purchase of pharmaceuticals with an emotion engine that recognizes the user's emotions. In this system, when a user purchases pharmaceuticals, they first launch a dedicated application on their terminal and scan the drug's barcode. The terminal uses its camera to read the barcode information and transmits this information to a server. The server refers to a pharmaceutical database based on the received barcode information and determines whether the product is eligible for the self-medication tax deduction. If it is determined to be an eligible product, the server receives information from the user regarding the purchase amount and purchase date and records this information in the user database.

[0359] Furthermore, the user terminal is equipped with an emotion engine that collects emotional data from the user's facial expressions and voice during operation. The emotion engine analyzes this data to identify the user's emotional state. This information is used to dynamically adjust the user interface and improve the user experience. For example, if the emotion engine detects stress or anxiety when a user is checking their purchase history, the terminal will display reminders and guides to help the user proceed smoothly.

[0360] During the filing period, the user requests the server to generate a tax return from their device. The server compiles the necessary information based on the user's purchase history and automatically generates the tax return. Even during this process, the emotion engine monitors the user's state and reduces user burden by presenting relaxing messages and options as needed. The generated tax return is sent to the device in electronic format, allowing the user to review and make corrections. The user can then print the finalized tax return or submit it electronically to the tax authorities.

[0361] As a concrete example, suppose a user purchases medication and scans the barcode with the terminal's camera. The terminal recognizes the user's emotion of joy from their facial expression at that moment. Based on this information, the emotion engine changes the user interface to a brighter color scheme and makes adjustments to facilitate smoother operation. Later, if the system detects user stress at the time of application, it suggests simplified procedures and provides support optimized for the user's state. This allows the user to effectively complete the electronic filing process.

[0362] The following describes the processing flow.

[0363] Step 1:

[0364] When a user purchases medication, they launch the application on their device and select barcode scanning mode. The device then activates its camera and accurately reads the barcode.

[0365] Step 2:

[0366] The terminal converts the scanned barcode information into text data and sends this information to the server via the internet.

[0367] Step 3:

[0368] The server analyzes the received barcode information and refers to the pharmaceutical database to determine whether the drug is eligible for the self-medication tax deduction.

[0369] Step 4:

[0370] If the server determines that the product is eligible, it sends the relevant information to the user's terminal. The user enters the purchase price and sends it from the terminal to the server.

[0371] Step 5:

[0372] The server records the submitted purchase amount and purchase date in a database entry for each user. This database is used as administrative information for future reporting.

[0373] Step 6:

[0374] An emotion engine built into the device analyzes the user's facial expressions and voice during operation, and evaluates the user's emotional state in real time.

[0375] Step 7:

[0376] If the emotion engine detects user stress or anxiety, the device will implement interface adjustments to provide the user with messages and procedures to help them relax.

[0377] Step 8:

[0378] When a user wishes to generate a declaration form, they send a request from their device to the server. The server compiles the purchase history and automatically generates the declaration form.

[0379] Step 9:

[0380] The generated declaration is sent to the device, where the user reviews it and makes corrections as needed. The emotion engine monitors the user's state throughout this process and provides appropriate support.

[0381] Step 10:

[0382] After the user has finalized their tax return, the terminal assists them in submitting the return to the tax authorities as electronic data or by printing it out.

[0383] (Example 2)

[0384] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0385] Traditional tax reporting processes for pharmaceutical purchases are complex and burdensome for users due to the manual nature of the work, making efficient and accurate reporting difficult. Furthermore, the stress and anxiety associated with the reporting process detract from the user experience, resulting in delays and errors in reporting. Additionally, the user interface is inadequately adapted to emotional fluctuations.

[0386] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0387] In this invention, the server includes means for referring to a product information collection using identification code information to identify the target product, means for automatically generating documents based on purchase history, and means for dynamically adjusting the user interface using an emotion analysis engine. This makes it possible to streamline tax filing and provide a smooth filing procedure that reduces stress and anxiety by adjusting the interface according to the user's emotional state.

[0388] A "user device" is an electronic device intended for user operation and is responsible for collecting and transmitting data.

[0389] An "identification code" is a machine-readable symbol or number used to identify a product or service.

[0390] An "information processing device" is a central computing device that receives, processes, stores, and transmits data.

[0391] A "product information database" is a collection of data containing information about a wide variety of products, and is particularly used as a database to classify products according to specific criteria.

[0392] A "storage device" is a hardware or software component for recording and storing digital data.

[0393] An "emotion analysis engine" is a software component that analyzes a user's emotional state based on data collected from the user and adjusts the response as needed.

[0394] "User interface" is a general term for the screen layout and operating elements that enable interaction between a user and an electronic device.

[0395] "Electronic notification" is the process of sending information or messages to users in an electronic format.

[0396] "Tax-reduced" refers to goods or services that, under tax law, are eligible for a reduction in tax burden by meeting specific conditions.

[0397] A "document" is an electronic or physical record that formalizes and records information or data.

[0398] This invention is a system that assists users in purchasing pharmaceuticals and efficiently claiming tax benefits. The system includes a user device, an information processing device, and a sentiment analysis engine. Details of each component and their operation are described below.

[0399] User equipment

[0400] Users use a portable digital information terminal (PDCA) when purchasing pharmaceuticals. This terminal is equipped with a camera, which is used to read identification codes (barcodes). Dedicated image processing software is used for barcode scanning. For example, the OpenCV library is used to extract barcode information from image data.

[0401] Information processing device

[0402] The identification code information read by the terminal is transmitted to the information processing device via a secure communication method (e.g., HTTPS protocol). The information processing device receives this information and queries the product information database to determine whether the product is eligible for tax reduction. This database stores detailed information about pharmaceuticals and is managed using a database management system such as SQL.

[0403] Emotion analysis engine

[0404] The user device incorporates an emotion analysis engine that collects and analyzes emotional data through cameras and microphones during user operation. Deep learning models are used for the analysis to identify the user's emotional state. This information is immediately reflected in the user interface, and the visual elements of the interface are dynamically adjusted.

[0405] Specific example

[0406] For example, a user purchases medicine using the system and scans the barcode with the terminal's camera. The terminal communicates with an information processing device to confirm that the product is eligible for tax benefits. An emotion analysis engine detects the user's stress level, changes the interface to a relaxing color scheme, and presents simplified operating instructions.

[0407] Example of a prompt

[0408] "Please describe the process of scanning the barcode of a medication purchased by the user to determine if it is a valid product. Also, demonstrate how the interface dynamically adjusts based on the user's emotional state."

[0409] The system, configured in this way, aims to streamline tax declarations related to pharmaceutical purchases while taking user emotions into consideration.

[0410] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0411] Step 1:

[0412] The user purchases medication and launches a dedicated application on the terminal. The application controls the camera and prepares to scan the barcode. The input is a physical barcode, and the output is barcode data. This data is processed as an identification code and used in the next step.

[0413] Step 2:

[0414] The terminal uses a camera to read barcodes. The read barcode data is decoded using an image processing library. The input is image data captured by the camera, and the output is an identification code in text format. This code is sent to an information processing device for drug identification.

[0415] Step 3:

[0416] The terminal transmits an identification code to the information processing device. The HTTPS protocol is used during transmission to ensure data security. The input is an identification code in text format, and the output is a secure data transmission to the information processing device.

[0417] Step 4:

[0418] The server queries the product information database using the received identification code. The input is the identification code, and the output is the product information retrieved from the database. Here, the server also determines whether the product is eligible for tax reduction.

[0419] Step 5:

[0420] The server stores purchase records in the user database based on product information. Inputs are product information and user purchase details, and output is the addition of new records to the user database. The purchase amount and date are accurately recorded.

[0421] Step 6:

[0422] While the user is interacting with the device, the terminal uses an emotion analysis engine to collect facial expression and audio data. The input is real-time audio and image data, and the output is the analysis result of the user's emotional state. Based on these results, the interface's color scheme and recommended actions are dynamically changed.

[0423] Step 7:

[0424] During the tax filing period, users request to create a tax return from their terminal. The server aggregates the user's purchase history and automatically generates a tax return with the necessary fields filled in. The input is the user's purchase history, and the output is a tax return in electronic format.

[0425] Step 8:

[0426] The generated declaration form is sent to the terminal, where the user reviews and modifies it. The input is the initial declaration form data received from the server, and the output is the final declaration form modified by the user. The user can perform the operation while receiving interface guidance to reduce stress.

[0427] (Application Example 2)

[0428] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0429] Purchasing activities and tax filing procedures for users are often complex, time-consuming, and can be stressful. In particular, when utilizing tax reduction schemes, identifying eligible products and preparing tax returns can be burdensome for users. Furthermore, the lack of consideration for users' emotional states can hinder the smoothness of the process. The payment process itself can also be a source of emotional stress for users.

[0430] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0431] In this invention, the server includes means for referencing a product database using barcode information to identify the target product, means for analyzing the user's emotional state, and means for dynamically adjusting the user interface based on the emotional state to reduce emotional burden during declaration form creation and payment support. As a result, the user can perform the entire process from product purchase to declaration procedures stress-free.

[0432] A "user terminal" is an electronic device used by a user to scan product barcodes, display information, and operate devices.

[0433] "Barcode information" refers to information that contains unique identification data about a product and is transmitted to a server to identify the target product.

[0434] A "server" is a computer system that receives information sent from user terminals and performs database lookups and information processing.

[0435] A "product database" is a data storage system that stores information about various products, allowing a server to refer to it and identify the target product.

[0436] A "user database" is a data storage system that records users' purchase history and declaration information, making it accessible as needed.

[0437] "Automatic generation of declaration forms" refers to the process of automatically compiling necessary information based on the user's purchase history and creating documents for declaration purposes.

[0438] "Emotional state" refers to the user's psychological state, analyzed based on facial expressions and voice observed during user interaction.

[0439] "Analysis means" refers to software and algorithms that use an emotion engine to collect the user's facial expressions and voice, and analyze their emotional state based on that data.

[0440] "Dynamic user interface adjustments" refer to adjustments made to improve the user experience by changing the screen display and operation methods in response to the user's emotions.

[0441] The system for implementing this invention consists of a user terminal, a server, a database, and an emotion analysis engine.

[0442] The user terminal is an electronic device such as a smartphone, which scans the product's barcode with its camera and acquires it as digital data. The acquired barcode information is transmitted to a server via wireless communication. Image recognition software is used in this process.

[0443] The server uses the received barcode information to refer to the product database and determine whether the product is subject to taxation. The server also records relevant information, such as the purchase price and date, in the user database. Data management software and a database management system are used for data processing.

[0444] Furthermore, the user terminal has a built-in emotion analysis engine that analyzes the user's facial expressions and voice to identify their emotional state. Emotion analysis uses machine learning algorithms and voice analysis technology. If the user is experiencing stress, the user interface is adjusted to make it more user-friendly and intuitive to use.

[0445] For example, when a user purchases medication and scans its barcode, if the emotion engine detects a feeling of joy, the background of the displayed screen will change to a brighter color and provide positive feedback to smooth the operation. Also, if the user expresses anxiety while creating a declaration, the server will present simplified instructions.

[0446] Examples of prompts to input into the generating AI model include, "What is a sentiment-based UI optimization method to display to users during payment?" and "Please suggest application features to reduce user stress while shopping."

[0447] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0448] Step 1:

[0449] The user uses a device to scan the product's barcode.

[0450] The input is image data of a barcode acquired through a camera, and the output is digitized data of the barcode information. This data is analyzed by image recognition software, and the barcode information is extracted.

[0451] Step 2:

[0452] The terminal sends the extracted barcode information to the server.

[0453] The input is digitized barcode information, and the output is wireless data transmission to a server. This includes specific actions to transmit information accurately and quickly using a communication protocol.

[0454] Step 3:

[0455] The server uses the received barcode information to refer to the product database and identify the target product.

[0456] The input is barcode information received from a terminal, and the output is whether or not the item is subject to taxation and related information. A database management system is used to execute queries and perform specific data calculations to obtain the desired product information.

[0457] Step 4:

[0458] The server records the user's purchase amount and date in the user database.

[0459] The input is the amount and purchase date information obtained from the buyer, and the output is the result of recording it in the user database. A database management system is used to perform the specific operations to persist the information.

[0460] Step 5:

[0461] The device's emotion analysis engine analyzes the user's emotional state.

[0462] The input is the user's facial expressions and voice data, and the output is the analyzed emotional state. A machine learning algorithm is used to analyze the emotional data and perform specific data calculations to classify the emotions.

[0463] Step 6:

[0464] The device dynamically adjusts the user interface based on the analyzed emotional state.

[0465] The input is the analyzed emotional state, and the output is the display of the adjusted interface. Specific actions are performed to modify the interface elements using UI design software.

[0466] Step 7:

[0467] The server automatically generates a declaration form using the user's purchase history in response to their declaration request, and aggregates information from the user database.

[0468] The input is the purchase history recorded in the user database, and the output is a digital document of the declaration form. A template is used to perform the specific process of filling in the necessary items and generating the document.

[0469] Step 8:

[0470] Users review and correct the declaration forms generated using their devices.

[0471] The input is a digital tax return document received from the server, and the output is the final tax return. The interface allows users to directly modify the content through editing.

[0472] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0473] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0474] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0475] [Third Embodiment]

[0476] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0477] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0478] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0479] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0480] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0481] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0482] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0483] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0484] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0485] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0486] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0487] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0488] This invention relates to a system that supports users in filing self-medication tax returns based on their purchase of pharmaceuticals. First, when a user purchases pharmaceuticals, they launch a dedicated application on their terminal and scan the barcode of the medication. The terminal uses its camera to read the barcode information and transmits that information to a server.

[0489] Based on the received barcode information, the server consults a pharmaceutical database to determine if the medication is eligible for the self-medication tax deduction. If it is determined to be eligible, the server then receives information from the user regarding the purchase price and date, and records this information in the user database. This database management ensures that each user's purchase history is accurately maintained.

[0490] In particular, during the filing process, users can use their terminal to request the server to automatically generate a tax return. The server then compiles the necessary information based on the user's purchase history and automatically generates the income deduction tax return. The generated return is sent to the terminal in electronic format, allowing the user to review and correct it. The user then finalizes the return and, if necessary, prints it or submits it electronically to the tax authorities. This entire process allows users to apply for the self-medication tax deduction accurately and quickly, without any hassle.

[0491] As a concrete example, suppose a user purchases medicine at a store and scans the barcode of the medicine with the camera on their terminal. The terminal sends the barcode data to a server, which identifies it as the target medicine. The user then enters the purchase amount, and the server records this information in a database. Later, when it is time to submit an application, the user requests the creation of a declaration form through the system. An automatically generated declaration form is sent to the terminal, and the user can review it and formally submit their application.

[0492] The following describes the processing flow.

[0493] Step 1:

[0494] When a user purchases medication, they open an application on their device and activate the barcode scanning function. The device uses its camera to read the barcode.

[0495] Step 2:

[0496] The terminal converts the scanned barcode information into text data and sends it to the server.

[0497] Step 3:

[0498] The server uses the received barcode data to search the pharmaceutical database and determines whether the product is eligible for the self-medication tax deduction.

[0499] Step 4:

[0500] Once the server determines that the item is the target product, it sends a confirmation message to the terminal. The user then enters the purchase price into the terminal.

[0501] Step 5:

[0502] The terminal sends the purchase amount and date / time entered by the user to the server. The server then records this information in the user database.

[0503] Step 6:

[0504] The user requests the server to generate the tax return from their terminal at the time the tax return is generated.

[0505] Step 7:

[0506] The server aggregates purchase history data for each user and automatically generates a declaration form based on that data. The generated declaration form is then converted into an electronic format and sent to the terminal.

[0507] Step 8:

[0508] The user reviews the tax return generated on their device and makes any necessary corrections. Once the corrections are complete, they finalize the return and submit it to the tax authorities as electronic data or a printed copy.

[0509] (Example 1)

[0510] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0511] The traditional self-medication tax declaration process was cumbersome, requiring users to manage purchase history and prepare declaration forms, thus demanding a significant amount of effort. Furthermore, manual management raised concerns about human error, highlighting the need for a more efficient and accurate method.

[0512] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0513] In this invention, the server includes means for identifying the target item by referring to an information storage device using received identification information, means for recording the transaction amount and transaction date in a user information storage device, and means for automatically generating a declaration document based on the transaction history according to the declaration request. This enables the user to file a self-medication tax return efficiently and accurately.

[0514] A "user device" is an electronic device used for inputting information or displaying received information.

[0515] "Identification information" refers to data that represents information specific to each item, and by using this information, a particular item can be identified.

[0516] An "electronic computing device" is a computer system that receives, processes, and transmits data.

[0517] An "information storage device" is a database or similar storage system for storing and managing various types of data.

[0518] "Target items" refer to products that meet specific conditions and are identified by the system.

[0519] "Transaction amount" refers to information indicating the monetary value of goods in a purchase or transaction.

[0520] "Transaction date" refers to information indicating the date on which a particular transaction was executed.

[0521] A "user information storage device" is a system that stores and manages individual transaction information and data related to users.

[0522] A "tax declaration document" is a formal document that contains information necessary primarily for tax purposes.

[0523] "Encrypted communication" refers to a communication method that uses technology to transform data in order to securely send and receive information.

[0524] This invention is a system for efficiently filing self-medication tax returns. The system aims to easily and accurately manage information about purchased medications and automatically generate tax returns. First, the user launches a dedicated application on a device such as a smartphone or tablet and scans the barcode of the medication. At this time, the device uses its built-in camera to acquire identification information from the barcode.

[0525] The terminal sends the generated identification information to the server. The server functions as a computer and uses the received identification information to refer to an information storage device (database) to determine whether the pharmaceutical product is eligible for tax reduction. If it is determined to be eligible, the server receives information about the transaction amount and transaction date from the user and records this in the user information storage device. This ensures that each user's purchase history is accurately maintained.

[0526] Furthermore, during the filing period, users can request the server to automatically generate filing documents via their terminal. The server, in response, generates the necessary filing documents in electronic format based on purchase history data stored in the information storage device and sends them to the terminal. Users can then review the contents of the filing documents on their terminal and make corrections as needed. The finalized filing can then be printed or submitted electronically to the tax authorities.

[0527] As a concrete example, suppose a user purchases a nutritional supplement at a pharmacy and scans the barcode printed on the package using a dedicated app. The terminal sends the barcode data to a server, which uses a database to determine if it is eligible for a tax deduction. The user then enters the purchase amount in the app, and this information is recorded on the server. Later, the user can request the system to create a tax return, receive an automatically generated return, and easily file their tax return.

[0528] The following prompt can be used for the generating AI model: "Design a system that automatically generates income tax deduction forms based on purchase history required for self-medication tax filing. A dedicated app scans the barcode of medicines, and a server refers to a database to identify tax-deductible items."

[0529] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0530] Step 1:

[0531] The user launches a dedicated application on their device and scans the barcode of the purchased medication. Specifically, the device's camera is used to read the barcode, and the digital data is captured within the app. At this stage, the input is the image data of the barcode captured by the camera, and the output is string information based on the barcode.

[0532] Step 2:

[0533] The terminal transmits the acquired barcode information to the server. This communication takes place via an internet connection, ensuring the secure transmission of the barcode information. The input here is the barcode information as string data, and the output is the barcode information received by the server.

[0534] Step 3:

[0535] The server uses the received barcode information to refer to the drug information storage device and determine whether the item is eligible for the self-medication tax deduction. The input is barcode information in string format, and a database query is executed to search for drug records. The output is either a boolean value as the determination result or detailed information about the drug.

[0536] Step 4:

[0537] If the item is identified as a target item, the server will prompt the user to enter the transaction amount and transaction date. The user then enters and submits the necessary data via the app. The input consists of numerical and date data entered by the user into the app, and the output is the corresponding data received by the server.

[0538] Step 5:

[0539] The server records the received transaction amount and transaction date in the user information storage device. This creates a purchase history for each user. The input is numerical and date data obtained from the user, and the output is the updated purchase history record in the database.

[0540] Step 6:

[0541] During the filing period, users request the server to automatically generate filing documents via their device. This operation is performed by clicking a specific button on the app. The input is the request to generate the filing document, and the output is the trigger for the filing document generation process on the server.

[0542] Step 7:

[0543] The server retrieves purchase history from the user information storage device and automatically generates income tax deduction declaration documents. This includes data aggregation and format conversion. The input is the user's purchase history data, and the output is a declaration document in electronic format.

[0544] Step 8:

[0545] The server sends the generated declaration document to the terminal and prompts the user for confirmation. The user can view the declaration document on the app and make corrections as needed. After confirmation and correction, the user saves or submits the finalized declaration. The input is the declaration document, and the output is the user-approved and corrected final declaration document.

[0546] (Application Example 1)

[0547] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0548] For modern consumers, efficiently and accurately identifying which products they purchase daily qualify for tax deductions is difficult. Furthermore, claiming deductions requires accurate tax returns, which are time-consuming and laborious to prepare. Traditional methods involve manual management and record-keeping, leading to delays and errors, highlighting the need for improvement.

[0549] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0550] In this invention, the server includes means for reading code information on a user terminal, means for transmitting the code information to an information processing device, and means for using the received code information in the information processing device to refer to a product information database and identify the target product. This enables the user to efficiently identify products eligible for tax deductions and automatically generate accurate tax returns.

[0551] A "user terminal" is an electronic device that has the function of reading code information and transmitting it to an information processing device.

[0552] "Code information" refers to encoded data used for product identification and information retrieval.

[0553] An "information processing device" is a computer system that processes code information received from a user terminal and identifies the target product by referring to a product information database.

[0554] A "product information database" is a data aggregation system that structures and stores information about various products, enabling searching and identification.

[0555] "Eligible products" refer to products that meet specific conditions when applying for tax deductions.

[0556] "Purchase price" refers to the amount the user paid when purchasing the product.

[0557] "Purchase date" refers to the date on which the user purchased the product.

[0558] A "user information database" is a data aggregation system that manages each user's purchase history and personal information.

[0559] A "declaration document" is a document automatically generated based on the user's purchase history in order to apply for tax deductions.

[0560] The system realizing this invention mainly consists of a user terminal, an information processing device, a product information database, a user information database, and a tax return generation module. The user terminal has a function to read product code information using a camera. This code information is transmitted to the information processing device using wireless communication technology. The information processing device operates on a server and, based on the received code information, refers to the product information database to determine whether the purchased product is eligible for tax deductions.

[0561] If the information processing device determines that a product is eligible for a deduction, it records the purchase price and purchase date in the user information database. This database holds each user's purchase history and personal information and is updated as needed. If a user wishes to file a declaration at any time, they can use the declaration form generation module to automatically generate a declaration document based on their purchase history. This declaration document is sent to the user's terminal, where the user can review and modify it.

[0562] As a concrete example, when a user scans the barcode of a health supplement they regularly purchase with their smartphone camera, the product information is automatically cross-referenced with a database, and it is immediately determined whether or not it is eligible for a tax deduction. If the product is eligible for a deduction, the information is automatically recorded, and at the end of the month, a tax deduction application form is automatically generated and sent to the user's smartphone.

[0563] An example of a prompt is the requirement: "Design a smartphone app to streamline the filing of self-medication tax returns. It will include an algorithm that scans barcodes and matches product information against a database."

[0564] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0565] Step 1:

[0566] The user's terminal reads the product's code information.

[0567] The user scans the product's barcode using the camera on their device. The input is the camera image, and the barcode data is extracted through image processing. The output is the code information.

[0568] Step 2:

[0569] The terminal transmits code information to the information processing device.

[0570] The terminal transmits the extracted barcode data to the server via wireless communication. The input is barcode data, which is converted into digital data according to the communication protocol and then transmitted. The server receives the barcode information as output.

[0571] Step 3:

[0572] The server identifies the target product by referring to the product information database.

[0573] The server queries the product information database based on the received barcode information and retrieves information about the corresponding product. The input is barcode information, and product information is obtained by searching the database. The output is a result that determines whether the product is eligible for tax deductions.

[0574] Step 4:

[0575] The server records the purchase price and purchase date in the user information database.

[0576] The server receives the price and date entered by the user when purchasing a product, and if it is the applicable product, it records it in the user information database. The input consists of the purchase date and price information, and a database write operation is performed. As output, the history is stored in the user information database.

[0577] Step 5:

[0578] The user makes a request to generate a declaration document.

[0579] The user sends instructions to the server via their terminal to create the tax return. The input is the user's request, and the server initiates the corresponding processing. As output, the server executes the tax return generation process.

[0580] Step 6:

[0581] The server automatically generates the declaration document and sends it to the user's terminal.

[0582] The server creates an electronic declaration document based on the purchase history in the user information database and sends it to the user's terminal. The input is the user's purchase history information, and the output document is generated through a data formatting and document creation process. As output, the declaration document is sent to the user's terminal.

[0583] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0584] This invention combines a system that supports users in filing self-medication tax returns based on their purchase of pharmaceuticals with an emotion engine that recognizes the user's emotions. In this system, when a user purchases pharmaceuticals, they first launch a dedicated application on their terminal and scan the drug's barcode. The terminal uses its camera to read the barcode information and transmits this information to a server. The server refers to a pharmaceutical database based on the received barcode information and determines whether the product is eligible for the self-medication tax deduction. If it is determined to be an eligible product, the server receives information from the user regarding the purchase amount and purchase date and records this information in the user database.

[0585] Furthermore, the user terminal is equipped with an emotion engine that collects emotional data from the user's facial expressions and voice during operation. The emotion engine analyzes this data to identify the user's emotional state. This information is used to dynamically adjust the user interface and improve the user experience. For example, if the emotion engine detects stress or anxiety when a user is checking their purchase history, the terminal will display reminders and guides to help the user proceed smoothly.

[0586] During the filing period, the user requests the server to generate a tax return from their device. The server compiles the necessary information based on the user's purchase history and automatically generates the tax return. Even during this process, the emotion engine monitors the user's state and reduces user burden by presenting relaxing messages and options as needed. The generated tax return is sent to the device in electronic format, allowing the user to review and make corrections. The user can then print the finalized tax return or submit it electronically to the tax authorities.

[0587] As a concrete example, suppose a user purchases medication and scans the barcode with the terminal's camera. The terminal recognizes the user's emotion of joy from their facial expression at that moment. Based on this information, the emotion engine changes the user interface to a brighter color scheme and makes adjustments to facilitate smoother operation. Later, if the system detects user stress at the time of application, it suggests simplified procedures and provides support optimized for the user's state. This allows the user to effectively complete the electronic filing process.

[0588] The following describes the processing flow.

[0589] Step 1:

[0590] When a user purchases medication, they launch the application on their device and select barcode scanning mode. The device then activates its camera and accurately reads the barcode.

[0591] Step 2:

[0592] The terminal converts the scanned barcode information into text data and sends this information to the server via the internet.

[0593] Step 3:

[0594] The server analyzes the received barcode information and refers to the pharmaceutical database to determine whether the drug is eligible for the self-medication tax deduction.

[0595] Step 4:

[0596] If the server determines that the product is eligible, it sends the relevant information to the user's terminal. The user enters the purchase price and sends it from the terminal to the server.

[0597] Step 5:

[0598] The server records the submitted purchase amount and purchase date in a database entry for each user. This database is used as administrative information for future reporting.

[0599] Step 6:

[0600] An emotion engine built into the device analyzes the user's facial expressions and voice during operation, and evaluates the user's emotional state in real time.

[0601] Step 7:

[0602] If the emotion engine detects user stress or anxiety, the device will implement interface adjustments to provide the user with messages and procedures to help them relax.

[0603] Step 8:

[0604] When a user wishes to generate a declaration form, they send a request from their device to the server. The server compiles the purchase history and automatically generates the declaration form.

[0605] Step 9:

[0606] The generated declaration is sent to the device, where the user reviews it and makes corrections as needed. The emotion engine monitors the user's state throughout this process and provides appropriate support.

[0607] Step 10:

[0608] After the user has finalized their tax return, the terminal assists them in submitting the return to the tax authorities as electronic data or by printing it out.

[0609] (Example 2)

[0610] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0611] Traditional tax reporting processes for pharmaceutical purchases are complex and burdensome for users due to the manual nature of the work, making efficient and accurate reporting difficult. Furthermore, the stress and anxiety associated with the reporting process detract from the user experience, resulting in delays and errors in reporting. Additionally, the user interface is inadequately adapted to emotional fluctuations.

[0612] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0613] In this invention, the server includes means for referring to a product information collection using identification code information to identify the target product, means for automatically generating documents based on purchase history, and means for dynamically adjusting the user interface using an emotion analysis engine. This makes it possible to streamline tax filing and provide a smooth filing procedure that reduces stress and anxiety by adjusting the interface according to the user's emotional state.

[0614] A "user device" is an electronic device intended for user operation and is responsible for collecting and transmitting data.

[0615] An "identification code" is a machine-readable symbol or number used to identify a product or service.

[0616] An "information processing device" is a central computing device that receives, processes, stores, and transmits data.

[0617] A "product information database" is a collection of data containing information about a wide variety of products, and is particularly used as a database to classify products according to specific criteria.

[0618] A "storage device" is a hardware or software component for recording and storing digital data.

[0619] An "emotion analysis engine" is a software component that analyzes a user's emotional state based on data collected from the user and adjusts the response as needed.

[0620] "User interface" is a general term for the screen layout and operating elements that enable interaction between a user and an electronic device.

[0621] "Electronic notification" is the process of sending information or messages to users in an electronic format.

[0622] "Tax-reduced" refers to goods or services that, under tax law, are eligible for a reduction in tax burden by meeting specific conditions.

[0623] A "document" is an electronic or physical record that formalizes and records information or data.

[0624] This invention is a system that assists users in purchasing pharmaceuticals and efficiently claiming tax benefits. The system includes a user device, an information processing device, and a sentiment analysis engine. Details of each component and their operation are described below.

[0625] User equipment

[0626] Users use a portable digital information terminal (PDCA) when purchasing pharmaceuticals. This terminal is equipped with a camera, which is used to read identification codes (barcodes). Dedicated image processing software is used for barcode scanning. For example, the OpenCV library is used to extract barcode information from image data.

[0627] Information processing device

[0628] The identification code information read by the terminal is transmitted to the information processing device via a secure communication method (e.g., HTTPS protocol). The information processing device receives this information and queries the product information database to determine whether the product is eligible for tax reduction. This database stores detailed information about pharmaceuticals and is managed using a database management system such as SQL.

[0629] Emotion analysis engine

[0630] The user device incorporates an emotion analysis engine that collects and analyzes emotional data through cameras and microphones during user operation. Deep learning models are used for the analysis to identify the user's emotional state. This information is immediately reflected in the user interface, and the visual elements of the interface are dynamically adjusted.

[0631] Specific example

[0632] For example, a user purchases medicine using the system and scans the barcode with the terminal's camera. The terminal communicates with an information processing device to confirm that the product is eligible for tax benefits. An emotion analysis engine detects the user's stress level, changes the interface to a relaxing color scheme, and presents simplified operating instructions.

[0633] Example of a prompt

[0634] "Please describe the process of scanning the barcode of a medication purchased by the user to determine if it is a valid product. Also, demonstrate how the interface dynamically adjusts based on the user's emotional state."

[0635] The system, configured in this way, aims to streamline tax declarations related to pharmaceutical purchases while taking user emotions into consideration.

[0636] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0637] Step 1:

[0638] The user purchases medication and launches a dedicated application on the terminal. The application controls the camera and prepares to scan the barcode. The input is a physical barcode, and the output is barcode data. This data is processed as an identification code and used in the next step.

[0639] Step 2:

[0640] The terminal uses a camera to read barcodes. The read barcode data is decoded using an image processing library. The input is image data captured by the camera, and the output is an identification code in text format. This code is sent to an information processing device for drug identification.

[0641] Step 3:

[0642] The terminal transmits an identification code to the information processing device. The HTTPS protocol is used during transmission to ensure data security. The input is an identification code in text format, and the output is a secure data transmission to the information processing device.

[0643] Step 4:

[0644] The server queries the product information database using the received identification code. The input is the identification code, and the output is the product information retrieved from the database. Here, the server also determines whether the product is eligible for tax reduction.

[0645] Step 5:

[0646] The server stores purchase records in the user database based on product information. Inputs are product information and user purchase details, and output is the addition of new records to the user database. The purchase amount and date are accurately recorded.

[0647] Step 6:

[0648] While the user is interacting with the device, the terminal uses an emotion analysis engine to collect facial expression and audio data. The input is real-time audio and image data, and the output is the analysis result of the user's emotional state. Based on these results, the interface's color scheme and recommended actions are dynamically changed.

[0649] Step 7:

[0650] During the tax filing period, users request to create a tax return from their terminal. The server aggregates the user's purchase history and automatically generates a tax return with the necessary fields filled in. The input is the user's purchase history, and the output is a tax return in electronic format.

[0651] Step 8:

[0652] The generated declaration form is sent to the terminal, where the user reviews and modifies it. The input is the initial declaration form data received from the server, and the output is the final declaration form modified by the user. The user can perform the operation while receiving interface guidance to reduce stress.

[0653] (Application Example 2)

[0654] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0655] Purchasing activities and tax filing procedures for users are often complex, time-consuming, and can be stressful. In particular, when utilizing tax reduction schemes, identifying eligible products and preparing tax returns can be burdensome for users. Furthermore, the lack of consideration for users' emotional states can hinder the smoothness of the process. The payment process itself can also be a source of emotional stress for users.

[0656] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0657] In this invention, the server includes means for referencing a product database using barcode information to identify the target product, means for analyzing the user's emotional state, and means for dynamically adjusting the user interface based on the emotional state to reduce emotional burden during declaration form creation and payment support. As a result, the user can perform the entire process from product purchase to declaration procedures stress-free.

[0658] A "user terminal" is an electronic device used by a user to scan product barcodes, display information, and operate devices.

[0659] "Barcode information" refers to information that contains unique identification data about a product and is transmitted to a server to identify the target product.

[0660] A "server" is a computer system that receives information sent from user terminals and performs database lookups and information processing.

[0661] A "product database" is a data storage system that stores information about various products, allowing a server to refer to it and identify the target product.

[0662] A "user database" is a data storage system that records users' purchase history and declaration information, making it accessible as needed.

[0663] "Automatic generation of declaration forms" refers to the process of automatically compiling necessary information based on the user's purchase history and creating documents for declaration purposes.

[0664] "Emotional state" refers to the user's psychological state, analyzed based on facial expressions and voice observed during user interaction.

[0665] "Analysis means" refers to software and algorithms that use an emotion engine to collect the user's facial expressions and voice, and analyze their emotional state based on that data.

[0666] "Dynamic user interface adjustments" refer to adjustments made to improve the user experience by changing the screen display and operation methods in response to the user's emotions.

[0667] The system for implementing this invention consists of a user terminal, a server, a database, and an emotion analysis engine.

[0668] The user terminal is an electronic device such as a smartphone, which scans the product's barcode with its camera and acquires it as digital data. The acquired barcode information is transmitted to a server via wireless communication. Image recognition software is used in this process.

[0669] The server uses the received barcode information to refer to the product database and determine whether the product is subject to taxation. The server also records relevant information, such as the purchase price and date, in the user database. Data management software and a database management system are used for data processing.

[0670] Furthermore, the user terminal has a built-in emotion analysis engine that analyzes the user's facial expressions and voice to identify their emotional state. Emotion analysis uses machine learning algorithms and voice analysis technology. If the user is experiencing stress, the user interface is adjusted to make it more user-friendly and intuitive to use.

[0671] For example, when a user purchases medication and scans its barcode, if the emotion engine detects a feeling of joy, the background of the displayed screen will change to a brighter color and provide positive feedback to smooth the operation. Also, if the user expresses anxiety while creating a declaration, the server will present simplified instructions.

[0672] Examples of prompts to input into the generating AI model include, "What is a sentiment-based UI optimization method to display to users during payment?" and "Please suggest application features to reduce user stress while shopping."

[0673] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0674] Step 1:

[0675] The user uses a device to scan the product's barcode.

[0676] The input is image data of a barcode acquired through a camera, and the output is digitized data of the barcode information. This data is analyzed by image recognition software, and the barcode information is extracted.

[0677] Step 2:

[0678] The terminal sends the extracted barcode information to the server.

[0679] The input is digitized barcode information, and the output is wireless data transmission to a server. This includes specific actions to transmit information accurately and quickly using a communication protocol.

[0680] Step 3:

[0681] The server uses the received barcode information to refer to the product database and identify the target product.

[0682] The input is barcode information received from a terminal, and the output is whether or not the item is subject to taxation and related information. A database management system is used to execute queries and perform specific data calculations to obtain the desired product information.

[0683] Step 4:

[0684] The server records the user's purchase amount and date in the user database.

[0685] The input is the amount and purchase date information obtained from the buyer, and the output is the result of recording it in the user database. A database management system is used to perform the specific operations to persist the information.

[0686] Step 5:

[0687] The device's emotion analysis engine analyzes the user's emotional state.

[0688] The input is the user's facial expressions and voice data, and the output is the analyzed emotional state. A machine learning algorithm is used to analyze the emotional data and perform specific data calculations to classify the emotions.

[0689] Step 6:

[0690] The device dynamically adjusts the user interface based on the analyzed emotional state.

[0691] The input is the analyzed emotional state, and the output is the display of the adjusted interface. Specific actions are performed to modify the interface elements using UI design software.

[0692] Step 7:

[0693] The server automatically generates a declaration form using the user's purchase history in response to their declaration request, and aggregates information from the user database.

[0694] The input is the purchase history recorded in the user database, and the output is a digital document of the declaration form. A template is used to perform the specific process of filling in the necessary items and generating the document.

[0695] Step 8:

[0696] Users review and correct the declaration forms generated using their devices.

[0697] The input is a digital tax return document received from the server, and the output is the final tax return. The interface allows users to directly modify the content through editing.

[0698] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0699] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0700] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0701] [Fourth Embodiment]

[0702] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0703] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0704] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0705] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0706] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0707] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0708] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0709] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0710] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0711] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0712] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0713] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0714] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0715] This invention relates to a system that supports users in filing self-medication tax returns based on their purchase of pharmaceuticals. First, when a user purchases pharmaceuticals, they launch a dedicated application on their terminal and scan the barcode of the medication. The terminal uses its camera to read the barcode information and transmits that information to a server.

[0716] Based on the received barcode information, the server consults a pharmaceutical database to determine if the medication is eligible for the self-medication tax deduction. If it is determined to be eligible, the server then receives information from the user regarding the purchase price and date, and records this information in the user database. This database management ensures that each user's purchase history is accurately maintained.

[0717] In particular, during the filing process, users can use their terminal to request the server to automatically generate a tax return. The server then compiles the necessary information based on the user's purchase history and automatically generates the income deduction tax return. The generated return is sent to the terminal in electronic format, allowing the user to review and correct it. The user then finalizes the return and, if necessary, prints it or submits it electronically to the tax authorities. This entire process allows users to apply for the self-medication tax deduction accurately and quickly, without any hassle.

[0718] As a concrete example, suppose a user purchases medicine at a store and scans the barcode of the medicine with the camera on their terminal. The terminal sends the barcode data to a server, which identifies it as the target medicine. The user then enters the purchase amount, and the server records this information in a database. Later, when it is time to submit an application, the user requests the creation of a declaration form through the system. An automatically generated declaration form is sent to the terminal, and the user can review it and formally submit their application.

[0719] The following describes the processing flow.

[0720] Step 1:

[0721] When a user purchases medication, they open an application on their device and activate the barcode scanning function. The device uses its camera to read the barcode.

[0722] Step 2:

[0723] The terminal converts the scanned barcode information into text data and sends it to the server.

[0724] Step 3:

[0725] The server uses the received barcode data to search the pharmaceutical database and determines whether the product is eligible for the self-medication tax deduction.

[0726] Step 4:

[0727] Once the server determines that the item is the target product, it sends a confirmation message to the terminal. The user then enters the purchase price into the terminal.

[0728] Step 5:

[0729] The terminal sends the purchase amount and date / time entered by the user to the server. The server then records this information in the user database.

[0730] Step 6:

[0731] The user requests the server to generate the tax return from their terminal at the time the tax return is generated.

[0732] Step 7:

[0733] The server aggregates purchase history data for each user and automatically generates a declaration form based on that data. The generated declaration form is then converted into an electronic format and sent to the terminal.

[0734] Step 8:

[0735] The user reviews the tax return generated on their device and makes any necessary corrections. Once the corrections are complete, they finalize the return and submit it to the tax authorities as electronic data or a printed copy.

[0736] (Example 1)

[0737] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0738] The traditional self-medication tax declaration process was cumbersome, requiring users to manage purchase history and prepare declaration forms, thus demanding a significant amount of effort. Furthermore, manual management raised concerns about human error, highlighting the need for a more efficient and accurate method.

[0739] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0740] In this invention, the server includes means for identifying the target item by referring to an information storage device using received identification information, means for recording the transaction amount and transaction date in a user information storage device, and means for automatically generating a declaration document based on the transaction history according to the declaration request. This enables the user to file a self-medication tax return efficiently and accurately.

[0741] A "user device" is an electronic device used for inputting information or displaying received information.

[0742] "Identification information" refers to data that represents information specific to each item, and by using this information, a particular item can be identified.

[0743] An "electronic computing device" is a computer system that receives, processes, and transmits data.

[0744] An "information storage device" is a database or similar storage system for storing and managing various types of data.

[0745] "Target items" refer to products that meet specific conditions and are identified by the system.

[0746] "Transaction amount" refers to information indicating the monetary value of goods in a purchase or transaction.

[0747] "Transaction date" refers to information indicating the date on which a particular transaction was executed.

[0748] A "user information storage device" is a system that stores and manages individual transaction information and data related to users.

[0749] A "tax declaration document" is a formal document that contains information necessary primarily for tax purposes.

[0750] "Encrypted communication" refers to a communication method that uses technology to transform data in order to securely send and receive information.

[0751] This invention is a system for efficiently filing self-medication tax returns. The system aims to easily and accurately manage information about purchased medications and automatically generate tax returns. First, the user launches a dedicated application on a device such as a smartphone or tablet and scans the barcode of the medication. At this time, the device uses its built-in camera to acquire identification information from the barcode.

[0752] The terminal sends the generated identification information to the server. The server functions as a computer and uses the received identification information to refer to an information storage device (database) to determine whether the pharmaceutical product is eligible for tax reduction. If it is determined to be eligible, the server receives information about the transaction amount and transaction date from the user and records this in the user information storage device. This ensures that each user's purchase history is accurately maintained.

[0753] Furthermore, during the filing period, users can request the server to automatically generate filing documents via their terminal. The server, in response, generates the necessary filing documents in electronic format based on purchase history data stored in the information storage device and sends them to the terminal. Users can then review the contents of the filing documents on their terminal and make corrections as needed. The finalized filing can then be printed or submitted electronically to the tax authorities.

[0754] As a concrete example, suppose a user purchases a nutritional supplement at a pharmacy and scans the barcode printed on the package using a dedicated app. The terminal sends the barcode data to a server, which uses a database to determine if it is eligible for a tax deduction. The user then enters the purchase amount in the app, and this information is recorded on the server. Later, the user can request the system to create a tax return, receive an automatically generated return, and easily file their tax return.

[0755] The following prompt can be used for the generating AI model: "Design a system that automatically generates income tax deduction forms based on purchase history required for self-medication tax filing. A dedicated app scans the barcode of medicines, and a server refers to a database to identify tax-deductible items."

[0756] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0757] Step 1:

[0758] The user launches a dedicated application on their device and scans the barcode of the purchased medication. Specifically, the device's camera is used to read the barcode, and the digital data is captured within the app. At this stage, the input is the image data of the barcode captured by the camera, and the output is string information based on the barcode.

[0759] Step 2:

[0760] The terminal transmits the acquired barcode information to the server. This communication takes place via an internet connection, ensuring the secure transmission of the barcode information. The input here is the barcode information as string data, and the output is the barcode information received by the server.

[0761] Step 3:

[0762] The server uses the received barcode information to refer to the drug information storage device and determine whether the item is eligible for the self-medication tax deduction. The input is barcode information in string format, and a database query is executed to search for drug records. The output is either a boolean value as the determination result or detailed information about the drug.

[0763] Step 4:

[0764] If the item is identified as a target item, the server will prompt the user to enter the transaction amount and transaction date. The user then enters and submits the necessary data via the app. The input consists of numerical and date data entered by the user into the app, and the output is the corresponding data received by the server.

[0765] Step 5:

[0766] The server records the received transaction amount and transaction date in the user information storage device. This creates a purchase history for each user. The input is numerical and date data obtained from the user, and the output is the updated purchase history record in the database.

[0767] Step 6:

[0768] During the filing period, users request the server to automatically generate filing documents via their device. This operation is performed by clicking a specific button on the app. The input is the request to generate the filing document, and the output is the trigger for the filing document generation process on the server.

[0769] Step 7:

[0770] The server retrieves purchase history from the user information storage device and automatically generates income tax deduction declaration documents. This includes data aggregation and format conversion. The input is the user's purchase history data, and the output is a declaration document in electronic format.

[0771] Step 8:

[0772] The server sends the generated declaration document to the terminal and prompts the user for confirmation. The user can view the declaration document on the app and make corrections as needed. After confirmation and correction, the user saves or submits the finalized declaration. The input is the declaration document, and the output is the user-approved and corrected final declaration document.

[0773] (Application Example 1)

[0774] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0775] For modern consumers, efficiently and accurately identifying which products they purchase daily qualify for tax deductions is difficult. Furthermore, claiming deductions requires accurate tax returns, which are time-consuming and laborious to prepare. Traditional methods involve manual management and record-keeping, leading to delays and errors, highlighting the need for improvement.

[0776] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0777] In this invention, the server includes means for reading code information on a user terminal, means for transmitting the code information to an information processing device, and means for using the received code information in the information processing device to refer to a product information database and identify the target product. This enables the user to efficiently identify products eligible for tax deductions and automatically generate accurate tax returns.

[0778] A "user terminal" is an electronic device that has the function of reading code information and transmitting it to an information processing device.

[0779] "Code information" refers to encoded data used for product identification and information retrieval.

[0780] An "information processing device" is a computer system that processes code information received from a user terminal and identifies the target product by referring to a product information database.

[0781] A "product information database" is a data aggregation system that structures and stores information about various products, enabling searching and identification.

[0782] "Eligible products" refer to products that meet specific conditions when applying for tax deductions.

[0783] "Purchase price" refers to the amount the user paid when purchasing the product.

[0784] "Purchase date" refers to the date on which the user purchased the product.

[0785] A "user information database" is a data aggregation system that manages each user's purchase history and personal information.

[0786] A "declaration document" is a document automatically generated based on the user's purchase history in order to apply for tax deductions.

[0787] The system realizing this invention mainly consists of a user terminal, an information processing device, a product information database, a user information database, and a tax return generation module. The user terminal has a function to read product code information using a camera. This code information is transmitted to the information processing device using wireless communication technology. The information processing device operates on a server and, based on the received code information, refers to the product information database to determine whether the purchased product is eligible for tax deductions.

[0788] If the information processing device determines that a product is eligible for a deduction, it records the purchase price and purchase date in the user information database. This database holds each user's purchase history and personal information and is updated as needed. If a user wishes to file a declaration at any time, they can use the declaration form generation module to automatically generate a declaration document based on their purchase history. This declaration document is sent to the user's terminal, where the user can review and modify it.

[0789] As a concrete example, when a user scans the barcode of a health supplement they regularly purchase with their smartphone camera, the product information is automatically cross-referenced with a database, and it is immediately determined whether or not it is eligible for a tax deduction. If the product is eligible for a deduction, the information is automatically recorded, and at the end of the month, a tax deduction application form is automatically generated and sent to the user's smartphone.

[0790] An example of a prompt is the requirement: "Design a smartphone app to streamline the filing of self-medication tax returns. It will include an algorithm that scans barcodes and matches product information against a database."

[0791] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0792] Step 1:

[0793] The user's terminal reads the product's code information.

[0794] The user scans the product's barcode using the camera on their device. The input is the camera image, and the barcode data is extracted through image processing. The output is the code information.

[0795] Step 2:

[0796] The terminal transmits code information to the information processing device.

[0797] The terminal transmits the extracted barcode data to the server via wireless communication. The input is barcode data, which is converted into digital data according to the communication protocol and then transmitted. The server receives the barcode information as output.

[0798] Step 3:

[0799] The server identifies the target product by referring to the product information database.

[0800] The server queries the product information database based on the received barcode information and retrieves information about the corresponding product. The input is barcode information, and product information is obtained by searching the database. The output is a result that determines whether the product is eligible for tax deductions.

[0801] Step 4:

[0802] The server records the purchase price and purchase date in the user information database.

[0803] The server receives the price and date entered by the user when purchasing a product, and if it is the applicable product, it records it in the user information database. The input consists of the purchase date and price information, and a database write operation is performed. As output, the history is stored in the user information database.

[0804] Step 5:

[0805] The user makes a request to generate a declaration document.

[0806] The user sends instructions to the server via their terminal to create the tax return. The input is the user's request, and the server initiates the corresponding processing. As output, the server executes the tax return generation process.

[0807] Step 6:

[0808] The server automatically generates the declaration document and sends it to the user's terminal.

[0809] The server creates an electronic declaration document based on the purchase history in the user information database and sends it to the user's terminal. The input is the user's purchase history information, and the output document is generated through a data formatting and document creation process. As output, the declaration document is sent to the user's terminal.

[0810] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0811] This invention combines a system that supports users in filing self-medication tax returns based on their purchase of pharmaceuticals with an emotion engine that recognizes the user's emotions. In this system, when a user purchases pharmaceuticals, they first launch a dedicated application on their terminal and scan the drug's barcode. The terminal uses its camera to read the barcode information and transmits this information to a server. The server refers to a pharmaceutical database based on the received barcode information and determines whether the product is eligible for the self-medication tax deduction. If it is determined to be an eligible product, the server receives information from the user regarding the purchase amount and purchase date and records this information in the user database.

[0812] Furthermore, the user terminal is equipped with an emotion engine that collects emotional data from the user's facial expressions and voice during operation. The emotion engine analyzes this data to identify the user's emotional state. This information is used to dynamically adjust the user interface and improve the user experience. For example, if the emotion engine detects stress or anxiety when a user is checking their purchase history, the terminal will display reminders and guides to help the user proceed smoothly.

[0813] During the filing period, the user requests the server to generate a tax return from their device. The server compiles the necessary information based on the user's purchase history and automatically generates the tax return. Even during this process, the emotion engine monitors the user's state and reduces user burden by presenting relaxing messages and options as needed. The generated tax return is sent to the device in electronic format, allowing the user to review and make corrections. The user can then print the finalized tax return or submit it electronically to the tax authorities.

[0814] As a concrete example, suppose a user purchases medication and scans the barcode with the terminal's camera. The terminal recognizes the user's emotion of joy from their facial expression at that moment. Based on this information, the emotion engine changes the user interface to a brighter color scheme and makes adjustments to facilitate smoother operation. Later, if the system detects user stress at the time of application, it suggests simplified procedures and provides support optimized for the user's state. This allows the user to effectively complete the electronic filing process.

[0815] The following describes the processing flow.

[0816] Step 1:

[0817] When a user purchases medication, they launch the application on their device and select barcode scanning mode. The device then activates its camera and accurately reads the barcode.

[0818] Step 2:

[0819] The terminal converts the scanned barcode information into text data and sends this information to the server via the internet.

[0820] Step 3:

[0821] The server analyzes the received barcode information and refers to the pharmaceutical database to determine whether the drug is eligible for the self-medication tax deduction.

[0822] Step 4:

[0823] If the server determines that the product is eligible, it sends the relevant information to the user's terminal. The user enters the purchase price and sends it from the terminal to the server.

[0824] Step 5:

[0825] The server records the submitted purchase amount and purchase date in a database entry for each user. This database is used as administrative information for future reporting.

[0826] Step 6:

[0827] An emotion engine built into the device analyzes the user's facial expressions and voice during operation, and evaluates the user's emotional state in real time.

[0828] Step 7:

[0829] If the emotion engine detects user stress or anxiety, the device will implement interface adjustments to provide the user with messages and procedures to help them relax.

[0830] Step 8:

[0831] When a user wishes to generate a declaration form, they send a request from their device to the server. The server compiles the purchase history and automatically generates the declaration form.

[0832] Step 9:

[0833] The generated declaration is sent to the device, where the user reviews it and makes corrections as needed. The emotion engine monitors the user's state throughout this process and provides appropriate support.

[0834] Step 10:

[0835] After the user has finalized their tax return, the terminal assists them in submitting the return to the tax authorities as electronic data or by printing it out.

[0836] (Example 2)

[0837] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0838] Traditional tax reporting processes for pharmaceutical purchases are complex and burdensome for users due to the manual nature of the work, making efficient and accurate reporting difficult. Furthermore, the stress and anxiety associated with the reporting process detract from the user experience, resulting in delays and errors in reporting. Additionally, the user interface is inadequately adapted to emotional fluctuations.

[0839] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0840] In this invention, the server includes means for referring to a product information collection using identification code information to identify the target product, means for automatically generating documents based on purchase history, and means for dynamically adjusting the user interface using an emotion analysis engine. This makes it possible to streamline tax filing and provide a smooth filing procedure that reduces stress and anxiety by adjusting the interface according to the user's emotional state.

[0841] A "user device" is an electronic device intended for user operation and is responsible for collecting and transmitting data.

[0842] An "identification code" is a machine-readable symbol or number used to identify a product or service.

[0843] An "information processing device" is a central computing device that receives, processes, stores, and transmits data.

[0844] A "product information database" is a collection of data containing information about a wide variety of products, and is particularly used as a database to classify products according to specific criteria.

[0845] A "storage device" is a hardware or software component for recording and storing digital data.

[0846] An "emotion analysis engine" is a software component that analyzes a user's emotional state based on data collected from the user and adjusts the response as needed.

[0847] "User interface" is a general term for the screen layout and operating elements that enable interaction between a user and an electronic device.

[0848] "Electronic notification" is the process of sending information or messages to users in an electronic format.

[0849] "Tax-reduced" refers to goods or services that, under tax law, are eligible for a reduction in tax burden by meeting specific conditions.

[0850] A "document" is an electronic or physical record that formalizes and records information or data.

[0851] This invention is a system that assists users in purchasing pharmaceuticals and efficiently claiming tax benefits. The system includes a user device, an information processing device, and a sentiment analysis engine. Details of each component and their operation are described below.

[0852] User equipment

[0853] Users use a portable digital information terminal (PDCA) when purchasing pharmaceuticals. This terminal is equipped with a camera, which is used to read identification codes (barcodes). Dedicated image processing software is used for barcode scanning. For example, the OpenCV library is used to extract barcode information from image data.

[0854] Information processing device

[0855] The identification code information read by the terminal is transmitted to the information processing device via a secure communication method (e.g., HTTPS protocol). The information processing device receives this information and queries the product information database to determine whether the product is eligible for tax reduction. This database stores detailed information about pharmaceuticals and is managed using a database management system such as SQL.

[0856] Emotion analysis engine

[0857] The user device incorporates an emotion analysis engine that collects and analyzes emotional data through cameras and microphones during user operation. Deep learning models are used for the analysis to identify the user's emotional state. This information is immediately reflected in the user interface, and the visual elements of the interface are dynamically adjusted.

[0858] Specific example

[0859] For example, a user purchases medicine using the system and scans the barcode with the terminal's camera. The terminal communicates with an information processing device to confirm that the product is eligible for tax benefits. An emotion analysis engine detects the user's stress level, changes the interface to a relaxing color scheme, and presents simplified operating instructions.

[0860] Example of a prompt

[0861] "Please describe the process of scanning the barcode of a medication purchased by the user to determine if it is a valid product. Also, demonstrate how the interface dynamically adjusts based on the user's emotional state."

[0862] The system, configured in this way, aims to streamline tax declarations related to pharmaceutical purchases while taking user emotions into consideration.

[0863] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0864] Step 1:

[0865] The user purchases medication and launches a dedicated application on the terminal. The application controls the camera and prepares to scan the barcode. The input is a physical barcode, and the output is barcode data. This data is processed as an identification code and used in the next step.

[0866] Step 2:

[0867] The terminal uses a camera to read barcodes. The read barcode data is decoded using an image processing library. The input is image data captured by the camera, and the output is an identification code in text format. This code is sent to an information processing device for drug identification.

[0868] Step 3:

[0869] The terminal transmits an identification code to the information processing device. The HTTPS protocol is used during transmission to ensure data security. The input is an identification code in text format, and the output is a secure data transmission to the information processing device.

[0870] Step 4:

[0871] The server queries the product information database using the received identification code. The input is the identification code, and the output is the product information retrieved from the database. Here, the server also determines whether the product is eligible for tax reduction.

[0872] Step 5:

[0873] The server stores purchase records in the user database based on product information. Inputs are product information and user purchase details, and output is the addition of new records to the user database. The purchase amount and date are accurately recorded.

[0874] Step 6:

[0875] While the user is interacting with the device, the terminal uses an emotion analysis engine to collect facial expression and audio data. The input is real-time audio and image data, and the output is the analysis result of the user's emotional state. Based on these results, the interface's color scheme and recommended actions are dynamically changed.

[0876] Step 7:

[0877] During the tax filing period, users request to create a tax return from their terminal. The server aggregates the user's purchase history and automatically generates a tax return with the necessary fields filled in. The input is the user's purchase history, and the output is a tax return in electronic format.

[0878] Step 8:

[0879] The generated declaration form is sent to the terminal, where the user reviews and modifies it. The input is the initial declaration form data received from the server, and the output is the final declaration form modified by the user. The user can perform the operation while receiving interface guidance to reduce stress.

[0880] (Application Example 2)

[0881] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0882] Purchasing activities and tax filing procedures for users are often complex, time-consuming, and can be stressful. In particular, when utilizing tax reduction schemes, identifying eligible products and preparing tax returns can be burdensome for users. Furthermore, the lack of consideration for users' emotional states can hinder the smoothness of the process. The payment process itself can also be a source of emotional stress for users.

[0883] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0884] In this invention, the server includes means for referencing a product database using barcode information to identify the target product, means for analyzing the user's emotional state, and means for dynamically adjusting the user interface based on the emotional state to reduce emotional burden during declaration form creation and payment support. As a result, the user can perform the entire process from product purchase to declaration procedures stress-free.

[0885] A "user terminal" is an electronic device used by a user to scan product barcodes, display information, and operate devices.

[0886] "Barcode information" refers to information that contains unique identification data about a product and is transmitted to a server to identify the target product.

[0887] A "server" is a computer system that receives information sent from user terminals and performs database lookups and information processing.

[0888] A "product database" is a data storage system that stores information about various products, allowing a server to refer to it and identify the target product.

[0889] A "user database" is a data storage system that records users' purchase history and declaration information, making it accessible as needed.

[0890] "Automatic generation of declaration forms" refers to the process of automatically compiling necessary information based on the user's purchase history and creating documents for declaration purposes.

[0891] "Emotional state" refers to the user's psychological state, analyzed based on facial expressions and voice observed during user interaction.

[0892] "Analysis means" refers to software and algorithms that use an emotion engine to collect the user's facial expressions and voice, and analyze their emotional state based on that data.

[0893] "Dynamic user interface adjustments" refer to adjustments made to improve the user experience by changing the screen display and operation methods in response to the user's emotions.

[0894] The system for implementing this invention consists of a user terminal, a server, a database, and an emotion analysis engine.

[0895] The user terminal is an electronic device such as a smartphone, which scans the product's barcode with its camera and acquires it as digital data. The acquired barcode information is transmitted to a server via wireless communication. Image recognition software is used in this process.

[0896] The server uses the received barcode information to refer to the product database and determine whether the product is subject to taxation. The server also records relevant information, such as the purchase price and date, in the user database. Data management software and a database management system are used for data processing.

[0897] Furthermore, the user terminal has a built-in emotion analysis engine that analyzes the user's facial expressions and voice to identify their emotional state. Emotion analysis uses machine learning algorithms and voice analysis technology. If the user is experiencing stress, the user interface is adjusted to make it more user-friendly and intuitive to use.

[0898] For example, when a user purchases medication and scans its barcode, if the emotion engine detects a feeling of joy, the background of the displayed screen will change to a brighter color and provide positive feedback to smooth the operation. Also, if the user expresses anxiety while creating a declaration, the server will present simplified instructions.

[0899] Examples of prompts to input into the generating AI model include, "What is a sentiment-based UI optimization method to display to users during payment?" and "Please suggest application features to reduce user stress while shopping."

[0900] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0901] Step 1:

[0902] The user uses a device to scan the product's barcode.

[0903] The input is image data of a barcode acquired through a camera, and the output is digitized data of the barcode information. This data is analyzed by image recognition software, and the barcode information is extracted.

[0904] Step 2:

[0905] The terminal sends the extracted barcode information to the server.

[0906] The input is digitized barcode information, and the output is wireless data transmission to a server. This includes specific actions to transmit information accurately and quickly using a communication protocol.

[0907] Step 3:

[0908] The server uses the received barcode information to refer to the product database and identify the target product.

[0909] The input is barcode information received from a terminal, and the output is whether or not the item is subject to taxation and related information. A database management system is used to execute queries and perform specific data calculations to obtain the desired product information.

[0910] Step 4:

[0911] The server records the user's purchase amount and date in the user database.

[0912] The input is the amount and purchase date information obtained from the buyer, and the output is the result of recording it in the user database. A database management system is used to perform the specific operations to persist the information.

[0913] Step 5:

[0914] The device's emotion analysis engine analyzes the user's emotional state.

[0915] The input is the user's facial expressions and voice data, and the output is the analyzed emotional state. A machine learning algorithm is used to analyze the emotional data and perform specific data calculations to classify the emotions.

[0916] Step 6:

[0917] The device dynamically adjusts the user interface based on the analyzed emotional state.

[0918] The input is the analyzed emotional state, and the output is the display of the adjusted interface. Specific actions are performed to modify the interface elements using UI design software.

[0919] Step 7:

[0920] The server automatically generates a declaration form using the user's purchase history in response to their declaration request, and aggregates information from the user database.

[0921] The input is the purchase history recorded in the user database, and the output is a digital document of the declaration form. A template is used to perform the specific process of filling in the necessary items and generating the document.

[0922] Step 8:

[0923] Users review and correct the declaration forms generated using their devices.

[0924] The input is a digital tax return document received from the server, and the output is the final tax return. The interface allows users to directly modify the content through editing.

[0925] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0926] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0927] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0928] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0929] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0930] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0931] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0932] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0933] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0934] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0935] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0936] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0937] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0938] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0939] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0940] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0941] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0942] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0943] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0944] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0945] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0946] The following is further disclosed regarding the embodiments described above.

[0947] (Claim 1)

[0948] A means of reading barcodes on the user terminal,

[0949] A means of sending barcode information to a server,

[0950] A means for identifying the target product by referring to a pharmaceutical database using barcode information received on the server,

[0951] A means of recording the purchase amount and purchase date in the user database,

[0952] A means of automatically generating a declaration form based on the user's purchase history in response to their declaration request,

[0953] A system that includes this.

[0954] (Claim 2)

[0955] The system according to claim 1, wherein the server uses a database of pharmaceuticals to determine eligibility for self-medication tax deductions.

[0956] (Claim 3)

[0957] The system according to claim 1, which allows a user to view and correct a declaration form using a terminal.

[0958] "Example 1"

[0959] (Claim 1)

[0960] A means for reading identification information on the user's device,

[0961] Means for transmitting identification information to a computer,

[0962] A means for identifying an item by referring to an information storage device using identification information received in an electronic computer,

[0963] Means for recording the transaction amount and transaction date in a user information storage device,

[0964] A means of automatically generating declaration documents based on transaction history in response to the user's declaration request,

[0965] A means of ensuring security by conducting encrypted communications,

[0966] A system that includes this.

[0967] (Claim 2)

[0968] The system according to claim 1, wherein an electronic computer device uses an information storage device to determine which items are eligible for tax reduction.

[0969] (Claim 3)

[0970] The system according to claim 1, which allows a user to review and modify a declaration document using a device.

[0971] "Application Example 1"

[0972] (Claim 1)

[0973] A means of reading code information on the user's terminal,

[0974] Means for transmitting code information to an information processing device,

[0975] A means for identifying a target product by referring to a product information database using code information received in an information processing device,

[0976] A means for recording the purchase price and purchase date in a user information database,

[0977] A means of automatically generating a declaration document based on the user's purchase history in response to their declaration request,

[0978] A means of sending the declaration document to the user's terminal, allowing for confirmation and correction,

[0979] A system that includes this.

[0980] (Claim 2)

[0981] The system according to claim 1, wherein the information processing device uses a product information database to determine eligibility for tax deductions.

[0982] (Claim 3)

[0983] The system according to claim 1, which allows a user to check and correct a declaration document using a terminal.

[0984] "Example 2 of combining an emotion engine"

[0985] (Claim 1)

[0986] A means for reading an identification code on a user device,

[0987] Means for transmitting identification code information to an information processing device,

[0988] A means for identifying a target product by referring to a product information collection using identification code information received in an information processing device,

[0989] Means for recording the purchase price and purchase date in a storage device,

[0990] A means of automatically generating documents based on purchase history in response to a user's request,

[0991] A means of analyzing user information using an emotion analysis engine and dynamically adjusting the user interface,

[0992] A means of providing users with the status of their declarations through electronic notifications,

[0993] A system that includes this.

[0994] (Claim 2)

[0995] The system according to claim 1, in which an information processing device uses a product information collection to determine which items are eligible for tax reduction.

[0996] (Claim 3)

[0997] The system according to claim 1, which allows a user to view and modify a document using a device.

[0998] "Application example 2 when combining with an emotional engine"

[0999] (Claim 1)

[1000] A means of reading barcodes on the user terminal,

[1001] A means of sending barcode information to a server,

[1002] A means for identifying the target product by referring to a product database using barcode information received on the server,

[1003] A means of recording the purchase amount and purchase date in the user database,

[1004] A means of automatically generating a declaration form based on the user's purchase history in response to their declaration request,

[1005] An analytical means for recognizing the user's emotional state,

[1006] A means of dynamically adjusting the user interface based on emotional state,

[1007] A system that includes this.

[1008] (Claim 2)

[1009] The system according to claim 1, wherein the server uses a product database to determine whether a product is subject to taxation.

[1010] (Claim 3)

[1011] The system according to claim 1, which allows a user to review and correct a declaration form using a terminal, and further provides emotionally appropriate support messages. [Explanation of Symbols]

[1012] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of reading code information on the user's terminal, Means for transmitting code information to an information processing device, A means for identifying a target product by referring to a product information database using code information received in an information processing device, A means for recording the purchase price and purchase date in a user information database, A means of automatically generating a declaration document based on the user's purchase history in response to their declaration request, A means of sending the declaration document to the user's terminal, allowing for confirmation and correction, A system that includes this.

2. The system according to claim 1, in which an information processing device uses a product information database to determine eligibility for tax deductions.

3. The system according to claim 1, which allows a user to check and correct a declaration document using a terminal.

Images