System

Abstract

A system is provided.SOLUTION: A system comprising: means for inputting subscription information provided by a user; means for centrally managing the subscription information; means for monitoring update dates of the subscription information and generating reminders; means for sharing the subscription information among family members; and means for analyzing usage and providing optimal subscription suggestions.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, the use of subscription services has skyrocketed, making it difficult for individuals and families to manage numerous subscriptions. Problems include duplicate contracts between family members for the same service, and unnecessary spending due to unawareness of automatic renewals. Furthermore, manually managing paper-based contracts and receipts is time-consuming and prone to errors. There is a need for a solution that will allow users to manage their subscriptions efficiently and economically. [Means for solving the problem]

[0005] The present invention provides a system that includes a means for inputting subscription information provided by a user, a means for centrally managing subscription information, a means for monitoring renewal dates of subscription information and generating reminders, a means for sharing subscription information among family members, and a means for analyzing usage patterns and providing optimal subscription suggestions. The present invention also includes a means for scanning paper contracts and receipts and extracting text data, and a means for analyzing the extracted text data to identify subscription information. This allows users to efficiently manage subscription information, avoid duplicate spending among family members, and support optimal consumption behavior.

[0006] "User" refers to an individual or family member who uses the system to manage and share subscription information.

[0007] "Subscription information" refers to information including details such as the name, provider, contract period, and cost of the periodic service to which a user subscribes.

[0008] "Scanning means" refers to a technological means for converting a paper contract or receipt into a digital image and extracting text data.

[0009] "Text data" refers to textual information extracted from a digital image acquired by a scanning means.

[0010] "Analysis Means" means the technical means for analyzing the Extracted Character Data and identifying the appropriate Subscription Information.

[0011] The "reminder generating means" refers to a means for monitoring the renewal date of subscription information and notifying the user before the renewal date.

[0012] "Sharing Method" means the technological means by which subscription information is shared among family members to avoid duplicate spending.

[0013] "Usage" refers to information such as the frequency of use and spending patterns of subscription services subscribed to by a user.

[0014] "Optimization suggestion means" refers to a technical means for analyzing usage and providing users with optimal subscription plans and saving advice.

[0015] "Centralized management means" refers to a technical means that enables centralized management of multiple subscription information. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] This invention relates to a system that centrally manages subscription information provided by users and enables it to be shared among family members. This system has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions.

[0038] System Overview

[0039] User Registration and Login

[0040] A user first accesses an application or website and creates a new account by entering required information such as name, email address, and password. The information entered by the user is encrypted for security purposes and sent from the device to the server.

[0041] The server saves the received information in a database and returns a response indicating that the information was saved successfully to the terminal. The user then checks the authentication email sent at this time and clicks on the link to activate the account.

[0042] The user accesses the login screen with an activated account and logs in by entering their email address and password. Authentication is performed on the server, and if successful, the user can access the dashboard.

[0043] Manage your subscription information

[0044] Users can input various subscription information (service name, provider, contract period, cost, etc.) that they have signed up for. This information is sent to the server via the terminal and stored in a database.

[0045] Based on the entered subscription information, the server generates an interface for centralized management on the dashboard and provides it to the user.

[0046] Automatically retrieve subscription information

[0047] Users can take a photo of a paper contract or receipt using the app's scanning function, and the image is sent to character recognition software (OCR) by the device, where text data is extracted.

[0048] The server analyzes the extracted character data and stores it in the database as appropriate subscription information. After storing it, it sends a confirmation notice to the user so that the user can confirm it.

[0049] Contract Renewal Reminders

[0050] The server monitors the contract renewal date in the database and generates a reminder a pre-set period before the contract renewal date, thereby notifying the user before the contract renewal date.

[0051] The device will receive the reminder and display a notification to the user, so that the user does not miss the timing of automatic renewal or contract renewal.

[0052] Family sharing

[0053] Users register their family members' accounts in the system and set up specific subscription sharing settings, which are then sent from the device to the server and stored in a database.

[0054] Users (family members) can view shared subscription information on their own dashboard, which helps prevent duplicate spending between family members.

[0055] Usage analysis and optimization suggestions

[0056] The server collects subscription usage data from users and analyzes their usage frequency and patterns, based on which it generates optimal subscription plans and savings advice for users.

[0057] The terminal receives optimization suggestions from the server and notifies the user, who can then review the suggestions and take necessary actions.

[0058] Specific examples

[0059] For example, suppose User A uses a "regular food delivery service" and a "video streaming service." User A can enter the service information into the app or scan the contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches.

[0060] Furthermore, when User A registers and shares information about his family members, it becomes clear that Family B has a duplicate subscription to the same "video streaming service." The system then presents User A with optimization suggestions to avoid this duplicate subscription, allowing User A to adjust the subscription details with Family B accordingly.

[0061] This allows User A and his family to use the subscription service more efficiently and economically.

[0062] The processing flow will be explained below.

[0063] User Registration and Login

[0064] Step 1:

[0065] The user accesses the application or website and enters the required information (name, email address, password) on the new registration screen.

[0066] Step 2:

[0067] The device sends the entered information to the server, where the user's password is hashed in a secure manner.

[0068] Step 3:

[0069] The server validates the received information to ensure its validity, and if validation is successful, stores the user information in the database.

[0070] Step 4:

[0071] The server generates a successful registration response and sends it to the device. The user opens the authentication email sent to them and clicks the authentication link to activate their account.

[0072] Step 5:

[0073] The user accesses the login screen again with the activated account and logs in by entering their email address and password.

[0074] Step 6:

[0075] The terminal transmits the entered login information to the server.

[0076] Step 7:

[0077] The server validates the login information and confirms that the user exists. If successful, it creates a session and sends a success response back to the terminal.

[0078] Manage your subscription information

[0079] Step 1:

[0080] The user enters subscription information (service name, provider, contract period, cost, etc.) on the app's subscription addition screen.

[0081] Step 2:

[0082] The terminal transmits the entered subscription information to the server.

[0083] Step 3:

[0084] The server stores the received information in a database, and if the storage is successful, returns a confirmation response to the terminal.

[0085] Automatically retrieve subscription information

[0086] Step 1:

[0087] Users can take a photo of a paper contract or receipt using the app's scanning function.

[0088] Step 2:

[0089] The device sends the captured image to an OCR engine and extracts the text data.

[0090] Step 3:

[0091] The server analyzes the character data received from the OCR engine and identifies the subscription information.

[0092] Step 4:

[0093] The server stores the identified subscription information in a database and sends a confirmation to the user.

[0094] Contract Renewal Reminders

[0095] Step 1:

[0096] The server periodically checks the contract renewal date of the subscription information in the database.

[0097] Step 2:

[0098] The server generates reminders when contract renewal dates approach.

[0099] Step 3:

[0100] The terminal receives the reminder notification from the server and displays the notification to the user.

[0101] Family sharing

[0102] Step 1:

[0103] Users register their family members' accounts in the app and set up sharing of subscription information.

[0104] Step 2:

[0105] The terminal transmits the setting information to the server.

[0106] Step 3:

[0107] The server stores the received sharing settings in a database and sends a notification to the family members with whom the sharing is intended.

[0108] Step 4:

[0109] Users (family members) can view and manage shared subscription information on their own dashboard.

[0110] Usage analysis and optimization suggestions

[0111] Step 1:

[0112] The server collects users' subscription usage data and analyzes their usage frequency and spending patterns.

[0113] Step 2:

[0114] The server generates optimal subscription plans and savings advice based on the analysis results.

[0115] Step 3:

[0116] The terminal notifies the user of the optimization proposal received from the server, and the user can check the proposal and take necessary actions.

[0117] In this way, specific operations are performed at each step, allowing the user to manage subscription information efficiently and optimally.

[0118] Example 1

[0119] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0120] With conventional subscription management systems, each user had to manage their contract information individually, making it difficult to keep track of contract renewal dates and share information among family members. It was also difficult to digitally acquire and properly manage information from paper contracts and receipts, making it difficult to analyze usage patterns and propose optimal subscription plans. Furthermore, the security and centralized data management required to solve these problems were not adequately considered.

[0121] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0122] In this invention, the server includes means for having a user enter registration information and encrypting it for security before transmitting it to the server, means for the server to store the received information in a database, send an authentication email, and have the user activate their account, means for the server to authenticate the user's account and, if successful, allow the user to access the dashboard, means for centrally managing subscription information, means for monitoring the update date of the subscription information and generating reminders, means for sharing the subscription information among family members, means for analyzing usage patterns and providing optimal subscription proposals, means for scanning paper contracts and receipts and extracting text data, and means for analyzing the extracted text data and identifying subscription information. This allows users to centrally manage contract information, avoid duplicate spending among family members, and receive optimal subscription proposals.

[0123] "User" refers to an individual or entity that uses the System to register, manage, and share subscription information.

[0124] "Subscription information" is information related to the subscription service to which the user has subscribed, and includes details such as the service name, provider, contract period, and cost.

[0125] "Server" refers to a computer resource that receives information sent from users, stores it in a database, manages it, and analyzes it.

[0126] "Terminal" refers to a device, such as a computer or smartphone, that a user uses to access the system.

[0127] "Database" means a collection of information for securely storing and managing user and subscription information.

[0128] "Encryption" refers to the process of transforming data using a specific algorithm to protect the contents of the information from third parties.

[0129] "Verification Email" means an email sent to a user to validate their account registration, which includes an authentication link.

[0130] "Reminder" refers to a message from the system that notifies users in advance of important deadlines, such as contract renewal dates.

[0131] "OCR" stands for Optical Character Recognition, a technology that reads characters from images or scanned documents and converts them into digital data.

[0132] "Dashboard" means a web or application interface that allows a User to manage and view their subscription information at a glance.

[0133] "Duplicate spending" refers to wasteful spending resulting from multiple contracts for the same subscription service within a household.

[0134] "Usage analysis" refers to the process of analyzing usage trends and patterns based on user subscription service usage data.

[0135] "Optimal subscription proposal" refers to recommending the most effective and economical subscription plan to a user based on an analysis of usage.

[0136] This invention provides a system that centrally manages subscription information provided by users and allows it to be shared among family members. This system has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions. A specific embodiment of this system is described below.

[0137] User Registration and Login

[0138] A user accesses an application or website and creates a new account by entering the required information, such as name, email address, and password. The information entered by the user is encrypted using RSA encryption technology for security purposes and sent from the device to the server.

[0139] The server saves the received information in a database (e.g., MySQL) and returns a response indicating that the information was saved successfully to the terminal. The user checks the authentication email sent at this time and clicks on the link to activate the account.

[0140] With an activated account, the user accesses the login screen and enters their email address and password to log in. Authentication is performed by the server, and if successful, the user is given access to the dashboard.

[0141] Manage your subscription information

[0142] The user inputs the various subscription information (service name, provider, contract period, cost, etc.) that they have signed up for. This information is sent to the server via the terminal and stored in a database.

[0143] Based on the entered subscription information, the server generates an interface for centralized management on the dashboard and provides it to the user.

[0144] Automatically retrieve subscription information

[0145] Users can take a photo of a paper contract or receipt using the app's scanning function, and the captured image is sent to character recognition software (OCR, e.g., Tesseract OCR library) by the device, where text data is extracted.

[0146] The server analyzes the extracted character data and stores it in the database as appropriate subscription information. After storing it, it sends a confirmation notice to the user so that the user can confirm it.

[0147] Contract Renewal Reminders

[0148] The server monitors the contract renewal date in the database and generates a reminder a pre-set period before the contract renewal date, thereby notifying the user before the contract renewal date.

[0149] The device will receive the reminder and display a notification to the user, so that the user does not miss the timing of automatic renewal or contract renewal.

[0150] Family sharing

[0151] Users register their family members' accounts in the system and set up specific subscription sharing settings, which are then sent from the device to the server and stored in a database.

[0152] Users (family members) can view shared subscription information on their own dashboard, which helps prevent duplicate spending between family members.

[0153] Usage analysis and optimization suggestions

[0154] The server collects subscription usage data from users and analyzes their usage frequency and patterns, based on which it generates optimal subscription plans and savings advice for users.

[0155] The terminal receives optimization suggestions from the server and notifies the user, who can then review the suggestions and take necessary actions.

[0156] Specific examples

[0157] For example, suppose User A uses a "regular food delivery service" and a "video streaming service." User A can enter the service information into the app or scan the contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches.

[0158] Furthermore, when User A registers and shares information about his family members, it becomes clear that Family B has a duplicate subscription to the same "video streaming service." The system then presents User A with optimization suggestions to avoid this duplicate subscription, allowing User A to adjust the subscription details with Family B accordingly.

[0159] This allows User A and his family to use the subscription service more efficiently and economically.

[0160] Example prompts for generative AI models

[0161] "Please create a program that allows users to register and manage subscription information and share it with their family members. Please include a function that allows users to enter or scan information about the services they subscribe to, a function that generates and notifies them of subscription renewal reminders, a function that allows information to be shared among family members, and a function that analyzes usage and makes optimization suggestions."

[0162] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0163] Step 1:

[0164] To create a new account, a user enters their name, email address, and password and submits the data to the server.

[0165] Input: Name, Email Address, Password

[0166] Processing: The terminal encrypts the entered information using RSA encryption technology and sends it to the server.

[0167] Output: Encrypted user information

[0168] Step 2:

[0169] The server stores the encrypted user information it receives in a database.

[0170] Input: Encrypted user information

[0171] Processing: The server saves the user information in a database (e.g. MySQL) and sends a verification email to the user.

[0172] Output: Verification email

[0173] Step 3:

[0174] The user clicks the link in the verification email to activate their account.

[0175] Input:Authentication link

[0176] Processing: The server receives the link and updates the user account to an activated status.

[0177] Output: Activated accounts

[0178] Step 4:

[0179] The user enters their email address and password on the login screen and sends them to the server.

[0180] Input: Email address, password

[0181] Processing: The server performs authentication and, if successful, displays the dashboard to the user.

[0182] Output: Dashboard access

[0183] Step 5:

[0184] The user enters subscription information (service name, provider, contract period, cost) and sends it to the server.

[0185] Input: Subscription information

[0186] Processing: The terminal inputs information and sends it to the server, which stores the received information in a database.

[0187] Output: Saved subscription information

[0188] Step 6:

[0189] The server generates the dashboard interface and provides it to the user.

[0190] Input: Saved subscription information

[0191] Processing: The server retrieves information from the database and generates the dashboard interface.

[0192] Output: Dashboard interface

[0193] Step 7:

[0194] The user takes a photo of a paper contract or receipt using the app's scanning function and sends it to the device.

[0195] Input: A photograph of a contract or receipt

[0196] Processing: The device extracts character data using OCR (Optical Character Recognition) technology.

[0197] Output: Extracted character data

[0198] Step 8:

[0199] The terminal transmits the extracted character data to the server, which analyzes it to identify subscription information.

[0200] Input: Extracted character data

[0201] Processing: The server parses the character data, recognizes it as subscription information, and stores it in the database.

[0202] Output: Identified subscription information

[0203] Step 9:

[0204] The server monitors the database for renewal dates and generates reminders as needed.

[0205] Input: Database contract information

[0206] Processing: The server periodically checks the contract renewal date and generates a reminder notification when the renewal date approaches.

[0207] Output: Reminder notification

[0208] Step 10:

[0209] The device receives the reminder notification and displays the notification to the user.

[0210] Input: Reminder

[0211] Processing: The device displays a notification to the user, who checks the notification and takes the necessary action.

[0212] Output: The notification displayed to the user

[0213] Step 11:

[0214] The user registers family member accounts in the system and sets up subscription information sharing among family members.

[0215] Input: Family member information, shared subscription information

[0216] Processing: The device sends the information to the server, which stores it in a database.

[0217] Output: Shared subscription information

[0218] Step 12:

[0219] Family members can view the shared subscription information on their dashboard.

[0220] Input: Shared subscription information

[0221] Processing: The server retrieves information from the database and reflects it on the family member's dashboard.

[0222] Output: Shared information displayed on family member's dashboard

[0223] Step 13:

[0224] The server collects user subscription usage data and analyzes usage frequency and patterns.

[0225] Input: Subscription usage data

[0226] Processing: The server analyzes the data to identify usage patterns and frequencies.

[0227] Output: Analysis results

[0228] Step 14:

[0229] The server generates optimal subscription plans and savings advice based on the analysis results.

[0230] Input: Analysis results

[0231] Processing: The server generates the optimal plan or advice for the user.

[0232] Output: Optimization suggestions

[0233] Step 15:

[0234] The terminal receives the optimization proposal and notifies the user.

[0235] Input: Optimization proposal

[0236] Processing: The terminal notifies the user of the proposal so that the user can confirm it.

[0237] Output: The suggestion sent to the user

[0238] (Application example 1)

[0239] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0240] Conventional subscription management systems make it difficult to centrally manage information about various subscriptions subscribed to by users, and lack reminder functions and functions for sharing information among family members, which leads to problems such as duplicate contracts and wasteful spending. Furthermore, updating and managing contract information is particularly cumbersome for services used daily, such as food delivery services, and efficient management is required.

[0241] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0242] In this invention, the server includes: a means for inputting subscription information provided by the user; a means for centrally managing the subscription information; a means for monitoring the renewal date of the subscription information and generating reminders; a means for sharing the subscription information among family members; a means for analyzing usage and providing optimal subscription proposals; a means for registering and managing subscription information for food delivery services; a means for the user to scan a paper contract and extract text data using OCR; a means for identifying the extracted text data as subscription information; and a means for notifying a smart device of a reminder when the contract renewal date approaches. This allows users to centrally manage the various subscription information they have subscribed to, receive reminders when the renewal date approaches, and avoid duplicate subscriptions by sharing information among family members. Furthermore, analyzing usage and receiving optimal subscription proposals allows users to use services efficiently and economically.

[0243] "User" means a user of the system who registers, manages, and shares subscription information and receives reminders and suggestions.

[0244] "Subscription information" is information about various services to which a user has subscribed, and includes the service name, provider, contract period, cost, etc.

[0245] "Centralized management" means that multiple subscription information is managed uniformly on one system.

[0246] "Reminder" is a function that notifies users when their subscription renewal date is approaching.

[0247] "Family information sharing" is a feature that allows family members who use the same system to view and share each other's subscription information.

[0248] "Usage analysis" means analyzing usage data of subscription services for which a user has signed up to evaluate frequency and patterns of use.

[0249] "Optimal subscription proposals" are proposals that present the most appropriate and economical subscription plans and saving methods for users based on an analysis of usage.

[0250] A "food delivery service" is a service that delivers ingredients and meals ordered online to a specified location.

[0251] "OCR" is an abbreviation for optical character recognition, a technology that extracts character information from image data.

[0252] "Smart devices" refer to intelligent devices with internet connectivity, such as smartphones, smart glasses, and head-mounted displays.

[0253] The system for implementing this invention is designed to enable users to efficiently use food delivery services by registering, managing, and sharing subscription information and providing reminders and optimal suggestions.

[0254] composition

[0255] The system consists of the following main components:

[0256] 1. Server

[0257] 2. Terminals (smartphones, smart glasses, other smart devices)

[0258] 3. OCR Software

[0259] 4. Database

[0260] 5. Notification System

[0261] User Registration and Login

[0262] First, the user creates a new account by entering necessary information such as name, email address, and password on the device.

[0263] The terminal sends the encrypted user information to the server, which stores it in a database.

[0264] The user checks the verification email sent to them and clicks the link to activate their account, after which they can log in.

[0265] Manage your subscription information

[0266] Enter the subscription information (service name, provider, contract period, cost, etc.) for the food delivery service to which the user has subscribed.

[0267] The terminal sends this information to the server, which stores it in a database.

[0268] Automatically retrieve subscription information

[0269] A user scans a paper contract with a smartphone app, and the scanned image is converted into text data by OCR software.

[0270] The server analyzes this character data and stores it in a database as subscription information.

[0271] Contract Renewal Reminders

[0272] The server monitors contract renewal dates in the database and generates reminders before a pre-set period.

[0273] The device will receive this reminder and display a notification to the user.

[0274] Family sharing

[0275] The user registers accounts for family members and sets up shared subscription information.

[0276] The server stores this setting information in a database, allowing information to be shared among family members.

[0277] Usage analysis and optimization suggestions

[0278] The server collects subscription usage data and analyzes usage patterns.

[0279] Based on the results of this analysis, the server generates and notifies the user of the optimal subscription plan and savings proposals.

[0280] Specific examples

[0281] For example, when a user scans a "Food Subscription" contract with a smartphone app, the information is read using OCR and automatically registered in the app. Then, when the contract renewal date approaches, a reminder notification pops up on the smart glasses.

[0282] Example prompts to input to a generative AI model

[0283] Prompt: How can I develop an application that scans my "food subscription" contract and notifies me when it's due for renewal?

[0284] This allows users to manage and use food delivery services efficiently and economically.

[0285] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0286] Step 1:

[0287] A user launches the smartphone app and creates a new account by entering required information such as name, email address, and password.

[0288] Input: Name, email address, and password entered by the user.

[0289] Data processing: The terminal encrypts the entered password for security purposes.

[0290] Output: Sends the encrypted password, name, and email address to the server.

[0291] Step 2:

[0292] The server stores the received user information in a database and returns a response to the terminal indicating that the information has been successfully stored.

[0293] Input: Encrypted password, name, and email address sent from your device.

[0294] Data processing: The server stores this information in a database.

[0295] Output: Returns a save completion response to the terminal.

[0296] Step 3:

[0297] The user checks the verification email sent to them and clicks on the link to activate their account.

[0298] Input: Click the link in the verification email.

[0299] Data processing: The server activates the user's account.

[0300] Output: Account activation notification.

[0301] Step 4:

[0302] Users log in with an activated account and enter their subscription information.

[0303] Input: Subscription information (service name, provider, contract period, cost, etc.).

[0304] Data processing: The device sends the entered information to the server.

[0305] Output: Submits subscription information to the server.

[0306] Step 5:

[0307] The server stores the submitted subscription information in a database and generates a dashboard based on it.

[0308] Input: Subscription information sent from the device.

[0309] Data processing: The server stores subscription information in a database and generates a dashboard.

[0310] Output: Sends the updated dashboard to the device.

[0311] Step 6:

[0312] The user scans the contract with a smartphone app, and the OCR software extracts the text data.

[0313] Input: Scanned contract image data.

[0314] Data processing: OCR software extracts text information from image data.

[0315] Output: The extracted character data is sent to the server.

[0316] Step 7:

[0317] The server analyzes the character data received from the OCR software and stores it in a database as subscription information.

[0318] Input: The extracted character data.

[0319] Data processing: The server parses the text data and formats it as subscription information.

[0320] Output: Formatted subscription information stored in the database.

[0321] Step 8:

[0322] The server monitors contract renewal dates in the database and generates reminders before a pre-set period.

[0323] Input: Subscription information in the database.

[0324] Data processing: The server checks the contract renewal date and generates a reminder.

[0325] Output: Send reminder notification to device.

[0326] Step 9:

[0327] The terminal receives the generated reminder and displays a notification to the user.

[0328] Input: Reminder notification sent from the server.

[0329] Data processing: The device displays reminder notifications.

[0330] Output: Notify the user of the reminder.

[0331] Step 10:

[0332] The user registers accounts for family members and sets up sharing of subscription information.

[0333] Input: Family member's account information.

[0334] Data processing: The device sends the share setting information to the server.

[0335] Output: Sends shared configuration information to the server.

[0336] Step 11:

[0337] The server stores the shared setting information in a database and shares the subscription information among family members.

[0338] Input: Shared configuration information.

[0339] Data processing: The server stores the shared setting information in a database and checks the integrity of the shared information.

[0340] Output: Sharing subscription information between family members.

[0341] Step 12:

[0342] The server collects subscription usage data, analyzes it, and generates optimal offers for users.

[0343] Input: Subscription usage data.

[0344] Data processing: The server analyzes usage patterns and generates optimal plans and savings proposals.

[0345] Output: Notify the device of the suggestion.

[0346] Step 13:

[0347] The terminal notifies the user of the optimization proposal received from the server, and the user confirms it.

[0348] Input: Optimization suggestions sent by the server.

[0349] Data processing: The device will display optimization suggestions.

[0350] Output: Notify user of optimization suggestions.

[0351] The above is the specific processing flow of the program of the system that realizes the application example.

[0352] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0353] This invention relates to a system that centrally manages subscription information provided by users, shares it among family members, and combines it with an emotion engine that recognizes the user's emotions. This system not only has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions, but also uses the emotion engine to make suggestions and notifications based on the user's emotions.

[0354] System Overview

[0355] User Registration and Login

[0356] A user accesses an application or website and creates a new account by entering required information such as name, email address, and password. The information entered by the user is encrypted for security purposes and sent from the device to the server.

[0357] The server saves the received information in its database and returns a response indicating successful saving to the terminal. The user checks the authentication email sent and clicks on the link to activate their account.

[0358] The user accesses the login screen with an activated account and logs in by entering their email address and password. Authentication is performed on the server, and if successful, the user can access the dashboard.

[0359] Manage your subscription information

[0360] Users can input various subscription information (service name, provider, contract period, cost, etc.) that they have signed up for. This information is sent to the server via the terminal and stored in a database.

[0361] Based on the entered subscription information, the server generates an interface for centralized management on the dashboard and provides it to the user.

[0362] Automatically retrieve subscription information

[0363] Users can take a photo of a paper contract or receipt using the app's scanning function, and the image is sent to character recognition software (OCR) by the device, where text data is extracted.

[0364] The server analyzes the extracted character data and stores it in the database as appropriate subscription information. After storing it, it sends a confirmation notice to the user so that the user can confirm it.

[0365] Contract Renewal Reminders

[0366] The server periodically checks the contract renewal date in the database and generates a reminder a pre-set period before the contract renewal date, thereby notifying the user before the contract renewal date.

[0367] The device will receive the reminder and display a notification to the user, so that the user does not miss the timing of automatic renewal or contract renewal.

[0368] Family sharing

[0369] Users register their family members' accounts in the system and set up specific subscription sharing settings, which are then sent from the device to the server and stored in a database.

[0370] Users (family members) can view shared subscription information on their own dashboard, which helps prevent duplicate spending between family members.

[0371] Usage analysis and optimization suggestions

[0372] The server collects subscription usage data from users and analyzes their usage frequency and patterns, based on which it generates optimal subscription plans and savings advice for users.

[0373] The terminal receives optimization suggestions from the server and notifies the user, who can then review the suggestions and take necessary actions.

[0374] Emotion Engine

[0375] When a user uses the app, the emotion engine analyzes the user's facial expressions and tone of voice to collect emotional data.

[0376] The device transmits emotion data to the server, which collects the emotion data with the user's consent.

[0377] The server analyzes the emotional data to understand the user's emotional state and uses this emotional data to tailor the content of subscription offers and notification methods.

[0378] The device displays subscription suggestions and notifications tailored to the user by the emotion engine, for example, suggesting relaxing entertainment services if the user is feeling stressed.

[0379] Specific examples

[0380] For example, suppose User A uses a "weekly magazine subscription" and a "music streaming service." User A can enter the service information into the app or scan the contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches.

[0381] Additionally, while User A is using the app, the emotion engine reads the user's facial expressions and detects that the user is feeling stressed. The server uses this information to suggest a subscription to a "meditation app" that can help the user relax. User A can accept this suggestion and enjoy customized suggestions based on their emotional state.

[0382] In this way, we will create a system that streamlines user subscription management and provides optimal emotional suggestions, enriching users' lives.

[0383] The processing flow will be explained below.

[0384] User Registration and Login

[0385] Step 1:

[0386] The user accesses the application or website and enters the required information (name, email address, password) on the new registration screen.

[0387] Step 2:

[0388] The device sends the entered information to the server, where the password is hashed to ensure security.

[0389] Step 3:

[0390] The server validates the received information and if validation is successful, saves the user information in the database.

[0391] Step 4:

[0392] The server generates a successful registration response and sends it to the device. The user opens the authentication email sent to them and clicks the authentication link to activate their account.

[0393] Step 5:

[0394] The user accesses the login screen again with the activated account and logs in by entering their email address and password.

[0395] Step 6:

[0396] The terminal transmits the entered login information to the server.

[0397] Step 7:

[0398] The server validates the login information and confirms that the user exists. If successful, it creates a session and sends a success response back to the terminal.

[0399] Manage your subscription information

[0400] Step 1:

[0401] The user enters subscription information (service name, provider, contract period, cost, etc.) on the app's subscription addition screen.

[0402] Step 2:

[0403] The terminal transmits the entered subscription information to the server.

[0404] Step 3:

[0405] The server stores the received information in a database, and if the storage is successful, returns a confirmation response to the terminal.

[0406] Automatically retrieve subscription information

[0407] Step 1:

[0408] Users can take a photo of a paper contract or receipt using the app's scanning function.

[0409] Step 2:

[0410] The device sends the captured image to an OCR engine to extract the text data.

[0411] Step 3:

[0412] The server analyzes the character data received from the OCR engine and identifies the subscription information.

[0413] Step 4:

[0414] The server stores the identified subscription information in a database and sends a confirmation to the user.

[0415] Contract Renewal Reminders

[0416] Step 1:

[0417] The server periodically checks the contract renewal date of the subscription information in the database.

[0418] Step 2:

[0419] The server generates reminders when contract renewal dates approach.

[0420] Step 3:

[0421] The terminal receives the reminder notification from the server and displays the notification to the user.

[0422] Family sharing

[0423] Step 1:

[0424] Users register their family members' accounts in the app and set up sharing of subscription information.

[0425] Step 2:

[0426] The terminal transmits the setting information to the server.

[0427] Step 3:

[0428] The server stores the received sharing settings in a database and sends a notification to the family members with whom the sharing is intended.

[0429] Step 4:

[0430] Users (family members) can view and manage shared subscription information on their own dashboard.

[0431] Usage analysis and optimization suggestions

[0432] Step 1:

[0433] The server collects users' subscription usage data and analyzes their usage frequency and spending patterns.

[0434] Step 2:

[0435] The server generates optimal subscription plans and savings advice based on the analysis results.

[0436] Step 3:

[0437] The terminal notifies the user of the optimization proposal received from the server, and the user can check the proposal and take necessary actions.

[0438] Emotion Engine

[0439] Step 1:

[0440] When a user uses the app, the device uses an emotion engine to analyze the user's facial expressions and tone of voice to collect emotional data. The emotion engine works via the camera and microphone.

[0441] Step 2:

[0442] The device then formats the collected emotion data appropriately and sends it to the server. The emotion data is encrypted to protect the user's privacy.

[0443] Step 3:

[0444] The server analyzes the received emotion data and identifies the user's emotional state, which can be classified as joy, sadness, stress, excitement, etc.

[0445] Step 4:

[0446] The server takes emotional data into account to tailor subscription suggestions and notifications, for example generating suggestions for relaxing entertainment services if the user is feeling stressed.

[0447] Step 5:

[0448] The device displays suggestions and notifications tailored by the emotion engine to the user, who can then review the suggestions and accept them if necessary.

[0449] Specific examples

[0450] For example, suppose User B uses a "music streaming service" and an "online fitness service." User B can enter their subscription information into the app or scan their contract to automatically obtain the information. The server then centrally manages this information and sends reminders when the renewal date approaches.

[0451] Additionally, while User B is using the app, the emotion engine reads the user's facial expressions and detects "stress." Based on this information, the server suggests subscribing to a "meditation app" to help them relax. This suggestion is displayed on User B's device, and User B may be able to confirm the suggestion and accept it if necessary.

[0452] In this way, the system streamlines users' subscription management and provides optimal emotional recommendations, enriching their lives.

[0453] Example 2

[0454] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0455] Conventional subscription management systems have the drawbacks of making it difficult to manage individual subscription information and sharing information among family members. Furthermore, there is a high risk of forgetting subscription renewal dates and incurring duplicate payments. Furthermore, proposals do not take into account the user's lifestyle or emotional state, making it difficult to select the optimal subscription for the user.

[0456] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0457] In this invention, the server includes means for inputting user information provided by the user, means for centrally managing subscription information, means for monitoring the update date of the subscription information and generating reminders, means for sharing the subscription information among family members, means for analyzing usage status and providing optimal subscription suggestions, means for understanding the emotional state of the user by analyzing facial expressions and tone of voice, and means for adjusting suggestions and notifications based on the emotional state. This enables centralized management of subscription information, update date reminders, information sharing among family members, optimal suggestions based on the analysis of usage status, and subscription suggestions based on the emotional state.

[0458] "User Information" means personal information provided by a User, such as name, email address, and password.

[0459] "Subscription information" is detailed information such as the name of the service to which the user has subscribed, the provider, the contract period, and the cost.

[0460] "Centrally managing" means integrating and managing multiple subscription information in a single system or interface.

[0461] "Monitoring renewal dates" means that the system periodically checks the renewal date of your subscription contract and notifies you a specific period in advance.

[0462] "Reminder" is a notification function that notifies users of important information or tasks in advance.

[0463] "Sharing information" means allowing family members and related parties to see each other's subscription information.

[0464] "Analyzing usage" means analyzing data on the frequency and patterns of users' subscription usage.

[0465] "Optimal subscription proposals" refers to providing users with the most suitable subscription plans and savings advice based on the analysis results.

[0466] "Analyzing facial expressions and tone of voice" refers to identifying the emotional state of a user by analyzing the movement of the user's facial muscles and the tone of their voice.

[0467] An "emotional state" refers to the emotions or moods that a user is currently experiencing.

[0468] "Adjust" means to change the content or method of a proposal or notification to suit specific conditions or circumstances.

[0469] This invention relates to a system that centrally manages subscription information provided by users, shares it among family members, and combines it with an emotion engine that recognizes the user's emotions. This system not only has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions, but also uses the emotion engine to make suggestions and notifications based on the user's emotions.

[0470] Hardware and software used

[0471] Terminal: A device used for input and display, such as a smartphone, tablet, or computer.

[0472] Server: A central management system that manages the database, analyzes data, generates reminders, and analyzes sentiment data.

[0473] OCR software: Optical character recognition software is used to extract text data from paper contracts and receipts.

[0474] Emotion engine: Software containing machine learning models for analyzing a user's facial expressions and tone of voice.

[0475] Encryption Algorithm: A cryptographic technique used to securely transmit a user's personal information.

[0476] System Overview

[0477] User Registration and Login

[0478] A user accesses an application or website and creates a new account by entering the required personal information, which is then encrypted on the device and sent to the server.

[0479] The server stores the received user information in a database and performs account activation procedures. Using the activated account, the user can access the system from the login screen.

[0480] Manage your subscription information

[0481] The user inputs the subscription information he or she has signed up for and transmits it to the server via the terminal.

[0482] The server stores the transmitted information in a database and generates and provides a dashboard for centralized management.

[0483] Automatically retrieve subscription information

[0484] Users take a photo of a paper contract or receipt with their smartphone and send the image to OCR software to extract the text data.

[0485] The extracted text data is sent from the device to the server, where it is analyzed and stored in a database. It is then notified so that it can be viewed on the device.

[0486] Contract Renewal Reminders

[0487] The server periodically checks the subscription information in the database and generates reminders when contract renewals are due.

[0488] The reminder is sent to the device and the user is notified.

[0489] Family sharing

[0490] Users register their family members in the system and set up subscription sharing, which is then sent from the device to the server and stored in a database.

[0491] Users (family members) can check shared subscription information and prevent duplicate spending.

[0492] Usage analysis and optimization suggestions

[0493] The server collects and analyzes subscription usage data to generate optimal plans and savings advice for users.

[0494] The terminal notifies the user of the optimization proposal.

[0495] Emotion Engine

[0496] The emotion engine analyzes the user's facial expressions and tone of voice to collect emotional data.

[0497] Emotional data is sent from the device to a server, where it is stored and analyzed with the user's consent.

[0498] The server then tailors suggestions and notifications based on the user's emotional state and sends them to the device. For example, if the user is feeling stressed, the server suggests services that can help them relax.

[0499] Specific examples

[0500] For example, suppose User A uses a "weekly magazine subscription" and a "music streaming service." User A can enter this service information into the app or scan a contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches. Additionally, while using the app, the emotion engine analyzes the user's facial expressions and detects stress. Based on this information, the server suggests a subscription to a "meditation app" to help them relax.

[0501] Prompt Sentence Examples

[0502] You are developing a system that manages user subscriptions and makes suggestions based on an emotional engine. The system provides a dashboard for users to register and manage various services. It also makes optimal service suggestions based on the user's emotional state. For example, if a user has a weekly magazine subscription and a music streaming service, the system will send renewal reminders and make new suggestions based on the user's emotional state. Please explain the specific process steps.

[0503] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0504] Step 1: User Registration

[0505] A user visits a website or application, enters personal information such as name, email address, password, etc. Once completed, the user clicks the submit button.

[0506] Input: User information (name, email address, password)

[0507] The terminal encrypts the input information and transmits it to the server.

[0508] The server stores the received information in a database and returns a response indicating that registration is complete to the terminal.

[0509] Output: Account registration completion notification

[0510] Step 2: Activate your account

[0511] The user checks the verification email sent to them and clicks on the account activation link.

[0512] Input: Click the link in the verification email

[0513] The server updates the account status to "activated."

[0514] Output: Activation status update notification

[0515] Step 3: Log in

[0516] The user logs in by entering the registered email address and password.

[0517] Input: Email address, password

[0518] The server checks the entered information against a database and redirects the user to the dashboard if authentication is successful.

[0519] Output: Dashboard access permissions

[0520] Step 4: Enter your subscription information

[0521] The user enters their subscription details, including the service name, provider, contract period, cost, etc.

[0522] Input: Subscription information (service name, provider, contract period, cost)

[0523] The terminal transmits the entered subscription information to the server.

[0524] The server stores the received information in a database and updates the dashboard.

[0525] Output: Updated dashboard

[0526] Step 5: Automatically retrieve subscription information

[0527] The user takes a photo of a paper contract or receipt using their smartphone camera.

[0528] Input: Image of contract or receipt

[0529] The device sends the captured image to OCR software, which extracts the text data.

[0530] Output: Extracted character data

[0531] The terminal transmits the extracted character data to the server.

[0532] The server analyzes the character data and stores it in a database as subscription information.

[0533] Output: Parsed subscription information

[0534] Step 6: Generate renewal reminders

[0535] The server periodically checks the subscription information in the database to detect information whose contract renewal date is approaching.

[0536] Input: Subscription information in the database

[0537] Output: Information that needs to be updated

[0538] The server generates a reminder based on the information that needs to be updated and sends it to the device.

[0539] The terminal displays a reminder notification to the user.

[0540] Output: Reminder notification

[0541] Step 7: Set up Family Sharing

[0542] Users enter information about their family members into the system and set up sharing of subscription information.

[0543] Input: Family member information, sharing settings

[0544] The terminal transmits the sharing setting information to the server.

[0545] The server stores the received shared setting information in a database.

[0546] Family members can view shared subscription information on their dashboard.

[0547] Output: Shared dashboard

[0548] Step 8: Usage analysis and optimization recommendations

[0549] The server collects subscription usage data and analyzes usage frequency and patterns.

[0550] Input: Subscription usage data

[0551] Output: Usage analysis results

[0552] The server generates optimal subscription plans and savings advice based on the analysis results and sends them to the device.

[0553] The terminal notifies the user of the optimization proposal.

[0554] Output: Optimization suggestion notification

[0555] Step 9: Leverage your emotional engine

[0556] While the user is using the app, the emotion engine analyzes facial expressions and tone of voice via the camera and microphone.

[0557] Input: facial expression data, tone of voice data

[0558] The terminal transmits the analyzed emotion data to the server.

[0559] The server analyzes the emotional data and understands the user's emotional state.

[0560] Output: Emotional state analysis results

[0561] The server tailors suggestions and notifications based on the emotional state and sends them to the device.

[0562] The device will display suggestions and notifications to the user based on their emotions, for example, suggesting services that will help them relax if they are feeling stressed.

[0563] Output: Adjusted proposal notification

[0564] (Application example 2)

[0565] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0566] Currently, many users use multiple subscription services, but are unable to efficiently manage their contract information, leading to problems such as missed renewal deadlines and duplicate contracts. Furthermore, the lack of a system that suggests optimal content based on a user's emotions and usage status makes it difficult to increase user satisfaction. Our goal is to solve these problems by enabling users to efficiently manage their subscriptions and enjoy optimal content tailored to their individual emotional state.

[0567] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0568] In this invention, the server includes a means for inputting subscription information provided by the user, a means for centrally managing the subscription information, a means for monitoring the renewal date of the subscription information and generating reminders, a means for sharing the subscription information among family members, a means for analyzing usage status and providing optimal subscription suggestions, and a means for analyzing the user's emotions and suggesting content based on the emotions. This allows the user to centrally manage subscriptions, not miss renewal deadlines, and share information among family members to avoid duplicate spending. Furthermore, by suggesting optimal content based on the user's emotional state, user satisfaction can be increased.

[0569] "Subscription information" indicates information about multiple services to which a user has subscribed, and includes details such as the service name, provider, contract period, and cost.

[0570] The "means for inputting" refers to a means by which a user registers subscription information in the system, and allows data input by keyboard input, voice input, or scanning.

[0571] "Means for centralized management" refers to means for centrally managing multiple subscription information using a single interface.

[0572] The "means for monitoring the renewal date and generating a reminder" is a means for periodically checking the contract renewal date of the subscription information and notifying the user when the expiration date approaches.

[0573] "Means for sharing among family members" refers to a means for sharing a user's subscription information among family members to avoid overlapping contracts.

[0574] "Means for analyzing usage and providing optimal subscription proposals" refers to means for collecting and analyzing users' subscription usage data and proposing optimal subscription plans based on the results.

[0575] The "means for analyzing emotions" is a means for acquiring emotional data from the user's facial expressions and voice and analyzing the emotional state.

[0576] The "means for suggesting content based on emotions" is a means for suggesting optimal subscription content (e.g., relaxing music or a meditation app) in response to the analyzed emotional state of the user.

[0577] The system for realizing this invention is composed of the following main components: A server, a user terminal, and an emotion engine work closely together to efficiently manage user subscription information and propose optimal content according to the user's emotional state.

[0578] Server Configuration

[0579] 1. The server receives subscription information input data provided by users and maintains a database for centralized management. It also has a function to monitor contract renewal dates and generate reminders when the renewal deadline approaches. This allows users to manage their subscriptions without forgetting to renew them.

[0580] 2. The server also has a management function for sharing user subscription information among family members. The family sharing function helps to avoid duplicate contracts and enables efficient management of household finances.

[0581] 3. The server also has the function of collecting users' subscription usage data and analyzing their usage patterns to propose the optimal subscription plan. This proposal is based on data such as usage frequency and cost performance, allowing users to enjoy maximum benefits.

[0582] User terminal configuration

[0583] 1. The user device (e.g., a smartphone) serves as an interface for the user to enter subscription information. The subscription information is sent from the device to a server and stored in a database. If the user uses a paper contract, character recognition software (e.g., OCR technology) is used to extract the data and automatically register the subscription information.

[0584] 2. The user device receives reminders and offers generated by the server and notifies the user, including contract renewal reminders and optimal subscription offers.

[0585] 3. The user device works in conjunction with the emotion engine to analyze the user's facial expressions and tone of voice to collect emotional data. The collected emotional data is sent to the server, which then suggests content based on the emotion analysis.

[0586] Emotion engine configuration

[0587] 1. The emotion engine analyzes the user's facial expressions and voice data to identify the user's emotional state. This analysis uses image processing and voice analysis technologies. The emotion engine can identify various emotional states, such as whether the user is stressed, relaxed, or enjoying themselves.

[0588] 2. The emotion engine connects with the user's device and sends the analysis results to the server, which uses this data to suggest optimal subscription content based on the user's emotional state.

[0589] Specific examples

[0590] For example, if a user feels like relaxing, the emotion engine analyzes the user's emotional state, and the server suggests optimal relaxation content (such as a music playlist or a meditation app). Also, if the user's subscription is nearing its renewal deadline, a server-generated reminder is sent to the user's device.

[0591] Example prompts for generative AI models

[0592] "If a user is feeling stressed, suggest subscription content that will help them relax. Suggestions could include a relaxing music playlist or a meditation app. Also, if a subscription is due for renewal soon, display a reminder."

[0593] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0594] Step 1:

[0595] User Registration and Login

[0596] What happens: A user creates an account by entering their name, email address, and password.

[0597] Input: The user enters their name, email address, and password.

[0598] Output: User information is saved on the server and an account verification email is sent.

[0599] Specific operation: When a user enters data into the form and presses the "Register" button, the data is encrypted and sent to the server, which stores it in a database and issues a verification email.

[0600] Step 2:

[0601] Entering subscription information and registration

[0602] Process: The user enters their subscription information through the application.

[0603] Input: Subscription information such as service name, provider, contract duration, and cost.

[0604] Output: The server stores this information in a database and displays it on a dashboard.

[0605] How it works: When a user enters information and presses the "Register" button, the data is sent to the server and stored in a database. The server retrieves this information and displays it on the user's dashboard.

[0606] Step 3:

[0607] Scanning paper contracts and character recognition

[0608] What it does: The user scans a paper contract or receipt and extracts the text data.

[0609] Input: scanned image data.

[0610] Output: Character recognition software extracts the character data and sends it to the server as subscription information.

[0611] Specific operation: When a user uses the scan function within the app and takes a picture of a contract with their camera, the image is processed by an OCR engine (such as Tesseract) and the extracted text data is sent to the server.

[0612] Step 4:

[0613] Contract renewal reminder generation and notification

[0614] What happens: The server periodically checks the contract renewal date and generates a reminder.

[0615] Input: Contract expiration date stored in the database.

[0616] Output: When the renewal date approaches, a reminder notification will be sent to the user's device.

[0617] How it works: The server periodically checks the date and generates reminders for subscriptions that are approaching their expiration date. The reminder information is then sent to the user's device via push notification.

[0618] Step 5:

[0619] Sharing subscription information between family members

[0620] What it does: Set up sharing of subscription information between family members.

[0621] Input: Family member's account information.

[0622] Output: The shared subscription information will be displayed on other family members' dashboards.

[0623] Specific operation: When a user enters the information of family members into the system and the server stores the information in the database, the sharing setup is complete. Family members can view the shared information on their dashboard.

[0624] Step 6:

[0625] Analysis of usage status and optimization proposals

[0626] What it does: The server collects user subscription usage data and analyzes usage frequency and patterns.

[0627] Input: Subscription usage data.

[0628] Output: Best subscription plans and savings advice.

[0629] Specific operation: The server analyzes the collected data, identifies the user's usage patterns, and generates optimal suggestions. The contents of the suggestions are sent to the user's device as a notification.

[0630] Step 7:

[0631] User emotion analysis and emotion-based suggestions

[0632] Processing content: The user device uses the emotion engine to analyze the user's emotions.

[0633] Input: Emotional data such as the user's facial expressions and tone of voice.

[0634] Output: Content suggestions based on emotional state.

[0635] Specific operation: The user's device captures the user's facial expressions and voice, and analyzes them using the emotion engine. The analysis results are sent to the server, which then suggests content appropriate to the user's emotional state (such as a relaxing music playlist).

[0636] Example prompts for generative AI models

[0637] "If a user is feeling stressed, suggest subscription content that will help them relax. Suggestions could include a relaxing music playlist or a meditation app. Also, if a subscription is due for renewal soon, display a reminder."

[0638] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0639] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0640] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0641] [Second embodiment]

[0642] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0643] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0644] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0645] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0646] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0647] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0648] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0649] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0650] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0651] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0652] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0653] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0654] This invention relates to a system that centrally manages subscription information provided by users and enables it to be shared among family members. This system has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions.

[0655] System Overview

[0656] User Registration and Login

[0657] A user first accesses an application or website and creates a new account by entering required information such as name, email address, and password. The information entered by the user is encrypted for security purposes and sent from the device to the server.

[0658] The server saves the received information in a database and returns a response indicating that the information was saved successfully to the terminal. The user then checks the authentication email sent at this time and clicks on the link to activate the account.

[0659] The user accesses the login screen with an activated account and logs in by entering their email address and password. Authentication is performed on the server, and if successful, the user can access the dashboard.

[0660] Manage your subscription information

[0661] Users can input various subscription information (service name, provider, contract period, cost, etc.) that they have signed up for. This information is sent to the server via the terminal and stored in a database.

[0662] Based on the entered subscription information, the server generates an interface for centralized management on the dashboard and provides it to the user.

[0663] Automatically retrieve subscription information

[0664] Users can take a photo of a paper contract or receipt using the app's scanning function, and the image is sent to character recognition software (OCR) by the device, where text data is extracted.

[0665] The server analyzes the extracted character data and stores it in the database as appropriate subscription information. After storing it, it sends a confirmation notice to the user so that the user can confirm it.

[0666] Contract Renewal Reminders

[0667] The server monitors the contract renewal date in the database and generates a reminder a pre-set period before the contract renewal date, thereby notifying the user before the contract renewal date.

[0668] The device will receive the reminder and display a notification to the user, so that the user does not miss the timing of automatic renewal or contract renewal.

[0669] Family sharing

[0670] Users register their family members' accounts in the system and set up specific subscription sharing settings, which are then sent from the device to the server and stored in a database.

[0671] Users (family members) can view shared subscription information on their own dashboard, which helps prevent duplicate spending between family members.

[0672] Usage analysis and optimization suggestions

[0673] The server collects subscription usage data from users and analyzes their usage frequency and patterns, based on which it generates optimal subscription plans and savings advice for users.

[0674] The terminal receives optimization suggestions from the server and notifies the user, who can then review the suggestions and take necessary actions.

[0675] Specific examples

[0676] For example, suppose User A uses a "regular food delivery service" and a "video streaming service." User A can enter the service information into the app or scan the contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches.

[0677] Furthermore, when User A registers and shares information about his family members, it becomes clear that Family B has a duplicate subscription to the same "video streaming service." The system then presents User A with optimization suggestions to avoid this duplicate subscription, allowing User A to adjust the subscription details with Family B accordingly.

[0678] This allows User A and his family to use the subscription service more efficiently and economically.

[0679] The processing flow will be explained below.

[0680] User Registration and Login

[0681] Step 1:

[0682] The user accesses the application or website and enters the required information (name, email address, password) on the new registration screen.

[0683] Step 2:

[0684] The device sends the entered information to the server, where the user's password is hashed in a secure manner.

[0685] Step 3:

[0686] The server validates the received information to ensure its validity, and if validation is successful, stores the user information in the database.

[0687] Step 4:

[0688] The server generates a successful registration response and sends it to the device. The user opens the authentication email sent to them and clicks the authentication link to activate their account.

[0689] Step 5:

[0690] The user accesses the login screen again with the activated account and logs in by entering their email address and password.

[0691] Step 6:

[0692] The terminal transmits the entered login information to the server.

[0693] Step 7:

[0694] The server validates the login information and confirms that the user exists. If successful, it creates a session and sends a success response back to the terminal.

[0695] Manage your subscription information

[0696] Step 1:

[0697] The user enters subscription information (service name, provider, contract period, cost, etc.) on the app's subscription addition screen.

[0698] Step 2:

[0699] The terminal transmits the entered subscription information to the server.

[0700] Step 3:

[0701] The server stores the received information in a database, and if the storage is successful, returns a confirmation response to the terminal.

[0702] Automatically retrieve subscription information

[0703] Step 1:

[0704] Users can take a photo of a paper contract or receipt using the app's scanning function.

[0705] Step 2:

[0706] The device sends the captured image to an OCR engine and extracts the text data.

[0707] Step 3:

[0708] The server analyzes the character data received from the OCR engine and identifies the subscription information.

[0709] Step 4:

[0710] The server stores the identified subscription information in a database and sends a confirmation to the user.

[0711] Contract Renewal Reminders

[0712] Step 1:

[0713] The server periodically checks the contract renewal date of the subscription information in the database.

[0714] Step 2:

[0715] The server generates reminders when contract renewal dates approach.

[0716] Step 3:

[0717] The terminal receives the reminder notification from the server and displays the notification to the user.

[0718] Family sharing

[0719] Step 1:

[0720] Users register their family members' accounts in the app and set up sharing of subscription information.

[0721] Step 2:

[0722] The terminal transmits the setting information to the server.

[0723] Step 3:

[0724] The server stores the received sharing settings in a database and sends a notification to the family members with whom the sharing is intended.

[0725] Step 4:

[0726] Users (family members) can view and manage shared subscription information on their own dashboard.

[0727] Usage analysis and optimization suggestions

[0728] Step 1:

[0729] The server collects users' subscription usage data and analyzes their usage frequency and spending patterns.

[0730] Step 2:

[0731] The server generates optimal subscription plans and savings advice based on the analysis results.

[0732] Step 3:

[0733] The terminal notifies the user of the optimization proposal received from the server, and the user can check the proposal and take necessary actions.

[0734] In this way, specific operations are performed at each step, allowing the user to manage subscription information efficiently and optimally.

[0735] Example 1

[0736] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0737] With conventional subscription management systems, each user had to manage their contract information individually, making it difficult to keep track of contract renewal dates and share information among family members. It was also difficult to digitally acquire and properly manage information from paper contracts and receipts, making it difficult to analyze usage patterns and propose optimal subscription plans. Furthermore, the security and centralized data management required to solve these problems were not adequately considered.

[0738] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0739] In this invention, the server includes means for having a user enter registration information and encrypting it for security before transmitting it to the server, means for the server to store the received information in a database, send an authentication email, and have the user activate their account, means for the server to authenticate the user's account and, if successful, allow the user to access the dashboard, means for centrally managing subscription information, means for monitoring the update date of the subscription information and generating reminders, means for sharing the subscription information among family members, means for analyzing usage patterns and providing optimal subscription proposals, means for scanning paper contracts and receipts and extracting text data, and means for analyzing the extracted text data and identifying subscription information. This allows users to centrally manage contract information, avoid duplicate spending among family members, and receive optimal subscription proposals.

[0740] "User" refers to an individual or entity that uses the System to register, manage, and share subscription information.

[0741] "Subscription information" is information related to the subscription service to which the user has subscribed, and includes details such as the service name, provider, contract period, and cost.

[0742] "Server" refers to a computer resource that receives information sent from users, stores it in a database, manages it, and analyzes it.

[0743] "Terminal" refers to a device, such as a computer or smartphone, that a user uses to access the system.

[0744] "Database" means a collection of information for securely storing and managing user and subscription information.

[0745] "Encryption" refers to the process of transforming data using a specific algorithm to protect the contents of the information from third parties.

[0746] "Verification Email" means an email sent to a user to validate their account registration, which includes an authentication link.

[0747] "Reminder" refers to a message from the system that notifies users in advance of important deadlines, such as contract renewal dates.

[0748] "OCR" stands for Optical Character Recognition, a technology that reads characters from images or scanned documents and converts them into digital data.

[0749] "Dashboard" means a web or application interface that allows a User to manage and view their subscription information at a glance.

[0750] "Duplicate spending" refers to wasteful spending resulting from multiple contracts for the same subscription service within a household.

[0751] "Usage analysis" refers to the process of analyzing usage trends and patterns based on user subscription service usage data.

[0752] "Optimal subscription proposal" refers to recommending the most effective and economical subscription plan to a user based on an analysis of usage.

[0753] This invention provides a system that centrally manages subscription information provided by users and allows it to be shared among family members. This system has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions. A specific embodiment of this system is described below.

[0754] User Registration and Login

[0755] A user accesses an application or website and creates a new account by entering the required information, such as name, email address, and password. The information entered by the user is encrypted using RSA encryption technology for security purposes and sent from the device to the server.

[0756] The server saves the received information in a database (e.g., MySQL) and returns a response indicating that the information was saved successfully to the terminal. The user checks the authentication email sent at this time and clicks on the link to activate the account.

[0757] With an activated account, the user accesses the login screen and enters their email address and password to log in. Authentication is performed by the server, and if successful, the user is given access to the dashboard.

[0758] Manage your subscription information

[0759] The user inputs the various subscription information (service name, provider, contract period, cost, etc.) that they have signed up for. This information is sent to the server via the terminal and stored in a database.

[0760] Based on the entered subscription information, the server generates an interface for centralized management on the dashboard and provides it to the user.

[0761] Automatically retrieve subscription information

[0762] Users can take a photo of a paper contract or receipt using the app's scanning function, and the captured image is sent to character recognition software (OCR, e.g., Tesseract OCR library) by the device, where text data is extracted.

[0763] The server analyzes the extracted character data and stores it in the database as appropriate subscription information. After storing it, it sends a confirmation notice to the user so that the user can confirm it.

[0764] Contract Renewal Reminders

[0765] The server monitors the contract renewal date in the database and generates a reminder a pre-set period before the contract renewal date, thereby notifying the user before the contract renewal date.

[0766] The device will receive the reminder and display a notification to the user, so that the user does not miss the timing of automatic renewal or contract renewal.

[0767] Family sharing

[0768] Users register their family members' accounts in the system and set up specific subscription sharing settings, which are then sent from the device to the server and stored in a database.

[0769] Users (family members) can view shared subscription information on their own dashboard, which helps prevent duplicate spending between family members.

[0770] Usage analysis and optimization suggestions

[0771] The server collects subscription usage data from users and analyzes their usage frequency and patterns, based on which it generates optimal subscription plans and savings advice for users.

[0772] The terminal receives optimization suggestions from the server and notifies the user, who can then review the suggestions and take necessary actions.

[0773] Specific examples

[0774] For example, suppose User A uses a "regular food delivery service" and a "video streaming service." User A can enter the service information into the app or scan the contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches.

[0775] Furthermore, when User A registers and shares information about his family members, it becomes clear that Family B has a duplicate subscription to the same "video streaming service." The system then presents User A with optimization suggestions to avoid this duplicate subscription, allowing User A to adjust the subscription details with Family B accordingly.

[0776] This allows User A and his family to use the subscription service more efficiently and economically.

[0777] Example prompts for generative AI models

[0778] "Please create a program that allows users to register and manage subscription information and share it with their family members. Please include a function that allows users to enter or scan information about the services they subscribe to, a function that generates and notifies them of subscription renewal reminders, a function that allows information to be shared among family members, and a function that analyzes usage and makes optimization suggestions."

[0779] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0780] Step 1:

[0781] To create a new account, a user enters their name, email address, and password and submits the data to the server.

[0782] Input: Name, Email Address, Password

[0783] Processing: The terminal encrypts the entered information using RSA encryption technology and sends it to the server.

[0784] Output: Encrypted user information

[0785] Step 2:

[0786] The server stores the encrypted user information it receives in a database.

[0787] Input: Encrypted user information

[0788] Processing: The server saves the user information in a database (e.g. MySQL) and sends a verification email to the user.

[0789] Output: Verification email

[0790] Step 3:

[0791] The user clicks the link in the verification email to activate their account.

[0792] Input:Authentication link

[0793] Processing: The server receives the link and updates the user account to an activated status.

[0794] Output: Activated accounts

[0795] Step 4:

[0796] The user enters their email address and password on the login screen and sends them to the server.

[0797] Input: Email address, password

[0798] Processing: The server performs authentication and, if successful, displays the dashboard to the user.

[0799] Output: Dashboard access

[0800] Step 5:

[0801] The user enters subscription information (service name, provider, contract period, cost) and sends it to the server.

[0802] Input: Subscription information

[0803] Processing: The terminal inputs information and sends it to the server, which stores the received information in a database.

[0804] Output: Saved subscription information

[0805] Step 6:

[0806] The server generates the dashboard interface and provides it to the user.

[0807] Input: Saved subscription information

[0808] Processing: The server retrieves information from the database and generates the dashboard interface.

[0809] Output: Dashboard interface

[0810] Step 7:

[0811] The user takes a photo of a paper contract or receipt using the app's scanning function and sends it to the device.

[0812] Input: A photograph of a contract or receipt

[0813] Processing: The device extracts character data using OCR (Optical Character Recognition) technology.

[0814] Output: Extracted character data

[0815] Step 8:

[0816] The terminal transmits the extracted character data to the server, which analyzes it to identify subscription information.

[0817] Input: Extracted character data

[0818] Processing: The server parses the character data, recognizes it as subscription information, and stores it in the database.

[0819] Output: Identified subscription information

[0820] Step 9:

[0821] The server monitors the database for renewal dates and generates reminders as needed.

[0822] Input: Database contract information

[0823] Processing: The server periodically checks the contract renewal date and generates a reminder notification when the renewal date approaches.

[0824] Output: Reminder notification

[0825] Step 10:

[0826] The device receives the reminder notification and displays the notification to the user.

[0827] Input: Reminder

[0828] Processing: The device displays a notification to the user, who checks the notification and takes the necessary action.

[0829] Output: The notification displayed to the user

[0830] Step 11:

[0831] The user registers family member accounts in the system and sets up subscription information sharing among family members.

[0832] Input: Family member information, shared subscription information

[0833] Processing: The device sends the information to the server, which stores it in a database.

[0834] Output: Shared subscription information

[0835] Step 12:

[0836] Family members can view the shared subscription information on their dashboard.

[0837] Input: Shared subscription information

[0838] Processing: The server retrieves information from the database and reflects it on the family member's dashboard.

[0839] Output: Shared information displayed on family member's dashboard

[0840] Step 13:

[0841] The server collects user subscription usage data and analyzes usage frequency and patterns.

[0842] Input: Subscription usage data

[0843] Processing: The server analyzes the data to identify usage patterns and frequencies.

[0844] Output: Analysis results

[0845] Step 14:

[0846] The server generates optimal subscription plans and savings advice based on the analysis results.

[0847] Input: Analysis results

[0848] Processing: The server generates the optimal plan or advice for the user.

[0849] Output: Optimization suggestions

[0850] Step 15:

[0851] The terminal receives the optimization proposal and notifies the user.

[0852] Input: Optimization proposal

[0853] Processing: The terminal notifies the user of the proposal so that the user can confirm it.

[0854] Output: The suggestion sent to the user

[0855] (Application example 1)

[0856] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0857] Conventional subscription management systems make it difficult to centrally manage information about various subscriptions subscribed to by users, and lack reminder functions and functions for sharing information among family members, which leads to problems such as duplicate contracts and wasteful spending. Furthermore, updating and managing contract information is particularly cumbersome for services used daily, such as food delivery services, and efficient management is required.

[0858] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0859] In this invention, the server includes: a means for inputting subscription information provided by the user; a means for centrally managing the subscription information; a means for monitoring the renewal date of the subscription information and generating reminders; a means for sharing the subscription information among family members; a means for analyzing usage and providing optimal subscription proposals; a means for registering and managing subscription information for food delivery services; a means for the user to scan a paper contract and extract text data using OCR; a means for identifying the extracted text data as subscription information; and a means for notifying a smart device of a reminder when the contract renewal date approaches. This allows users to centrally manage the various subscription information they have subscribed to, receive reminders when the renewal date approaches, and avoid duplicate subscriptions by sharing information among family members. Furthermore, analyzing usage and receiving optimal subscription proposals allows users to use services efficiently and economically.

[0860] "User" means a user of the system who registers, manages, and shares subscription information and receives reminders and suggestions.

[0861] "Subscription information" is information about various services to which a user has subscribed, and includes the service name, provider, contract period, cost, etc.

[0862] "Centralized management" means that multiple subscription information is managed uniformly on one system.

[0863] "Reminder" is a function that notifies users when their subscription renewal date is approaching.

[0864] "Family information sharing" is a feature that allows family members who use the same system to view and share each other's subscription information.

[0865] "Usage analysis" means analyzing usage data of subscription services for which a user has signed up to evaluate frequency and patterns of use.

[0866] "Optimal subscription proposals" are proposals that present the most appropriate and economical subscription plans and saving methods for users based on an analysis of usage.

[0867] A "food delivery service" is a service that delivers ingredients and meals ordered online to a specified location.

[0868] "OCR" is an abbreviation for optical character recognition, a technology that extracts character information from image data.

[0869] "Smart devices" refer to intelligent devices with internet connectivity, such as smartphones, smart glasses, and head-mounted displays.

[0870] The system for implementing this invention is designed to enable users to efficiently use food delivery services by registering, managing, and sharing subscription information and providing reminders and optimal suggestions.

[0871] composition

[0872] The system consists of the following main components:

[0873] 1. Server

[0874] 2. Terminals (smartphones, smart glasses, other smart devices)

[0875] 3. OCR Software

[0876] 4. Database

[0877] 5. Notification System

[0878] User Registration and Login

[0879] First, the user creates a new account by entering necessary information such as name, email address, and password on the device.

[0880] The terminal sends the encrypted user information to the server, which stores it in a database.

[0881] The user checks the verification email sent to them and clicks the link to activate their account, after which they can log in.

[0882] Manage your subscription information

[0883] Enter the subscription information (service name, provider, contract period, cost, etc.) for the food delivery service to which the user has subscribed.

[0884] The terminal sends this information to the server, which stores it in a database.

[0885] Automatically retrieve subscription information

[0886] A user scans a paper contract with a smartphone app, and the scanned image is converted into text data by OCR software.

[0887] The server analyzes this character data and stores it in a database as subscription information.

[0888] Contract Renewal Reminders

[0889] The server monitors contract renewal dates in the database and generates reminders before a pre-set period.

[0890] The device will receive this reminder and display a notification to the user.

[0891] Family sharing

[0892] The user registers accounts for family members and sets up shared subscription information.

[0893] The server stores this setting information in a database, allowing information to be shared among family members.

[0894] Usage analysis and optimization suggestions

[0895] The server collects subscription usage data and analyzes usage patterns.

[0896] Based on the results of this analysis, the server generates and notifies the user of the optimal subscription plan and savings proposals.

[0897] Specific examples

[0898] For example, when a user scans a "Food Subscription" contract with a smartphone app, the information is read using OCR and automatically registered in the app. Then, when the contract renewal date approaches, a reminder notification pops up on the smart glasses.

[0899] Example prompts to input to a generative AI model

[0900] Prompt: How can I develop an application that scans my "food subscription" contract and notifies me when it's due for renewal?

[0901] This allows users to manage and use food delivery services efficiently and economically.

[0902] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0903] Step 1:

[0904] A user launches the smartphone app and creates a new account by entering required information such as name, email address, and password.

[0905] Input: Name, email address, and password entered by the user.

[0906] Data processing: The terminal encrypts the entered password for security purposes.

[0907] Output: Sends the encrypted password, name, and email address to the server.

[0908] Step 2:

[0909] The server stores the received user information in a database and returns a response to the terminal indicating that the information has been successfully stored.

[0910] Input: Encrypted password, name, and email address sent from your device.

[0911] Data processing: The server stores this information in a database.

[0912] Output: Returns a save completion response to the terminal.

[0913] Step 3:

[0914] The user checks the verification email sent to them and clicks on the link to activate their account.

[0915] Input: Click the link in the verification email.

[0916] Data processing: The server activates the user's account.

[0917] Output: Account activation notification.

[0918] Step 4:

[0919] Users log in with an activated account and enter their subscription information.

[0920] Input: Subscription information (service name, provider, contract period, cost, etc.).

[0921] Data processing: The device sends the entered information to the server.

[0922] Output: Submits subscription information to the server.

[0923] Step 5:

[0924] The server stores the submitted subscription information in a database and generates a dashboard based on it.

[0925] Input: Subscription information sent from the device.

[0926] Data processing: The server stores subscription information in a database and generates a dashboard.

[0927] Output: Sends the updated dashboard to the device.

[0928] Step 6:

[0929] The user scans the contract with a smartphone app, and the OCR software extracts the text data.

[0930] Input: Scanned contract image data.

[0931] Data processing: OCR software extracts text information from image data.

[0932] Output: The extracted character data is sent to the server.

[0933] Step 7:

[0934] The server analyzes the character data received from the OCR software and stores it in a database as subscription information.

[0935] Input: The extracted character data.

[0936] Data processing: The server parses the text data and formats it as subscription information.

[0937] Output: Formatted subscription information stored in the database.

[0938] Step 8:

[0939] The server monitors contract renewal dates in the database and generates reminders before a pre-set period.

[0940] Input: Subscription information in the database.

[0941] Data processing: The server checks the contract renewal date and generates a reminder.

[0942] Output: Send reminder notification to device.

[0943] Step 9:

[0944] The terminal receives the generated reminder and displays a notification to the user.

[0945] Input: Reminder notification sent from the server.

[0946] Data processing: The device displays reminder notifications.

[0947] Output: Notify the user of the reminder.

[0948] Step 10:

[0949] The user registers accounts for family members and sets up sharing of subscription information.

[0950] Input: Family member's account information.

[0951] Data processing: The device sends the share setting information to the server.

[0952] Output: Sends shared configuration information to the server.

[0953] Step 11:

[0954] The server stores the shared setting information in a database and shares the subscription information among family members.

[0955] Input: Shared configuration information.

[0956] Data processing: The server stores the shared setting information in a database and checks the integrity of the shared information.

[0957] Output: Sharing subscription information between family members.

[0958] Step 12:

[0959] The server collects subscription usage data, analyzes it, and generates optimal offers for users.

[0960] Input: Subscription usage data.

[0961] Data processing: The server analyzes usage patterns and generates optimal plans and savings proposals.

[0962] Output: Notify the device of the suggestion.

[0963] Step 13:

[0964] The terminal notifies the user of the optimization proposal received from the server, and the user confirms it.

[0965] Input: Optimization suggestions sent by the server.

[0966] Data processing: The device will display optimization suggestions.

[0967] Output: Notify user of optimization suggestions.

[0968] The above is the specific processing flow of the program of the system that realizes the application example.

[0969] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0970] This invention relates to a system that centrally manages subscription information provided by users, shares it among family members, and combines it with an emotion engine that recognizes the user's emotions. This system not only has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions, but also uses the emotion engine to make suggestions and notifications based on the user's emotions.

[0971] System Overview

[0972] User Registration and Login

[0973] A user accesses an application or website and creates a new account by entering required information such as name, email address, and password. The information entered by the user is encrypted for security purposes and sent from the device to the server.

[0974] The server saves the received information in its database and returns a response indicating successful saving to the terminal. The user checks the authentication email sent and clicks on the link to activate their account.

[0975] The user accesses the login screen with an activated account and logs in by entering their email address and password. Authentication is performed on the server, and if successful, the user can access the dashboard.

[0976] Manage your subscription information

[0977] Users can input various subscription information (service name, provider, contract period, cost, etc.) that they have signed up for. This information is sent to the server via the terminal and stored in a database.

[0978] Based on the entered subscription information, the server generates an interface for centralized management on the dashboard and provides it to the user.

[0979] Automatically retrieve subscription information

[0980] Users can take a photo of a paper contract or receipt using the app's scanning function, and the image is sent to character recognition software (OCR) by the device, where text data is extracted.

[0981] The server analyzes the extracted character data and stores it in the database as appropriate subscription information. After storing it, it sends a confirmation notice to the user so that the user can confirm it.

[0982] Contract Renewal Reminders

[0983] The server periodically checks the contract renewal date in the database and generates a reminder a pre-set period before the contract renewal date, thereby notifying the user before the contract renewal date.

[0984] The device will receive the reminder and display a notification to the user, so that the user does not miss the timing of automatic renewal or contract renewal.

[0985] Family sharing

[0986] Users register their family members' accounts in the system and set up specific subscription sharing settings, which are then sent from the device to the server and stored in a database.

[0987] Users (family members) can view shared subscription information on their own dashboard, which helps prevent duplicate spending between family members.

[0988] Usage analysis and optimization suggestions

[0989] The server collects subscription usage data from users and analyzes their usage frequency and patterns, based on which it generates optimal subscription plans and savings advice for users.

[0990] The terminal receives optimization suggestions from the server and notifies the user, who can then review the suggestions and take necessary actions.

[0991] Emotion Engine

[0992] When a user uses the app, the emotion engine analyzes the user's facial expressions and tone of voice to collect emotional data.

[0993] The device transmits emotion data to the server, which collects the emotion data with the user's consent.

[0994] The server analyzes the emotional data to understand the user's emotional state and uses this emotional data to tailor the content of subscription offers and notification methods.

[0995] The device displays subscription suggestions and notifications tailored to the user by the emotion engine, for example, suggesting relaxing entertainment services if the user is feeling stressed.

[0996] Specific examples

[0997] For example, suppose User A uses a "weekly magazine subscription" and a "music streaming service." User A can enter the service information into the app or scan the contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches.

[0998] Additionally, while User A is using the app, the emotion engine reads the user's facial expressions and detects that the user is feeling stressed. The server uses this information to suggest a subscription to a "meditation app" that can help the user relax. User A can accept this suggestion and enjoy customized suggestions based on their emotional state.

[0999] In this way, we will create a system that streamlines user subscription management and provides optimal emotional suggestions, enriching users' lives.

[1000] The processing flow will be explained below.

[1001] User Registration and Login

[1002] Step 1:

[1003] The user accesses the application or website and enters the required information (name, email address, password) on the new registration screen.

[1004] Step 2:

[1005] The device sends the entered information to the server, where the password is hashed to ensure security.

[1006] Step 3:

[1007] The server validates the received information and if validation is successful, saves the user information in the database.

[1008] Step 4:

[1009] The server generates a successful registration response and sends it to the device. The user opens the authentication email sent to them and clicks the authentication link to activate their account.

[1010] Step 5:

[1011] The user accesses the login screen again with the activated account and logs in by entering their email address and password.

[1012] Step 6:

[1013] The terminal transmits the entered login information to the server.

[1014] Step 7:

[1015] The server validates the login information and confirms that the user exists. If successful, it creates a session and sends a success response back to the terminal.

[1016] Manage your subscription information

[1017] Step 1:

[1018] The user enters subscription information (service name, provider, contract period, cost, etc.) on the app's subscription addition screen.

[1019] Step 2:

[1020] The terminal transmits the entered subscription information to the server.

[1021] Step 3:

[1022] The server stores the received information in a database, and if the storage is successful, returns a confirmation response to the terminal.

[1023] Automatically retrieve subscription information

[1024] Step 1:

[1025] Users can take a photo of a paper contract or receipt using the app's scanning function.

[1026] Step 2:

[1027] The device sends the captured image to an OCR engine to extract the text data.

[1028] Step 3:

[1029] The server analyzes the character data received from the OCR engine and identifies the subscription information.

[1030] Step 4:

[1031] The server stores the identified subscription information in a database and sends a confirmation to the user.

[1032] Contract Renewal Reminders

[1033] Step 1:

[1034] The server periodically checks the contract renewal date of the subscription information in the database.

[1035] Step 2:

[1036] The server generates reminders when contract renewal dates approach.

[1037] Step 3:

[1038] The terminal receives the reminder notification from the server and displays the notification to the user.

[1039] Family sharing

[1040] Step 1:

[1041] Users register their family members' accounts in the app and set up sharing of subscription information.

[1042] Step 2:

[1043] The terminal transmits the setting information to the server.

[1044] Step 3:

[1045] The server stores the received sharing settings in a database and sends a notification to the family members with whom the sharing is intended.

[1046] Step 4:

[1047] Users (family members) can view and manage shared subscription information on their own dashboard.

[1048] Usage analysis and optimization suggestions

[1049] Step 1:

[1050] The server collects users' subscription usage data and analyzes their usage frequency and spending patterns.

[1051] Step 2:

[1052] The server generates optimal subscription plans and savings advice based on the analysis results.

[1053] Step 3:

[1054] The terminal notifies the user of the optimization proposal received from the server, and the user can check the proposal and take necessary actions.

[1055] Emotion Engine

[1056] Step 1:

[1057] When a user uses the app, the device uses an emotion engine to analyze the user's facial expressions and tone of voice to collect emotional data. The emotion engine works via the camera and microphone.

[1058] Step 2:

[1059] The device then formats the collected emotion data appropriately and sends it to the server. The emotion data is encrypted to protect the user's privacy.

[1060] Step 3:

[1061] The server analyzes the received emotion data and identifies the user's emotional state, which can be classified as joy, sadness, stress, excitement, etc.

[1062] Step 4:

[1063] The server takes emotional data into account to tailor subscription suggestions and notifications, for example generating suggestions for relaxing entertainment services if the user is feeling stressed.

[1064] Step 5:

[1065] The device displays suggestions and notifications tailored by the emotion engine to the user, who can then review the suggestions and accept them if necessary.

[1066] Specific examples

[1067] For example, suppose User B uses a "music streaming service" and an "online fitness service." User B can enter their subscription information into the app or scan their contract to automatically obtain the information. The server then centrally manages this information and sends reminders when the renewal date approaches.

[1068] Additionally, while User B is using the app, the emotion engine reads the user's facial expressions and detects "stress." Based on this information, the server suggests subscribing to a "meditation app" to help them relax. This suggestion is displayed on User B's device, and User B may be able to confirm the suggestion and accept it if necessary.

[1069] In this way, the system streamlines users' subscription management and provides optimal emotional recommendations, enriching their lives.

[1070] Example 2

[1071] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1072] Conventional subscription management systems have the drawbacks of making it difficult to manage individual subscription information and sharing information among family members. Furthermore, there is a high risk of forgetting subscription renewal dates and incurring duplicate payments. Furthermore, proposals do not take into account the user's lifestyle or emotional state, making it difficult to select the optimal subscription for the user.

[1073] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1074] In this invention, the server includes means for inputting user information provided by the user, means for centrally managing subscription information, means for monitoring the update date of the subscription information and generating reminders, means for sharing the subscription information among family members, means for analyzing usage status and providing optimal subscription suggestions, means for understanding the emotional state of the user by analyzing facial expressions and tone of voice, and means for adjusting suggestions and notifications based on the emotional state. This enables centralized management of subscription information, update date reminders, information sharing among family members, optimal suggestions based on the analysis of usage status, and subscription suggestions based on the emotional state.

[1075] "User Information" means personal information provided by a User, such as name, email address, and password.

[1076] "Subscription information" is detailed information such as the name of the service to which the user has subscribed, the provider, the contract period, and the cost.

[1077] "Centrally managing" means integrating and managing multiple subscription information in a single system or interface.

[1078] "Monitoring renewal dates" means that the system periodically checks the renewal date of your subscription contract and notifies you a specific period in advance.

[1079] "Reminder" is a notification function that notifies users of important information or tasks in advance.

[1080] "Sharing information" means allowing family members and related parties to see each other's subscription information.

[1081] "Analyzing usage" means analyzing data on the frequency and patterns of users' subscription usage.

[1082] "Optimal subscription proposals" refers to providing users with the most suitable subscription plans and savings advice based on the analysis results.

[1083] "Analyzing facial expressions and tone of voice" refers to identifying the emotional state of a user by analyzing the movement of the user's facial muscles and the tone of their voice.

[1084] An "emotional state" refers to the emotions or moods that a user is currently experiencing.

[1085] "Adjust" means to change the content or method of a proposal or notification to suit specific conditions or circumstances.

[1086] This invention relates to a system that centrally manages subscription information provided by users, shares it among family members, and combines it with an emotion engine that recognizes the user's emotions. This system not only has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions, but also uses the emotion engine to make suggestions and notifications based on the user's emotions.

[1087] Hardware and software used

[1088] Terminal: A device used for input and display, such as a smartphone, tablet, or computer.

[1089] Server: A central management system that manages the database, analyzes data, generates reminders, and analyzes sentiment data.

[1090] OCR software: Optical character recognition software is used to extract text data from paper contracts and receipts.

[1091] Emotion engine: Software containing machine learning models for analyzing a user's facial expressions and tone of voice.

[1092] Encryption Algorithm: A cryptographic technique used to securely transmit a user's personal information.

[1093] System Overview

[1094] User Registration and Login

[1095] A user accesses an application or website and creates a new account by entering the required personal information, which is then encrypted on the device and sent to the server.

[1096] The server stores the received user information in a database and performs account activation procedures. Using the activated account, the user can access the system from the login screen.

[1097] Manage your subscription information

[1098] The user inputs the subscription information he or she has signed up for and transmits it to the server via the terminal.

[1099] The server stores the transmitted information in a database and generates and provides a dashboard for centralized management.

[1100] Automatically retrieve subscription information

[1101] Users take a photo of a paper contract or receipt with their smartphone and send the image to OCR software to extract the text data.

[1102] The extracted text data is sent from the device to the server, where it is analyzed and stored in a database. It is then notified so that it can be viewed on the device.

[1103] Contract Renewal Reminders

[1104] The server periodically checks the subscription information in the database and generates reminders when contract renewals are due.

[1105] The reminder is sent to the device and the user is notified.

[1106] Family sharing

[1107] Users register their family members in the system and set up subscription sharing, which is then sent from the device to the server and stored in a database.

[1108] Users (family members) can check shared subscription information and prevent duplicate spending.

[1109] Usage analysis and optimization suggestions

[1110] The server collects and analyzes subscription usage data to generate optimal plans and savings advice for users.

[1111] The terminal notifies the user of the optimization proposal.

[1112] Emotion Engine

[1113] The emotion engine analyzes the user's facial expressions and tone of voice to collect emotional data.

[1114] Emotional data is sent from the device to a server, where it is stored and analyzed with the user's consent.

[1115] The server then tailors suggestions and notifications based on the user's emotional state and sends them to the device. For example, if the user is feeling stressed, the server suggests services that can help them relax.

[1116] Specific examples

[1117] For example, suppose User A uses a "weekly magazine subscription" and a "music streaming service." User A can enter this service information into the app or scan a contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches. Additionally, while using the app, the emotion engine analyzes the user's facial expressions and detects stress. Based on this information, the server suggests a subscription to a "meditation app" to help them relax.

[1118] Prompt Sentence Examples

[1119] You are developing a system that manages user subscriptions and makes suggestions based on an emotional engine. The system provides a dashboard for users to register and manage various services. It also makes optimal service suggestions based on the user's emotional state. For example, if a user has a weekly magazine subscription and a music streaming service, the system will send renewal reminders and make new suggestions based on the user's emotional state. Please explain the specific process steps.

[1120] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1121] Step 1: User Registration

[1122] A user visits a website or application, enters personal information such as name, email address, password, etc. Once completed, the user clicks the submit button.

[1123] Input: User information (name, email address, password)

[1124] The terminal encrypts the input information and transmits it to the server.

[1125] The server stores the received information in a database and returns a response indicating that registration is complete to the terminal.

[1126] Output: Account registration completion notification

[1127] Step 2: Activate your account

[1128] The user checks the verification email sent to them and clicks on the account activation link.

[1129] Input: Click the link in the verification email

[1130] The server updates the account status to "activated."

[1131] Output: Activation status update notification

[1132] Step 3: Log in

[1133] The user logs in by entering the registered email address and password.

[1134] Input: Email address, password

[1135] The server checks the entered information against a database and redirects the user to the dashboard if authentication is successful.

[1136] Output: Dashboard access permissions

[1137] Step 4: Enter your subscription information

[1138] The user enters their subscription details, including the service name, provider, contract period, cost, etc.

[1139] Input: Subscription information (service name, provider, contract period, cost)

[1140] The terminal transmits the entered subscription information to the server.

[1141] The server stores the received information in a database and updates the dashboard.

[1142] Output: Updated dashboard

[1143] Step 5: Automatically retrieve subscription information

[1144] The user takes a photo of a paper contract or receipt using their smartphone camera.

[1145] Input: Image of contract or receipt

[1146] The device sends the captured image to OCR software, which extracts the text data.

[1147] Output: Extracted character data

[1148] The terminal transmits the extracted character data to the server.

[1149] The server analyzes the character data and stores it in a database as subscription information.

[1150] Output: Parsed subscription information

[1151] Step 6: Generate renewal reminders

[1152] The server periodically checks the subscription information in the database to detect information whose contract renewal date is approaching.

[1153] Input: Subscription information in the database

[1154] Output: Information that needs to be updated

[1155] The server generates a reminder based on the information that needs to be updated and sends it to the device.

[1156] The terminal displays a reminder notification to the user.

[1157] Output: Reminder notification

[1158] Step 7: Set up Family Sharing

[1159] Users enter information about their family members into the system and set up sharing of subscription information.

[1160] Input: Family member information, sharing settings

[1161] The terminal transmits the sharing setting information to the server.

[1162] The server stores the received shared setting information in a database.

[1163] Family members can view shared subscription information on their dashboard.

[1164] Output: Shared dashboard

[1165] Step 8: Usage analysis and optimization recommendations

[1166] The server collects subscription usage data and analyzes usage frequency and patterns.

[1167] Input: Subscription usage data

[1168] Output: Usage analysis results

[1169] The server generates optimal subscription plans and savings advice based on the analysis results and sends them to the device.

[1170] The terminal notifies the user of the optimization proposal.

[1171] Output: Optimization suggestion notification

[1172] Step 9: Leverage your emotional engine

[1173] While the user is using the app, the emotion engine analyzes facial expressions and tone of voice via the camera and microphone.

[1174] Input: facial expression data, tone of voice data

[1175] The terminal transmits the analyzed emotion data to the server.

[1176] The server analyzes the emotional data and understands the user's emotional state.

[1177] Output: Emotional state analysis results

[1178] The server tailors suggestions and notifications based on the emotional state and sends them to the device.

[1179] The device will display suggestions and notifications to the user based on their emotions, for example, suggesting services that will help them relax if they are feeling stressed.

[1180] Output: Adjusted proposal notification

[1181] (Application example 2)

[1182] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1183] Currently, many users use multiple subscription services, but are unable to efficiently manage their contract information, leading to problems such as missed renewal deadlines and duplicate contracts. Furthermore, the lack of a system that suggests optimal content based on a user's emotions and usage status makes it difficult to increase user satisfaction. Our goal is to solve these problems by enabling users to efficiently manage their subscriptions and enjoy optimal content tailored to their individual emotional state.

[1184] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1185] In this invention, the server includes a means for inputting subscription information provided by the user, a means for centrally managing the subscription information, a means for monitoring the renewal date of the subscription information and generating reminders, a means for sharing the subscription information among family members, a means for analyzing usage status and providing optimal subscription suggestions, and a means for analyzing the user's emotions and suggesting content based on the emotions. This allows the user to centrally manage subscriptions, not miss renewal deadlines, and share information among family members to avoid duplicate spending. Furthermore, by suggesting optimal content based on the user's emotional state, user satisfaction can be increased.

[1186] "Subscription information" indicates information about multiple services to which a user has subscribed, and includes details such as the service name, provider, contract period, and cost.

[1187] The "means for inputting" refers to a means by which a user registers subscription information in the system, and allows data input by keyboard input, voice input, or scanning.

[1188] "Means for centralized management" refers to means for centrally managing multiple subscription information using a single interface.

[1189] The "means for monitoring the renewal date and generating a reminder" is a means for periodically checking the contract renewal date of the subscription information and notifying the user when the expiration date approaches.

[1190] "Means for sharing among family members" refers to a means for sharing a user's subscription information among family members to avoid overlapping contracts.

[1191] "Means for analyzing usage and providing optimal subscription proposals" refers to means for collecting and analyzing users' subscription usage data and proposing optimal subscription plans based on the results.

[1192] The "means for analyzing emotions" is a means for acquiring emotional data from the user's facial expressions and voice and analyzing the emotional state.

[1193] The "means for suggesting content based on emotions" is a means for suggesting optimal subscription content (e.g., relaxing music or a meditation app) in response to the analyzed emotional state of the user.

[1194] The system for realizing this invention is composed of the following main components: A server, a user terminal, and an emotion engine work closely together to efficiently manage user subscription information and propose optimal content according to the user's emotional state.

[1195] Server Configuration

[1196] 1. The server receives subscription information input data provided by users and maintains a database for centralized management. It also has a function to monitor contract renewal dates and generate reminders when the renewal deadline approaches. This allows users to manage their subscriptions without forgetting to renew them.

[1197] 2. The server also has a management function for sharing user subscription information among family members. The family sharing function helps to avoid duplicate contracts and enables efficient management of household finances.

[1198] 3. The server also has the function of collecting users' subscription usage data and analyzing their usage patterns to propose the optimal subscription plan. This proposal is based on data such as usage frequency and cost performance, allowing users to enjoy maximum benefits.

[1199] User terminal configuration

[1200] 1. The user device (e.g., a smartphone) serves as an interface for the user to enter subscription information. The subscription information is sent from the device to a server and stored in a database. If the user uses a paper contract, character recognition software (e.g., OCR technology) is used to extract the data and automatically register the subscription information.

[1201] 2. The user device receives reminders and offers generated by the server and notifies the user, including contract renewal reminders and optimal subscription offers.

[1202] 3. The user device works in conjunction with the emotion engine to analyze the user's facial expressions and tone of voice to collect emotional data. The collected emotional data is sent to the server, which then suggests content based on the emotion analysis.

[1203] Emotion engine configuration

[1204] 1. The emotion engine analyzes the user's facial expressions and voice data to identify the user's emotional state. This analysis uses image processing and voice analysis technologies. The emotion engine can identify various emotional states, such as whether the user is stressed, relaxed, or enjoying themselves.

[1205] 2. The emotion engine connects with the user's device and sends the analysis results to the server, which uses this data to suggest optimal subscription content based on the user's emotional state.

[1206] Specific examples

[1207] For example, if a user feels like relaxing, the emotion engine analyzes the user's emotional state, and the server suggests optimal relaxation content (such as a music playlist or a meditation app). Also, if the user's subscription is nearing its renewal deadline, a server-generated reminder is sent to the user's device.

[1208] Example prompts for generative AI models

[1209] "If a user is feeling stressed, suggest subscription content that will help them relax. Suggestions could include a relaxing music playlist or a meditation app. Also, if a subscription is due for renewal soon, display a reminder."

[1210] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1211] Step 1:

[1212] User Registration and Login

[1213] What happens: A user creates an account by entering their name, email address, and password.

[1214] Input: The user enters their name, email address, and password.

[1215] Output: User information is saved on the server and an account verification email is sent.

[1216] Specific operation: When a user enters data into the form and presses the "Register" button, the data is encrypted and sent to the server, which stores it in a database and issues a verification email.

[1217] Step 2:

[1218] Entering subscription information and registration

[1219] Process: The user enters their subscription information through the application.

[1220] Input: Subscription information such as service name, provider, contract duration, and cost.

[1221] Output: The server stores this information in a database and displays it on a dashboard.

[1222] How it works: When a user enters information and presses the "Register" button, the data is sent to the server and stored in a database. The server retrieves this information and displays it on the user's dashboard.

[1223] Step 3:

[1224] Scanning paper contracts and character recognition

[1225] What it does: The user scans a paper contract or receipt and extracts the text data.

[1226] Input: scanned image data.

[1227] Output: Character recognition software extracts the character data and sends it to the server as subscription information.

[1228] Specific operation: When a user uses the scan function within the app and takes a picture of a contract with their camera, the image is processed by an OCR engine (such as Tesseract) and the extracted text data is sent to the server.

[1229] Step 4:

[1230] Contract renewal reminder generation and notification

[1231] What happens: The server periodically checks the contract renewal date and generates a reminder.

[1232] Input: Contract expiration date stored in the database.

[1233] Output: When the renewal date approaches, a reminder notification will be sent to the user's device.

[1234] How it works: The server periodically checks the date and generates reminders for subscriptions that are approaching their expiration date. The reminder information is then sent to the user's device via push notification.

[1235] Step 5:

[1236] Sharing subscription information between family members

[1237] What it does: Set up sharing of subscription information between family members.

[1238] Input: Family member's account information.

[1239] Output: The shared subscription information will be displayed on other family members' dashboards.

[1240] Specific operation: When a user enters the information of family members into the system and the server stores the information in the database, the sharing setup is complete. Family members can view the shared information on their dashboard.

[1241] Step 6:

[1242] Analysis of usage status and optimization proposals

[1243] What it does: The server collects user subscription usage data and analyzes usage frequency and patterns.

[1244] Input: Subscription usage data.

[1245] Output: Best subscription plans and savings advice.

[1246] Specific operation: The server analyzes the collected data, identifies the user's usage patterns, and generates optimal suggestions. The contents of the suggestions are sent to the user's device as a notification.

[1247] Step 7:

[1248] User emotion analysis and emotion-based suggestions

[1249] Processing content: The user device uses the emotion engine to analyze the user's emotions.

[1250] Input: Emotional data such as the user's facial expressions and tone of voice.

[1251] Output: Content suggestions based on emotional state.

[1252] Specific operation: The user's device captures the user's facial expressions and voice, and analyzes them using the emotion engine. The analysis results are sent to the server, which then suggests content appropriate to the user's emotional state (such as a relaxing music playlist).

[1253] Example prompts for generative AI models

[1254] "If a user is feeling stressed, suggest subscription content that will help them relax. Suggestions could include a relaxing music playlist or a meditation app. Also, if a subscription is due for renewal soon, display a reminder."

[1255] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1256] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1257] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1258] [Third embodiment]

[1259] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1260] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1261] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1262] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1263] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1264] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1265] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1266] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1267] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1268] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1269] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1270] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1271] This invention relates to a system that centrally manages subscription information provided by users and enables it to be shared among family members. This system has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions.

[1272] System Overview

[1273] User Registration and Login

[1274] A user first accesses an application or website and creates a new account by entering required information such as name, email address, and password. The information entered by the user is encrypted for security purposes and sent from the device to the server.

[1275] The server saves the received information in a database and returns a response indicating that the information was saved successfully to the terminal. The user then checks the authentication email sent at this time and clicks on the link to activate the account.

[1276] The user accesses the login screen with an activated account and logs in by entering their email address and password. Authentication is performed on the server, and if successful, the user can access the dashboard.

[1277] Manage your subscription information

[1278] Users can input various subscription information (service name, provider, contract period, cost, etc.) that they have signed up for. This information is sent to the server via the terminal and stored in a database.

[1279] Based on the entered subscription information, the server generates an interface for centralized management on the dashboard and provides it to the user.

[1280] Automatically retrieve subscription information

[1281] Users can take a photo of a paper contract or receipt using the app's scanning function, and the image is sent to character recognition software (OCR) by the device, where text data is extracted.

[1282] The server analyzes the extracted character data and stores it in the database as appropriate subscription information. After storing it, it sends a confirmation notice to the user so that the user can confirm it.

[1283] Contract Renewal Reminders

[1284] The server monitors the contract renewal date in the database and generates a reminder a pre-set period before the contract renewal date, thereby notifying the user before the contract renewal date.

[1285] The device will receive the reminder and display a notification to the user, so that the user does not miss the timing of automatic renewal or contract renewal.

[1286] Family sharing

[1287] Users register their family members' accounts in the system and set up specific subscription sharing settings, which are then sent from the device to the server and stored in a database.

[1288] Users (family members) can view shared subscription information on their own dashboard, which helps prevent duplicate spending between family members.

[1289] Usage analysis and optimization suggestions

[1290] The server collects subscription usage data from users and analyzes their usage frequency and patterns, based on which it generates optimal subscription plans and savings advice for users.

[1291] The terminal receives optimization suggestions from the server and notifies the user, who can then review the suggestions and take necessary actions.

[1292] Specific examples

[1293] For example, suppose User A uses a "regular food delivery service" and a "video streaming service." User A can enter the service information into the app or scan the contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches.

[1294] Furthermore, when User A registers and shares information about his family members, it becomes clear that Family B has a duplicate subscription to the same "video streaming service." The system then presents User A with optimization suggestions to avoid this duplicate subscription, allowing User A to adjust the subscription details with Family B accordingly.

[1295] This allows User A and his family to use the subscription service more efficiently and economically.

[1296] The processing flow will be explained below.

[1297] User Registration and Login

[1298] Step 1:

[1299] The user accesses the application or website and enters the required information (name, email address, password) on the new registration screen.

[1300] Step 2:

[1301] The device sends the entered information to the server, where the user's password is hashed in a secure manner.

[1302] Step 3:

[1303] The server validates the received information to ensure its validity, and if validation is successful, stores the user information in the database.

[1304] Step 4:

[1305] The server generates a successful registration response and sends it to the device. The user opens the authentication email sent to them and clicks the authentication link to activate their account.

[1306] Step 5:

[1307] The user accesses the login screen again with the activated account and logs in by entering their email address and password.

[1308] Step 6:

[1309] The terminal transmits the entered login information to the server.

[1310] Step 7:

[1311] The server validates the login information and confirms that the user exists. If successful, it creates a session and sends a success response back to the terminal.

[1312] Manage your subscription information

[1313] Step 1:

[1314] The user enters subscription information (service name, provider, contract period, cost, etc.) on the app's subscription addition screen.

[1315] Step 2:

[1316] The terminal transmits the entered subscription information to the server.

[1317] Step 3:

[1318] The server stores the received information in a database, and if the storage is successful, returns a confirmation response to the terminal.

[1319] Automatically retrieve subscription information

[1320] Step 1:

[1321] Users can take a photo of a paper contract or receipt using the app's scanning function.

[1322] Step 2:

[1323] The device sends the captured image to an OCR engine and extracts the text data.

[1324] Step 3:

[1325] The server analyzes the character data received from the OCR engine and identifies the subscription information.

[1326] Step 4:

[1327] The server stores the identified subscription information in a database and sends a confirmation to the user.

[1328] Contract Renewal Reminders

[1329] Step 1:

[1330] The server periodically checks the contract renewal date of the subscription information in the database.

[1331] Step 2:

[1332] The server generates reminders when contract renewal dates approach.

[1333] Step 3:

[1334] The terminal receives the reminder notification from the server and displays the notification to the user.

[1335] Family sharing

[1336] Step 1:

[1337] Users register their family members' accounts in the app and set up sharing of subscription information.

[1338] Step 2:

[1339] The terminal transmits the setting information to the server.

[1340] Step 3:

[1341] The server stores the received sharing settings in a database and sends a notification to the family members with whom the sharing is intended.

[1342] Step 4:

[1343] Users (family members) can view and manage shared subscription information on their own dashboard.

[1344] Usage analysis and optimization suggestions

[1345] Step 1:

[1346] The server collects users' subscription usage data and analyzes their usage frequency and spending patterns.

[1347] Step 2:

[1348] The server generates optimal subscription plans and savings advice based on the analysis results.

[1349] Step 3:

[1350] The terminal notifies the user of the optimization proposal received from the server, and the user can check the proposal and take necessary actions.

[1351] In this way, specific operations are performed at each step, allowing the user to manage subscription information efficiently and optimally.

[1352] Example 1

[1353] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1354] With conventional subscription management systems, each user had to manage their contract information individually, making it difficult to keep track of contract renewal dates and share information among family members. It was also difficult to digitally acquire and properly manage information from paper contracts and receipts, making it difficult to analyze usage patterns and propose optimal subscription plans. Furthermore, the security and centralized data management required to solve these problems were not adequately considered.

[1355] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1356] In this invention, the server includes means for having a user enter registration information and encrypting it for security before transmitting it to the server, means for the server to store the received information in a database, send an authentication email, and have the user activate their account, means for the server to authenticate the user's account and, if successful, allow the user to access the dashboard, means for centrally managing subscription information, means for monitoring the update date of the subscription information and generating reminders, means for sharing the subscription information among family members, means for analyzing usage patterns and providing optimal subscription proposals, means for scanning paper contracts and receipts and extracting text data, and means for analyzing the extracted text data and identifying subscription information. This allows users to centrally manage contract information, avoid duplicate spending among family members, and receive optimal subscription proposals.

[1357] "User" refers to an individual or entity that uses the System to register, manage, and share subscription information.

[1358] "Subscription information" is information related to the subscription service to which the user has subscribed, and includes details such as the service name, provider, contract period, and cost.

[1359] "Server" refers to a computer resource that receives information sent from users, stores it in a database, manages it, and analyzes it.

[1360] "Terminal" refers to a device, such as a computer or smartphone, that a user uses to access the system.

[1361] "Database" means a collection of information for securely storing and managing user and subscription information.

[1362] "Encryption" refers to the process of transforming data using a specific algorithm to protect the contents of the information from third parties.

[1363] "Verification Email" means an email sent to a user to validate their account registration, which includes an authentication link.

[1364] "Reminder" refers to a message from the system that notifies users in advance of important deadlines, such as contract renewal dates.

[1365] "OCR" stands for Optical Character Recognition, a technology that reads characters from images or scanned documents and converts them into digital data.

[1366] "Dashboard" means a web or application interface that allows a User to manage and view their subscription information at a glance.

[1367] "Duplicate spending" refers to wasteful spending resulting from multiple contracts for the same subscription service within a household.

[1368] "Usage analysis" refers to the process of analyzing usage trends and patterns based on user subscription service usage data.

[1369] "Optimal subscription proposal" refers to recommending the most effective and economical subscription plan to a user based on an analysis of usage.

[1370] This invention provides a system that centrally manages subscription information provided by users and allows it to be shared among family members. This system has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions. A specific embodiment of this system is described below.

[1371] User Registration and Login

[1372] A user accesses an application or website and creates a new account by entering the required information, such as name, email address, and password. The information entered by the user is encrypted using RSA encryption technology for security purposes and sent from the device to the server.

[1373] The server saves the received information in a database (e.g., MySQL) and returns a response indicating that the information was saved successfully to the terminal. The user checks the authentication email sent at this time and clicks on the link to activate the account.

[1374] With an activated account, the user accesses the login screen and enters their email address and password to log in. Authentication is performed by the server, and if successful, the user is given access to the dashboard.

[1375] Manage your subscription information

[1376] The user inputs the various subscription information (service name, provider, contract period, cost, etc.) that they have signed up for. This information is sent to the server via the terminal and stored in a database.

[1377] Based on the entered subscription information, the server generates an interface for centralized management on the dashboard and provides it to the user.

[1378] Automatically retrieve subscription information

[1379] Users can take a photo of a paper contract or receipt using the app's scanning function, and the captured image is sent to character recognition software (OCR, e.g., Tesseract OCR library) by the device, where text data is extracted.

[1380] The server analyzes the extracted character data and stores it in the database as appropriate subscription information. After storing it, it sends a confirmation notice to the user so that the user can confirm it.

[1381] Contract Renewal Reminders

[1382] The server monitors the contract renewal date in the database and generates a reminder a pre-set period before the contract renewal date, thereby notifying the user before the contract renewal date.

[1383] The device will receive the reminder and display a notification to the user, so that the user does not miss the timing of automatic renewal or contract renewal.

[1384] Family sharing

[1385] Users register their family members' accounts in the system and set up specific subscription sharing settings, which are then sent from the device to the server and stored in a database.

[1386] Users (family members) can view shared subscription information on their own dashboard, which helps prevent duplicate spending between family members.

[1387] Usage analysis and optimization suggestions

[1388] The server collects subscription usage data from users and analyzes their usage frequency and patterns, based on which it generates optimal subscription plans and savings advice for users.

[1389] The terminal receives optimization suggestions from the server and notifies the user, who can then review the suggestions and take necessary actions.

[1390] Specific examples

[1391] For example, suppose User A uses a "regular food delivery service" and a "video streaming service." User A can enter the service information into the app or scan the contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches.

[1392] Furthermore, when User A registers and shares information about his family members, it becomes clear that Family B has a duplicate subscription to the same "video streaming service." The system then presents User A with optimization suggestions to avoid this duplicate subscription, allowing User A to adjust the subscription details with Family B accordingly.

[1393] This allows User A and his family to use the subscription service more efficiently and economically.

[1394] Example prompts for generative AI models

[1395] "Please create a program that allows users to register and manage subscription information and share it with their family members. Please include a function that allows users to enter or scan information about the services they subscribe to, a function that generates and notifies them of subscription renewal reminders, a function that allows information to be shared among family members, and a function that analyzes usage and makes optimization suggestions."

[1396] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1397] Step 1:

[1398] To create a new account, a user enters their name, email address, and password and submits the data to the server.

[1399] Input: Name, Email Address, Password

[1400] Processing: The terminal encrypts the entered information using RSA encryption technology and sends it to the server.

[1401] Output: Encrypted user information

[1402] Step 2:

[1403] The server stores the encrypted user information it receives in a database.

[1404] Input: Encrypted user information

[1405] Processing: The server saves the user information in a database (e.g. MySQL) and sends a verification email to the user.

[1406] Output: Verification email

[1407] Step 3:

[1408] The user clicks the link in the verification email to activate their account.

[1409] Input:Authentication link

[1410] Processing: The server receives the link and updates the user account to an activated status.

[1411] Output: Activated accounts

[1412] Step 4:

[1413] The user enters their email address and password on the login screen and sends them to the server.

[1414] Input: Email address, password

[1415] Processing: The server performs authentication and, if successful, displays the dashboard to the user.

[1416] Output: Dashboard access

[1417] Step 5:

[1418] The user enters subscription information (service name, provider, contract period, cost) and sends it to the server.

[1419] Input: Subscription information

[1420] Processing: The terminal inputs information and sends it to the server, which stores the received information in a database.

[1421] Output: Saved subscription information

[1422] Step 6:

[1423] The server generates the dashboard interface and provides it to the user.

[1424] Input: Saved subscription information

[1425] Processing: The server retrieves information from the database and generates the dashboard interface.

[1426] Output: Dashboard interface

[1427] Step 7:

[1428] The user takes a photo of a paper contract or receipt using the app's scanning function and sends it to the device.

[1429] Input: A photograph of a contract or receipt

[1430] Processing: The device extracts character data using OCR (Optical Character Recognition) technology.

[1431] Output: Extracted character data

[1432] Step 8:

[1433] The terminal transmits the extracted character data to the server, which analyzes it to identify subscription information.

[1434] Input: Extracted character data

[1435] Processing: The server parses the character data, recognizes it as subscription information, and stores it in the database.

[1436] Output: Identified subscription information

[1437] Step 9:

[1438] The server monitors the database for renewal dates and generates reminders as needed.

[1439] Input: Database contract information

[1440] Processing: The server periodically checks the contract renewal date and generates a reminder notification when the renewal date approaches.

[1441] Output: Reminder notification

[1442] Step 10:

[1443] The device receives the reminder notification and displays the notification to the user.

[1444] Input: Reminder

[1445] Processing: The device displays a notification to the user, who checks the notification and takes the necessary action.

[1446] Output: The notification displayed to the user

[1447] Step 11:

[1448] The user registers family member accounts in the system and sets up subscription information sharing among family members.

[1449] Input: Family member information, shared subscription information

[1450] Processing: The device sends the information to the server, which stores it in a database.

[1451] Output: Shared subscription information

[1452] Step 12:

[1453] Family members can view the shared subscription information on their dashboard.

[1454] Input: Shared subscription information

[1455] Processing: The server retrieves information from the database and reflects it on the family member's dashboard.

[1456] Output: Shared information displayed on family member's dashboard

[1457] Step 13:

[1458] The server collects user subscription usage data and analyzes usage frequency and patterns.

[1459] Input: Subscription usage data

[1460] Processing: The server analyzes the data to identify usage patterns and frequencies.

[1461] Output: Analysis results

[1462] Step 14:

[1463] The server generates optimal subscription plans and savings advice based on the analysis results.

[1464] Input: Analysis results

[1465] Processing: The server generates the optimal plan or advice for the user.

[1466] Output: Optimization suggestions

[1467] Step 15:

[1468] The terminal receives the optimization proposal and notifies the user.

[1469] Input: Optimization proposal

[1470] Processing: The terminal notifies the user of the proposal so that the user can confirm it.

[1471] Output: The suggestion sent to the user

[1472] (Application example 1)

[1473] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1474] Conventional subscription management systems make it difficult to centrally manage information about various subscriptions subscribed to by users, and lack reminder functions and functions for sharing information among family members, which leads to problems such as duplicate contracts and wasteful spending. Furthermore, updating and managing contract information is particularly cumbersome for services used daily, such as food delivery services, and efficient management is required.

[1475] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1476] In this invention, the server includes: a means for inputting subscription information provided by the user; a means for centrally managing the subscription information; a means for monitoring the renewal date of the subscription information and generating reminders; a means for sharing the subscription information among family members; a means for analyzing usage and providing optimal subscription proposals; a means for registering and managing subscription information for food delivery services; a means for the user to scan a paper contract and extract text data using OCR; a means for identifying the extracted text data as subscription information; and a means for notifying a smart device of a reminder when the contract renewal date approaches. This allows users to centrally manage the various subscription information they have subscribed to, receive reminders when the renewal date approaches, and avoid duplicate subscriptions by sharing information among family members. Furthermore, analyzing usage and receiving optimal subscription proposals allows users to use services efficiently and economically.

[1477] "User" means a user of the system who registers, manages, and shares subscription information and receives reminders and suggestions.

[1478] "Subscription information" is information about various services to which a user has subscribed, and includes the service name, provider, contract period, cost, etc.

[1479] "Centralized management" means that multiple subscription information is managed uniformly on one system.

[1480] "Reminder" is a function that notifies users when their subscription renewal date is approaching.

[1481] "Family information sharing" is a feature that allows family members who use the same system to view and share each other's subscription information.

[1482] "Usage analysis" means analyzing usage data of subscription services for which a user has signed up to evaluate frequency and patterns of use.

[1483] "Optimal subscription proposals" are proposals that present the most appropriate and economical subscription plans and saving methods for users based on an analysis of usage.

[1484] A "food delivery service" is a service that delivers ingredients and meals ordered online to a specified location.

[1485] "OCR" is an abbreviation for optical character recognition, a technology that extracts character information from image data.

[1486] "Smart devices" refer to intelligent devices with internet connectivity, such as smartphones, smart glasses, and head-mounted displays.

[1487] The system for implementing this invention is designed to enable users to efficiently use food delivery services by registering, managing, and sharing subscription information and providing reminders and optimal suggestions.

[1488] composition

[1489] The system consists of the following main components:

[1490] 1. Server

[1491] 2. Terminals (smartphones, smart glasses, other smart devices)

[1492] 3. OCR Software

[1493] 4. Database

[1494] 5. Notification System

[1495] User Registration and Login

[1496] First, the user creates a new account by entering necessary information such as name, email address, and password on the device.

[1497] The terminal sends the encrypted user information to the server, which stores it in a database.

[1498] The user checks the verification email sent to them and clicks the link to activate their account, after which they can log in.

[1499] Manage your subscription information

[1500] Enter the subscription information (service name, provider, contract period, cost, etc.) for the food delivery service to which the user has subscribed.

[1501] The terminal sends this information to the server, which stores it in a database.

[1502] Automatically retrieve subscription information

[1503] A user scans a paper contract with a smartphone app, and the scanned image is converted into text data by OCR software.

[1504] The server analyzes this character data and stores it in a database as subscription information.

[1505] Contract Renewal Reminders

[1506] The server monitors contract renewal dates in the database and generates reminders before a pre-set period.

[1507] The device will receive this reminder and display a notification to the user.

[1508] Family sharing

[1509] The user registers accounts for family members and sets up shared subscription information.

[1510] The server stores this setting information in a database, allowing information to be shared among family members.

[1511] Usage analysis and optimization suggestions

[1512] The server collects subscription usage data and analyzes usage patterns.

[1513] Based on the results of this analysis, the server generates and notifies the user of the optimal subscription plan and savings proposals.

[1514] Specific examples

[1515] For example, when a user scans a "Food Subscription" contract with a smartphone app, the information is read using OCR and automatically registered in the app. Then, when the contract renewal date approaches, a reminder notification pops up on the smart glasses.

[1516] Example prompts to input to a generative AI model

[1517] Prompt: How can I develop an application that scans my "food subscription" contract and notifies me when it's due for renewal?

[1518] This allows users to manage and use food delivery services efficiently and economically.

[1519] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1520] Step 1:

[1521] A user launches the smartphone app and creates a new account by entering required information such as name, email address, and password.

[1522] Input: Name, email address, and password entered by the user.

[1523] Data processing: The terminal encrypts the entered password for security purposes.

[1524] Output: Sends the encrypted password, name, and email address to the server.

[1525] Step 2:

[1526] The server stores the received user information in a database and returns a response to the terminal indicating that the information has been successfully stored.

[1527] Input: Encrypted password, name, and email address sent from your device.

[1528] Data processing: The server stores this information in a database.

[1529] Output: Returns a save completion response to the terminal.

[1530] Step 3:

[1531] The user checks the verification email sent to them and clicks on the link to activate their account.

[1532] Input: Click the link in the verification email.

[1533] Data processing: The server activates the user's account.

[1534] Output: Account activation notification.

[1535] Step 4:

[1536] Users log in with an activated account and enter their subscription information.

[1537] Input: Subscription information (service name, provider, contract period, cost, etc.).

[1538] Data processing: The device sends the entered information to the server.

[1539] Output: Submits subscription information to the server.

[1540] Step 5:

[1541] The server stores the submitted subscription information in a database and generates a dashboard based on it.

[1542] Input: Subscription information sent from the device.

[1543] Data processing: The server stores subscription information in a database and generates a dashboard.

[1544] Output: Sends the updated dashboard to the device.

[1545] Step 6:

[1546] The user scans the contract with a smartphone app, and the OCR software extracts the text data.

[1547] Input: Scanned contract image data.

[1548] Data processing: OCR software extracts text information from image data.

[1549] Output: The extracted character data is sent to the server.

[1550] Step 7:

[1551] The server analyzes the character data received from the OCR software and stores it in a database as subscription information.

[1552] Input: The extracted character data.

[1553] Data processing: The server parses the text data and formats it as subscription information.

[1554] Output: Formatted subscription information stored in the database.

[1555] Step 8:

[1556] The server monitors contract renewal dates in the database and generates reminders before a pre-set period.

[1557] Input: Subscription information in the database.

[1558] Data processing: The server checks the contract renewal date and generates a reminder.

[1559] Output: Send reminder notification to device.

[1560] Step 9:

[1561] The terminal receives the generated reminder and displays a notification to the user.

[1562] Input: Reminder notification sent from the server.

[1563] Data processing: The device displays reminder notifications.

[1564] Output: Notify the user of the reminder.

[1565] Step 10:

[1566] The user registers accounts for family members and sets up sharing of subscription information.

[1567] Input: Family member's account information.

[1568] Data processing: The device sends the share setting information to the server.

[1569] Output: Sends shared configuration information to the server.

[1570] Step 11:

[1571] The server stores the shared setting information in a database and shares the subscription information among family members.

[1572] Input: Shared configuration information.

[1573] Data processing: The server stores the shared setting information in a database and checks the integrity of the shared information.

[1574] Output: Sharing subscription information between family members.

[1575] Step 12:

[1576] The server collects subscription usage data, analyzes it, and generates optimal offers for users.

[1577] Input: Subscription usage data.

[1578] Data processing: The server analyzes usage patterns and generates optimal plans and savings proposals.

[1579] Output: Notify the device of the suggestion.

[1580] Step 13:

[1581] The terminal notifies the user of the optimization proposal received from the server, and the user confirms it.

[1582] Input: Optimization suggestions sent by the server.

[1583] Data processing: The device will display optimization suggestions.

[1584] Output: Notify user of optimization suggestions.

[1585] The above is the specific processing flow of the program of the system that realizes the application example.

[1586] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1587] This invention relates to a system that centrally manages subscription information provided by users, shares it among family members, and combines it with an emotion engine that recognizes the user's emotions. This system not only has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions, but also uses the emotion engine to make suggestions and notifications based on the user's emotions.

[1588] System Overview

[1589] User Registration and Login

[1590] A user accesses an application or website and creates a new account by entering required information such as name, email address, and password. The information entered by the user is encrypted for security purposes and sent from the device to the server.

[1591] The server saves the received information in its database and returns a response indicating successful saving to the terminal. The user checks the authentication email sent and clicks on the link to activate their account.

[1592] The user accesses the login screen with an activated account and logs in by entering their email address and password. Authentication is performed on the server, and if successful, the user can access the dashboard.

[1593] Manage your subscription information

[1594] Users can input various subscription information (service name, provider, contract period, cost, etc.) that they have signed up for. This information is sent to the server via the terminal and stored in a database.

[1595] Based on the entered subscription information, the server generates an interface for centralized management on the dashboard and provides it to the user.

[1596] Automatically retrieve subscription information

[1597] Users can take a photo of a paper contract or receipt using the app's scanning function, and the image is sent to character recognition software (OCR) by the device, where text data is extracted.

[1598] The server analyzes the extracted character data and stores it in the database as appropriate subscription information. After storing it, it sends a confirmation notice to the user so that the user can confirm it.

[1599] Contract Renewal Reminders

[1600] The server periodically checks the contract renewal date in the database and generates a reminder a pre-set period before the contract renewal date, thereby notifying the user before the contract renewal date.

[1601] The device will receive the reminder and display a notification to the user, so that the user does not miss the timing of automatic renewal or contract renewal.

[1602] Family sharing

[1603] Users register their family members' accounts in the system and set up specific subscription sharing settings, which are then sent from the device to the server and stored in a database.

[1604] Users (family members) can view shared subscription information on their own dashboard, which helps prevent duplicate spending between family members.

[1605] Usage analysis and optimization suggestions

[1606] The server collects subscription usage data from users and analyzes their usage frequency and patterns, based on which it generates optimal subscription plans and savings advice for users.

[1607] The terminal receives optimization suggestions from the server and notifies the user, who can then review the suggestions and take necessary actions.

[1608] Emotion Engine

[1609] When a user uses the app, the emotion engine analyzes the user's facial expressions and tone of voice to collect emotional data.

[1610] The device transmits emotion data to the server, which collects the emotion data with the user's consent.

[1611] The server analyzes the emotional data to understand the user's emotional state and uses this emotional data to tailor the content of subscription offers and notification methods.

[1612] The device displays subscription suggestions and notifications tailored to the user by the emotion engine, for example, suggesting relaxing entertainment services if the user is feeling stressed.

[1613] Specific examples

[1614] For example, suppose User A uses a "weekly magazine subscription" and a "music streaming service." User A can enter the service information into the app or scan the contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches.

[1615] Additionally, while User A is using the app, the emotion engine reads the user's facial expressions and detects that the user is feeling stressed. The server uses this information to suggest a subscription to a "meditation app" that can help the user relax. User A can accept this suggestion and enjoy customized suggestions based on their emotional state.

[1616] In this way, we will create a system that streamlines user subscription management and provides optimal emotional suggestions, enriching users' lives.

[1617] The processing flow will be explained below.

[1618] User Registration and Login

[1619] Step 1:

[1620] The user accesses the application or website and enters the required information (name, email address, password) on the new registration screen.

[1621] Step 2:

[1622] The device sends the entered information to the server, where the password is hashed to ensure security.

[1623] Step 3:

[1624] The server validates the received information and if validation is successful, saves the user information in the database.

[1625] Step 4:

[1626] The server generates a successful registration response and sends it to the device. The user opens the authentication email sent to them and clicks the authentication link to activate their account.

[1627] Step 5:

[1628] The user accesses the login screen again with the activated account and logs in by entering their email address and password.

[1629] Step 6:

[1630] The terminal transmits the entered login information to the server.

[1631] Step 7:

[1632] The server validates the login information and confirms that the user exists. If successful, it creates a session and sends a success response back to the terminal.

[1633] Manage your subscription information

[1634] Step 1:

[1635] The user enters subscription information (service name, provider, contract period, cost, etc.) on the app's subscription addition screen.

[1636] Step 2:

[1637] The terminal transmits the entered subscription information to the server.

[1638] Step 3:

[1639] The server stores the received information in a database, and if the storage is successful, returns a confirmation response to the terminal.

[1640] Automatically retrieve subscription information

[1641] Step 1:

[1642] Users can take a photo of a paper contract or receipt using the app's scanning function.

[1643] Step 2:

[1644] The device sends the captured image to an OCR engine to extract the text data.

[1645] Step 3:

[1646] The server analyzes the character data received from the OCR engine and identifies the subscription information.

[1647] Step 4:

[1648] The server stores the identified subscription information in a database and sends a confirmation to the user.

[1649] Contract Renewal Reminders

[1650] Step 1:

[1651] The server periodically checks the contract renewal date of the subscription information in the database.

[1652] Step 2:

[1653] The server generates reminders when contract renewal dates approach.

[1654] Step 3:

[1655] The terminal receives the reminder notification from the server and displays the notification to the user.

[1656] Family sharing

[1657] Step 1:

[1658] Users register their family members' accounts in the app and set up sharing of subscription information.

[1659] Step 2:

[1660] The terminal transmits the setting information to the server.

[1661] Step 3:

[1662] The server stores the received sharing settings in a database and sends a notification to the family members with whom the sharing is intended.

[1663] Step 4:

[1664] Users (family members) can view and manage shared subscription information on their own dashboard.

[1665] Usage analysis and optimization suggestions

[1666] Step 1:

[1667] The server collects users' subscription usage data and analyzes their usage frequency and spending patterns.

[1668] Step 2:

[1669] The server generates optimal subscription plans and savings advice based on the analysis results.

[1670] Step 3:

[1671] The terminal notifies the user of the optimization proposal received from the server, and the user can check the proposal and take necessary actions.

[1672] Emotion Engine

[1673] Step 1:

[1674] When a user uses the app, the device uses an emotion engine to analyze the user's facial expressions and tone of voice to collect emotional data. The emotion engine works via the camera and microphone.

[1675] Step 2:

[1676] The device then formats the collected emotion data appropriately and sends it to the server. The emotion data is encrypted to protect the user's privacy.

[1677] Step 3:

[1678] The server analyzes the received emotion data and identifies the user's emotional state, which can be classified as joy, sadness, stress, excitement, etc.

[1679] Step 4:

[1680] The server takes emotional data into account to tailor subscription suggestions and notifications, for example generating suggestions for relaxing entertainment services if the user is feeling stressed.

[1681] Step 5:

[1682] The device displays suggestions and notifications tailored by the emotion engine to the user, who can then review the suggestions and accept them if necessary.

[1683] Specific examples

[1684] For example, suppose User B uses a "music streaming service" and an "online fitness service." User B can enter their subscription information into the app or scan their contract to automatically obtain the information. The server then centrally manages this information and sends reminders when the renewal date approaches.

[1685] Additionally, while User B is using the app, the emotion engine reads the user's facial expressions and detects "stress." Based on this information, the server suggests subscribing to a "meditation app" to help them relax. This suggestion is displayed on User B's device, and User B may be able to confirm the suggestion and accept it if necessary.

[1686] In this way, the system streamlines users' subscription management and provides optimal emotional recommendations, enriching their lives.

[1687] Example 2

[1688] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1689] Conventional subscription management systems have the drawbacks of making it difficult to manage individual subscription information and sharing information among family members. Furthermore, there is a high risk of forgetting subscription renewal dates and incurring duplicate payments. Furthermore, proposals do not take into account the user's lifestyle or emotional state, making it difficult to select the optimal subscription for the user.

[1690] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1691] In this invention, the server includes means for inputting user information provided by the user, means for centrally managing subscription information, means for monitoring the update date of the subscription information and generating reminders, means for sharing the subscription information among family members, means for analyzing usage status and providing optimal subscription suggestions, means for understanding the emotional state of the user by analyzing facial expressions and tone of voice, and means for adjusting suggestions and notifications based on the emotional state. This enables centralized management of subscription information, update date reminders, information sharing among family members, optimal suggestions based on the analysis of usage status, and subscription suggestions based on the emotional state.

[1692] "User Information" means personal information provided by a User, such as name, email address, and password.

[1693] "Subscription information" is detailed information such as the name of the service to which the user has subscribed, the provider, the contract period, and the cost.

[1694] "Centrally managing" means integrating and managing multiple subscription information in a single system or interface.

[1695] "Monitoring renewal dates" means that the system periodically checks the renewal date of your subscription contract and notifies you a specific period in advance.

[1696] "Reminder" is a notification function that notifies users of important information or tasks in advance.

[1697] "Sharing information" means allowing family members and related parties to see each other's subscription information.

[1698] "Analyzing usage" means analyzing data on the frequency and patterns of users' subscription usage.

[1699] "Optimal subscription proposals" refers to providing users with the most suitable subscription plans and savings advice based on the analysis results.

[1700] "Analyzing facial expressions and tone of voice" refers to identifying the emotional state of a user by analyzing the movement of the user's facial muscles and the tone of their voice.

[1701] An "emotional state" refers to the emotions or moods that a user is currently experiencing.

[1702] "Adjust" means to change the content or method of a proposal or notification to suit specific conditions or circumstances.

[1703] This invention relates to a system that centrally manages subscription information provided by users, shares it among family members, and combines it with an emotion engine that recognizes the user's emotions. This system not only has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions, but also uses the emotion engine to make suggestions and notifications based on the user's emotions.

[1704] Hardware and software used

[1705] Terminal: A device used for input and display, such as a smartphone, tablet, or computer.

[1706] Server: A central management system that manages the database, analyzes data, generates reminders, and analyzes sentiment data.

[1707] OCR software: Optical character recognition software is used to extract text data from paper contracts and receipts.

[1708] Emotion engine: Software containing machine learning models for analyzing a user's facial expressions and tone of voice.

[1709] Encryption Algorithm: A cryptographic technique used to securely transmit a user's personal information.

[1710] System Overview

[1711] User Registration and Login

[1712] A user accesses an application or website and creates a new account by entering the required personal information, which is then encrypted on the device and sent to the server.

[1713] The server stores the received user information in a database and performs account activation procedures. Using the activated account, the user can access the system from the login screen.

[1714] Manage your subscription information

[1715] The user inputs the subscription information he or she has signed up for and transmits it to the server via the terminal.

[1716] The server stores the transmitted information in a database and generates and provides a dashboard for centralized management.

[1717] Automatically retrieve subscription information

[1718] Users take a photo of a paper contract or receipt with their smartphone and send the image to OCR software to extract the text data.

[1719] The extracted text data is sent from the device to the server, where it is analyzed and stored in a database. It is then notified so that it can be viewed on the device.

[1720] Contract Renewal Reminders

[1721] The server periodically checks the subscription information in the database and generates reminders when contract renewals are due.

[1722] The reminder is sent to the device and the user is notified.

[1723] Family sharing

[1724] Users register their family members in the system and set up subscription sharing, which is then sent from the device to the server and stored in a database.

[1725] Users (family members) can check shared subscription information and prevent duplicate spending.

[1726] Usage analysis and optimization suggestions

[1727] The server collects and analyzes subscription usage data to generate optimal plans and savings advice for users.

[1728] The terminal notifies the user of the optimization proposal.

[1729] Emotion Engine

[1730] The emotion engine analyzes the user's facial expressions and tone of voice to collect emotional data.

[1731] Emotional data is sent from the device to a server, where it is stored and analyzed with the user's consent.

[1732] The server then tailors suggestions and notifications based on the user's emotional state and sends them to the device. For example, if the user is feeling stressed, the server suggests services that can help them relax.

[1733] Specific examples

[1734] For example, suppose User A uses a "weekly magazine subscription" and a "music streaming service." User A can enter this service information into the app or scan a contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches. Additionally, while using the app, the emotion engine analyzes the user's facial expressions and detects stress. Based on this information, the server suggests a subscription to a "meditation app" to help them relax.

[1735] Prompt Sentence Examples

[1736] You are developing a system that manages user subscriptions and makes suggestions based on an emotional engine. The system provides a dashboard for users to register and manage various services. It also makes optimal service suggestions based on the user's emotional state. For example, if a user has a weekly magazine subscription and a music streaming service, the system will send renewal reminders and make new suggestions based on the user's emotional state. Please explain the specific process steps.

[1737] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1738] Step 1: User Registration

[1739] A user visits a website or application, enters personal information such as name, email address, password, etc. Once completed, the user clicks the submit button.

[1740] Input: User information (name, email address, password)

[1741] The terminal encrypts the input information and transmits it to the server.

[1742] The server stores the received information in a database and returns a response indicating that registration is complete to the terminal.

[1743] Output: Account registration completion notification

[1744] Step 2: Activate your account

[1745] The user checks the verification email sent to them and clicks on the account activation link.

[1746] Input: Click the link in the verification email

[1747] The server updates the account status to "activated."

[1748] Output: Activation status update notification

[1749] Step 3: Log in

[1750] The user logs in by entering the registered email address and password.

[1751] Input: Email address, password

[1752] The server checks the entered information against a database and redirects the user to the dashboard if authentication is successful.

[1753] Output: Dashboard access permissions

[1754] Step 4: Enter your subscription information

[1755] The user enters their subscription details, including the service name, provider, contract period, cost, etc.

[1756] Input: Subscription information (service name, provider, contract period, cost)

[1757] The terminal transmits the entered subscription information to the server.

[1758] The server stores the received information in a database and updates the dashboard.

[1759] Output: Updated dashboard

[1760] Step 5: Automatically retrieve subscription information

[1761] The user takes a photo of a paper contract or receipt using their smartphone camera.

[1762] Input: Image of contract or receipt

[1763] The device sends the captured image to OCR software, which extracts the text data.

[1764] Output: Extracted character data

[1765] The terminal transmits the extracted character data to the server.

[1766] The server analyzes the character data and stores it in a database as subscription information.

[1767] Output: Parsed subscription information

[1768] Step 6: Generate renewal reminders

[1769] The server periodically checks the subscription information in the database to detect information whose contract renewal date is approaching.

[1770] Input: Subscription information in the database

[1771] Output: Information that needs to be updated

[1772] The server generates a reminder based on the information that needs to be updated and sends it to the device.

[1773] The terminal displays a reminder notification to the user.

[1774] Output: Reminder notification

[1775] Step 7: Set up Family Sharing

[1776] Users enter information about their family members into the system and set up sharing of subscription information.

[1777] Input: Family member information, sharing settings

[1778] The terminal transmits the sharing setting information to the server.

[1779] The server stores the received shared setting information in a database.

[1780] Family members can view shared subscription information on their dashboard.

[1781] Output: Shared dashboard

[1782] Step 8: Usage analysis and optimization recommendations

[1783] The server collects subscription usage data and analyzes usage frequency and patterns.

[1784] Input: Subscription usage data

[1785] Output: Usage analysis results

[1786] The server generates optimal subscription plans and savings advice based on the analysis results and sends them to the device.

[1787] The terminal notifies the user of the optimization proposal.

[1788] Output: Optimization suggestion notification

[1789] Step 9: Leverage your emotional engine

[1790] While the user is using the app, the emotion engine analyzes facial expressions and tone of voice via the camera and microphone.

[1791] Input: facial expression data, tone of voice data

[1792] The terminal transmits the analyzed emotion data to the server.

[1793] The server analyzes the emotional data and understands the user's emotional state.

[1794] Output: Emotional state analysis results

[1795] The server tailors suggestions and notifications based on the emotional state and sends them to the device.

[1796] The device will display suggestions and notifications to the user based on their emotions, for example, suggesting services that will help them relax if they are feeling stressed.

[1797] Output: Adjusted proposal notification

[1798] (Application example 2)

[1799] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1800] Currently, many users use multiple subscription services, but are unable to efficiently manage their contract information, leading to problems such as missed renewal deadlines and duplicate contracts. Furthermore, the lack of a system that suggests optimal content based on a user's emotions and usage status makes it difficult to increase user satisfaction. Our goal is to solve these problems by enabling users to efficiently manage their subscriptions and enjoy optimal content tailored to their individual emotional state.

[1801] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1802] In this invention, the server includes a means for inputting subscription information provided by the user, a means for centrally managing the subscription information, a means for monitoring the renewal date of the subscription information and generating reminders, a means for sharing the subscription information among family members, a means for analyzing usage status and providing optimal subscription suggestions, and a means for analyzing the user's emotions and suggesting content based on the emotions. This allows the user to centrally manage subscriptions, not miss renewal deadlines, and share information among family members to avoid duplicate spending. Furthermore, by suggesting optimal content based on the user's emotional state, user satisfaction can be increased.

[1803] "Subscription information" indicates information about multiple services to which a user has subscribed, and includes details such as the service name, provider, contract period, and cost.

[1804] The "means for inputting" refers to a means by which a user registers subscription information in the system, and allows data input by keyboard input, voice input, or scanning.

[1805] "Means for centralized management" refers to means for centrally managing multiple subscription information using a single interface.

[1806] The "means for monitoring the renewal date and generating a reminder" is a means for periodically checking the contract renewal date of the subscription information and notifying the user when the expiration date approaches.

[1807] "Means for sharing among family members" refers to a means for sharing a user's subscription information among family members to avoid overlapping contracts.

[1808] "Means for analyzing usage and providing optimal subscription proposals" refers to means for collecting and analyzing users' subscription usage data and proposing optimal subscription plans based on the results.

[1809] The "means for analyzing emotions" is a means for acquiring emotional data from the user's facial expressions and voice and analyzing the emotional state.

[1810] The "means for suggesting content based on emotions" is a means for suggesting optimal subscription content (e.g., relaxing music or a meditation app) in response to the analyzed emotional state of the user.

[1811] The system for realizing this invention is composed of the following main components: A server, a user terminal, and an emotion engine work closely together to efficiently manage user subscription information and propose optimal content according to the user's emotional state.

[1812] Server Configuration

[1813] 1. The server receives subscription information input data provided by users and maintains a database for centralized management. It also has a function to monitor contract renewal dates and generate reminders when the renewal deadline approaches. This allows users to manage their subscriptions without forgetting to renew them.

[1814] 2. The server also has a management function for sharing user subscription information among family members. The family sharing function helps to avoid duplicate contracts and enables efficient management of household finances.

[1815] 3. The server also has the function of collecting users' subscription usage data and analyzing their usage patterns to propose the optimal subscription plan. This proposal is based on data such as usage frequency and cost performance, allowing users to enjoy maximum benefits.

[1816] User terminal configuration

[1817] 1. The user device (e.g., a smartphone) serves as an interface for the user to enter subscription information. The subscription information is sent from the device to a server and stored in a database. If the user uses a paper contract, character recognition software (e.g., OCR technology) is used to extract the data and automatically register the subscription information.

[1818] 2. The user device receives reminders and offers generated by the server and notifies the user, including contract renewal reminders and optimal subscription offers.

[1819] 3. The user device works in conjunction with the emotion engine to analyze the user's facial expressions and tone of voice to collect emotional data. The collected emotional data is sent to the server, which then suggests content based on the emotion analysis.

[1820] Emotion engine configuration

[1821] 1. The emotion engine analyzes the user's facial expressions and voice data to identify the user's emotional state. This analysis uses image processing and voice analysis technologies. The emotion engine can identify various emotional states, such as whether the user is stressed, relaxed, or enjoying themselves.

[1822] 2. The emotion engine connects with the user's device and sends the analysis results to the server, which uses this data to suggest optimal subscription content based on the user's emotional state.

[1823] Specific examples

[1824] For example, if a user feels like relaxing, the emotion engine analyzes the user's emotional state, and the server suggests optimal relaxation content (such as a music playlist or a meditation app). Also, if the user's subscription is nearing its renewal deadline, a server-generated reminder is sent to the user's device.

[1825] Example prompts for generative AI models

[1826] "If a user is feeling stressed, suggest subscription content that will help them relax. Suggestions could include a relaxing music playlist or a meditation app. Also, if a subscription is due for renewal soon, display a reminder."

[1827] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1828] Step 1:

[1829] User Registration and Login

[1830] What happens: A user creates an account by entering their name, email address, and password.

[1831] Input: The user enters their name, email address, and password.

[1832] Output: User information is saved on the server and an account verification email is sent.

[1833] Specific operation: When a user enters data into the form and presses the "Register" button, the data is encrypted and sent to the server, which stores it in a database and issues a verification email.

[1834] Step 2:

[1835] Entering subscription information and registration

[1836] Process: The user enters their subscription information through the application.

[1837] Input: Subscription information such as service name, provider, contract duration, and cost.

[1838] Output: The server stores this information in a database and displays it on a dashboard.

[1839] How it works: When a user enters information and presses the "Register" button, the data is sent to the server and stored in a database. The server retrieves this information and displays it on the user's dashboard.

[1840] Step 3:

[1841] Scanning paper contracts and character recognition

[1842] What it does: The user scans a paper contract or receipt and extracts the text data.

[1843] Input: scanned image data.

[1844] Output: Character recognition software extracts the character data and sends it to the server as subscription information.

[1845] Specific operation: When a user uses the scan function within the app and takes a picture of a contract with their camera, the image is processed by an OCR engine (such as Tesseract) and the extracted text data is sent to the server.

[1846] Step 4:

[1847] Contract renewal reminder generation and notification

[1848] What happens: The server periodically checks the contract renewal date and generates a reminder.

[1849] Input: Contract expiration date stored in the database.

[1850] Output: When the renewal date approaches, a reminder notification will be sent to the user's device.

[1851] How it works: The server periodically checks the date and generates reminders for subscriptions that are approaching their expiration date. The reminder information is then sent to the user's device via push notification.

[1852] Step 5:

[1853] Sharing subscription information between family members

[1854] What it does: Set up sharing of subscription information between family members.

[1855] Input: Family member's account information.

[1856] Output: The shared subscription information will be displayed on other family members' dashboards.

[1857] Specific operation: When a user enters the information of family members into the system and the server stores the information in the database, the sharing setup is complete. Family members can view the shared information on their dashboard.

[1858] Step 6:

[1859] Analysis of usage status and optimization proposals

[1860] What it does: The server collects user subscription usage data and analyzes usage frequency and patterns.

[1861] Input: Subscription usage data.

[1862] Output: Best subscription plans and savings advice.

[1863] Specific operation: The server analyzes the collected data, identifies the user's usage patterns, and generates optimal suggestions. The contents of the suggestions are sent to the user's device as a notification.

[1864] Step 7:

[1865] User emotion analysis and emotion-based suggestions

[1866] Processing content: The user device uses the emotion engine to analyze the user's emotions.

[1867] Input: Emotional data such as the user's facial expressions and tone of voice.

[1868] Output: Content suggestions based on emotional state.

[1869] Specific operation: The user's device captures the user's facial expressions and voice, and analyzes them using the emotion engine. The analysis results are sent to the server, which then suggests content appropriate to the user's emotional state (such as a relaxing music playlist).

[1870] Example prompts for generative AI models

[1871] "If a user is feeling stressed, suggest subscription content that will help them relax. Suggestions could include a relaxing music playlist or a meditation app. Also, if a subscription is due for renewal soon, display a reminder."

[1872] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1873] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1874] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1875] [Fourth embodiment]

[1876] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1877] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1878] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1879] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1880] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1881] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1882] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1883] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1884] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1885] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1886] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1887] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1888] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1889] This invention relates to a system that centrally manages subscription information provided by users and enables it to be shared among family members. This system has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions.

[1890] System Overview

[1891] User Registration and Login

[1892] A user first accesses an application or website and creates a new account by entering required information such as name, email address, and password. The information entered by the user is encrypted for security purposes and sent from the device to the server.

[1893] The server saves the received information in a database and returns a response indicating that the information was saved successfully to the terminal. The user then checks the authentication email sent at this time and clicks on the link to activate the account.

[1894] The user accesses the login screen with an activated account and logs in by entering their email address and password. Authentication is performed on the server, and if successful, the user can access the dashboard.

[1895] Manage your subscription information

[1896] Users can input various subscription information (service name, provider, contract period, cost, etc.) that they have signed up for. This information is sent to the server via the terminal and stored in a database.

[1897] Based on the entered subscription information, the server generates an interface for centralized management on the dashboard and provides it to the user.

[1898] Automatically retrieve subscription information

[1899] Users can take a photo of a paper contract or receipt using the app's scanning function, and the image is sent to character recognition software (OCR) by the device, where text data is extracted.

[1900] The server analyzes the extracted character data and stores it in the database as appropriate subscription information. After storing it, it sends a confirmation notice to the user so that the user can confirm it.

[1901] Contract Renewal Reminders

[1902] The server monitors the contract renewal date in the database and generates a reminder a pre-set period before the contract renewal date, thereby notifying the user before the contract renewal date.

[1903] The device will receive the reminder and display a notification to the user, so that the user does not miss the timing of automatic renewal or contract renewal.

[1904] Family sharing

[1905] Users register their family members' accounts in the system and set up specific subscription sharing settings, which are then sent from the device to the server and stored in a database.

[1906] Users (family members) can view shared subscription information on their own dashboard, which helps prevent duplicate spending between family members.

[1907] Usage analysis and optimization suggestions

[1908] The server collects subscription usage data from users and analyzes their usage frequency and patterns, based on which it generates optimal subscription plans and savings advice for users.

[1909] The terminal receives optimization suggestions from the server and notifies the user, who can then review the suggestions and take necessary actions.

[1910] Specific examples

[1911] For example, suppose User A uses a "regular food delivery service" and a "video streaming service." User A can enter the service information into the app or scan the contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches.

[1912] Furthermore, when User A registers and shares information about his family members, it becomes clear that Family B has a duplicate subscription to the same "video streaming service." The system then presents User A with optimization suggestions to avoid this duplicate subscription, allowing User A to adjust the subscription details with Family B accordingly.

[1913] This allows User A and his family to use the subscription service more efficiently and economically.

[1914] The processing flow will be explained below.

[1915] User Registration and Login

[1916] Step 1:

[1917] The user accesses the application or website and enters the required information (name, email address, password) on the new registration screen.

[1918] Step 2:

[1919] The device sends the entered information to the server, where the user's password is hashed in a secure manner.

[1920] Step 3:

[1921] The server validates the received information to ensure its validity, and if validation is successful, stores the user information in the database.

[1922] Step 4:

[1923] The server generates a successful registration response and sends it to the device. The user opens the authentication email sent to them and clicks the authentication link to activate their account.

[1924] Step 5:

[1925] The user accesses the login screen again with the activated account and logs in by entering their email address and password.

[1926] Step 6:

[1927] The terminal transmits the entered login information to the server.

[1928] Step 7:

[1929] The server validates the login information and confirms that the user exists. If successful, it creates a session and sends a success response back to the terminal.

[1930] Manage your subscription information

[1931] Step 1:

[1932] The user enters subscription information (service name, provider, contract period, cost, etc.) on the app's subscription addition screen.

[1933] Step 2:

[1934] The terminal transmits the entered subscription information to the server.

[1935] Step 3:

[1936] The server stores the received information in a database, and if the storage is successful, returns a confirmation response to the terminal.

[1937] Automatically retrieve subscription information

[1938] Step 1:

[1939] Users can take a photo of a paper contract or receipt using the app's scanning function.

[1940] Step 2:

[1941] The device sends the captured image to an OCR engine and extracts the text data.

[1942] Step 3:

[1943] The server analyzes the character data received from the OCR engine and identifies the subscription information.

[1944] Step 4:

[1945] The server stores the identified subscription information in a database and sends a confirmation to the user.

[1946] Contract Renewal Reminders

[1947] Step 1:

[1948] The server periodically checks the contract renewal date of the subscription information in the database.

[1949] Step 2:

[1950] The server generates reminders when contract renewal dates approach.

[1951] Step 3:

[1952] The terminal receives the reminder notification from the server and displays the notification to the user.

[1953] Family sharing

[1954] Step 1:

[1955] Users register their family members' accounts in the app and set up sharing of subscription information.

[1956] Step 2:

[1957] The terminal transmits the setting information to the server.

[1958] Step 3:

[1959] The server stores the received sharing settings in a database and sends a notification to the family members with whom the sharing is intended.

[1960] Step 4:

[1961] Users (family members) can view and manage shared subscription information on their own dashboard.

[1962] Usage analysis and optimization suggestions

[1963] Step 1:

[1964] The server collects users' subscription usage data and analyzes their usage frequency and spending patterns.

[1965] Step 2:

[1966] The server generates optimal subscription plans and savings advice based on the analysis results.

[1967] Step 3:

[1968] The terminal notifies the user of the optimization proposal received from the server, and the user can check the proposal and take necessary actions.

[1969] In this way, specific operations are performed at each step, allowing the user to manage subscription information efficiently and optimally.

[1970] Example 1

[1971] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1972] With conventional subscription management systems, each user had to manage their contract information individually, making it difficult to keep track of contract renewal dates and share information among family members. It was also difficult to digitally acquire and properly manage information from paper contracts and receipts, making it difficult to analyze usage patterns and propose optimal subscription plans. Furthermore, the security and centralized data management required to solve these problems were not adequately considered.

[1973] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1974] In this invention, the server includes means for having a user enter registration information and encrypting it for security before transmitting it to the server, means for the server to store the received information in a database, send an authentication email, and have the user activate their account, means for the server to authenticate the user's account and, if successful, allow the user to access the dashboard, means for centrally managing subscription information, means for monitoring the update date of the subscription information and generating reminders, means for sharing the subscription information among family members, means for analyzing usage patterns and providing optimal subscription proposals, means for scanning paper contracts and receipts and extracting text data, and means for analyzing the extracted text data and identifying subscription information. This allows users to centrally manage contract information, avoid duplicate spending among family members, and receive optimal subscription proposals.

[1975] "User" refers to an individual or entity that uses the System to register, manage, and share subscription information.

[1976] "Subscription information" is information related to the subscription service to which the user has subscribed, and includes details such as the service name, provider, contract period, and cost.

[1977] "Server" refers to a computer resource that receives information sent from users, stores it in a database, manages it, and analyzes it.

[1978] "Terminal" refers to a device, such as a computer or smartphone, that a user uses to access the system.

[1979] "Database" means a collection of information for securely storing and managing user and subscription information.

[1980] "Encryption" refers to the process of transforming data using a specific algorithm to protect the contents of the information from third parties.

[1981] "Verification Email" means an email sent to a user to validate their account registration, which includes an authentication link.

[1982] "Reminder" refers to a message from the system that notifies users in advance of important deadlines, such as contract renewal dates.

[1983] "OCR" stands for Optical Character Recognition, a technology that reads characters from images or scanned documents and converts them into digital data.

[1984] "Dashboard" means a web or application interface that allows a User to manage and view their subscription information at a glance.

[1985] "Duplicate spending" refers to wasteful spending resulting from multiple contracts for the same subscription service within a household.

[1986] "Usage analysis" refers to the process of analyzing usage trends and patterns based on user subscription service usage data.

[1987] "Optimal subscription proposal" refers to recommending the most effective and economical subscription plan to a user based on an analysis of usage.

[1988] This invention provides a system that centrally manages subscription information provided by users and allows it to be shared among family members. This system has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions. A specific embodiment of this system is described below.

[1989] User Registration and Login

[1990] A user accesses an application or website and creates a new account by entering the required information, such as name, email address, and password. The information entered by the user is encrypted using RSA encryption technology for security purposes and sent from the device to the server.

[1991] The server saves the received information in a database (e.g., MySQL) and returns a response indicating that the information was saved successfully to the terminal. The user checks the authentication email sent at this time and clicks on the link to activate the account.

[1992] With an activated account, the user accesses the login screen and enters their email address and password to log in. Authentication is performed by the server, and if successful, the user is given access to the dashboard.

[1993] Manage your subscription information

[1994] The user inputs the various subscription information (service name, provider, contract period, cost, etc.) that they have signed up for. This information is sent to the server via the terminal and stored in a database.

[1995] Based on the entered subscription information, the server generates an interface for centralized management on the dashboard and provides it to the user.

[1996] Automatically retrieve subscription information

[1997] Users can take a photo of a paper contract or receipt using the app's scanning function, and the captured image is sent to character recognition software (OCR, e.g., Tesseract OCR library) by the device, where text data is extracted.

[1998] The server analyzes the extracted character data and stores it in the database as appropriate subscription information. After storing it, it sends a confirmation notice to the user so that the user can confirm it.

[1999] Contract Renewal Reminders

[2000] The server monitors the contract renewal date in the database and generates a reminder a pre-set period before the contract renewal date, thereby notifying the user before the contract renewal date.

[2001] The device will receive the reminder and display a notification to the user, so that the user does not miss the timing of automatic renewal or contract renewal.

[2002] Family sharing

[2003] Users register their family members' accounts in the system and set up specific subscription sharing settings, which are then sent from the device to the server and stored in a database.

[2004] Users (family members) can view shared subscription information on their own dashboard, which helps prevent duplicate spending between family members.

[2005] Usage analysis and optimization suggestions

[2006] The server collects subscription usage data from users and analyzes their usage frequency and patterns, based on which it generates optimal subscription plans and savings advice for users.

[2007] The terminal receives optimization suggestions from the server and notifies the user, who can then review the suggestions and take necessary actions.

[2008] Specific examples

[2009] For example, suppose User A uses a "regular food delivery service" and a "video streaming service." User A can enter the service information into the app or scan the contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches.

[2010] Furthermore, when User A registers and shares information about his family members, it becomes clear that Family B has a duplicate subscription to the same "video streaming service." The system then presents User A with optimization suggestions to avoid this duplicate subscription, allowing User A to adjust the subscription details with Family B accordingly.

[2011] This allows User A and his family to use the subscription service more efficiently and economically.

[2012] Example prompts for generative AI models

[2013] "Please create a program that allows users to register and manage subscription information and share it with their family members. Please include a function that allows users to enter or scan information about the services they subscribe to, a function that generates and notifies them of subscription renewal reminders, a function that allows information to be shared among family members, and a function that analyzes usage and makes optimization suggestions."

[2014] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2015] Step 1:

[2016] To create a new account, a user enters their name, email address, and password and submits the data to the server.

[2017] Input: Name, Email Address, Password

[2018] Processing: The terminal encrypts the entered information using RSA encryption technology and sends it to the server.

[2019] Output: Encrypted user information

[2020] Step 2:

[2021] The server stores the encrypted user information it receives in a database.

[2022] Input: Encrypted user information

[2023] Processing: The server saves the user information in a database (e.g. MySQL) and sends a verification email to the user.

[2024] Output: Verification email

[2025] Step 3:

[2026] The user clicks the link in the verification email to activate their account.

[2027] Input:Authentication link

[2028] Processing: The server receives the link and updates the user account to an activated status.

[2029] Output: Activated accounts

[2030] Step 4:

[2031] The user enters their email address and password on the login screen and sends them to the server.

[2032] Input: Email address, password

[2033] Processing: The server performs authentication and, if successful, displays the dashboard to the user.

[2034] Output: Dashboard access

[2035] Step 5:

[2036] The user enters subscription information (service name, provider, contract period, cost) and sends it to the server.

[2037] Input: Subscription information

[2038] Processing: The terminal inputs information and sends it to the server, which stores the received information in a database.

[2039] Output: Saved subscription information

[2040] Step 6:

[2041] The server generates the dashboard interface and provides it to the user.

[2042] Input: Saved subscription information

[2043] Processing: The server retrieves information from the database and generates the dashboard interface.

[2044] Output: Dashboard interface

[2045] Step 7:

[2046] The user takes a photo of a paper contract or receipt using the app's scanning function and sends it to the device.

[2047] Input: A photograph of a contract or receipt

[2048] Processing: The device extracts character data using OCR (Optical Character Recognition) technology.

[2049] Output: Extracted character data

[2050] Step 8:

[2051] The terminal transmits the extracted character data to the server, which analyzes it to identify subscription information.

[2052] Input: Extracted character data

[2053] Processing: The server parses the character data, recognizes it as subscription information, and stores it in the database.

[2054] Output: Identified subscription information

[2055] Step 9:

[2056] The server monitors the database for renewal dates and generates reminders as needed.

[2057] Input: Database contract information

[2058] Processing: The server periodically checks the contract renewal date and generates a reminder notification when the renewal date approaches.

[2059] Output: Reminder notification

[2060] Step 10:

[2061] The device receives the reminder notification and displays the notification to the user.

[2062] Input: Reminder

[2063] Processing: The device displays a notification to the user, who checks the notification and takes the necessary action.

[2064] Output: The notification displayed to the user

[2065] Step 11:

[2066] The user registers family member accounts in the system and sets up subscription information sharing among family members.

[2067] Input: Family member information, shared subscription information

[2068] Processing: The device sends the information to the server, which stores it in a database.

[2069] Output: Shared subscription information

[2070] Step 12:

[2071] Family members can view the shared subscription information on their dashboard.

[2072] Input: Shared subscription information

[2073] Processing: The server retrieves information from the database and reflects it on the family member's dashboard.

[2074] Output: Shared information displayed on family member's dashboard

[2075] Step 13:

[2076] The server collects user subscription usage data and analyzes usage frequency and patterns.

[2077] Input: Subscription usage data

[2078] Processing: The server analyzes the data to identify usage patterns and frequencies.

[2079] Output: Analysis results

[2080] Step 14:

[2081] The server generates optimal subscription plans and savings advice based on the analysis results.

[2082] Input: Analysis results

[2083] Processing: The server generates the optimal plan or advice for the user.

[2084] Output: Optimization suggestions

[2085] Step 15:

[2086] The terminal receives the optimization proposal and notifies the user.

[2087] Input: Optimization proposal

[2088] Processing: The terminal notifies the user of the proposal so that the user can confirm it.

[2089] Output: The suggestion sent to the user

[2090] (Application example 1)

[2091] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2092] Conventional subscription management systems make it difficult to centrally manage information about various subscriptions subscribed to by users, and lack reminder functions and functions for sharing information among family members, which leads to problems such as duplicate contracts and wasteful spending. Furthermore, updating and managing contract information is particularly cumbersome for services used daily, such as food delivery services, and efficient management is required.

[2093] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2094] In this invention, the server includes: a means for inputting subscription information provided by the user; a means for centrally managing the subscription information; a means for monitoring the renewal date of the subscription information and generating reminders; a means for sharing the subscription information among family members; a means for analyzing usage and providing optimal subscription proposals; a means for registering and managing subscription information for food delivery services; a means for the user to scan a paper contract and extract text data using OCR; a means for identifying the extracted text data as subscription information; and a means for notifying a smart device of a reminder when the contract renewal date approaches. This allows users to centrally manage the various subscription information they have subscribed to, receive reminders when the renewal date approaches, and avoid duplicate subscriptions by sharing information among family members. Furthermore, analyzing usage and receiving optimal subscription proposals allows users to use services efficiently and economically.

[2095] "User" means a user of the system who registers, manages, and shares subscription information and receives reminders and suggestions.

[2096] "Subscription information" is information about various services to which a user has subscribed, and includes the service name, provider, contract period, cost, etc.

[2097] "Centralized management" means that multiple subscription information is managed uniformly on one system.

[2098] "Reminder" is a function that notifies users when their subscription renewal date is approaching.

[2099] "Family information sharing" is a feature that allows family members who use the same system to view and share each other's subscription information.

[2100] "Usage analysis" means analyzing usage data of subscription services for which a user has signed up to evaluate frequency and patterns of use.

[2101] "Optimal subscription proposals" are proposals that present the most appropriate and economical subscription plans and saving methods for users based on an analysis of usage.

[2102] A "food delivery service" is a service that delivers ingredients and meals ordered online to a specified location.

[2103] "OCR" is an abbreviation for optical character recognition, a technology that extracts character information from image data.

[2104] "Smart devices" refer to intelligent devices with internet connectivity, such as smartphones, smart glasses, and head-mounted displays.

[2105] The system for implementing this invention is designed to enable users to efficiently use food delivery services by registering, managing, and sharing subscription information and providing reminders and optimal suggestions.

[2106] composition

[2107] The system consists of the following main components:

[2108] 1. Server

[2109] 2. Terminals (smartphones, smart glasses, other smart devices)

[2110] 3. OCR Software

[2111] 4. Database

[2112] 5. Notification System

[2113] User Registration and Login

[2114] First, the user creates a new account by entering necessary information such as name, email address, and password on the device.

[2115] The terminal sends the encrypted user information to the server, which stores it in a database.

[2116] The user checks the verification email sent to them and clicks the link to activate their account, after which they can log in.

[2117] Manage your subscription information

[2118] Enter the subscription information (service name, provider, contract period, cost, etc.) for the food delivery service to which the user has subscribed.

[2119] The terminal sends this information to the server, which stores it in a database.

[2120] Automatically retrieve subscription information

[2121] A user scans a paper contract with a smartphone app, and the scanned image is converted into text data by OCR software.

[2122] The server analyzes this character data and stores it in a database as subscription information.

[2123] Contract Renewal Reminders

[2124] The server monitors contract renewal dates in the database and generates reminders before a pre-set period.

[2125] The device will receive this reminder and display a notification to the user.

[2126] Family sharing

[2127] The user registers accounts for family members and sets up shared subscription information.

[2128] The server stores this setting information in a database, allowing information to be shared among family members.

[2129] Usage analysis and optimization suggestions

[2130] The server collects subscription usage data and analyzes usage patterns.

[2131] Based on the results of this analysis, the server generates and notifies the user of the optimal subscription plan and savings proposals.

[2132] Specific examples

[2133] For example, when a user scans a "Food Subscription" contract with a smartphone app, the information is read using OCR and automatically registered in the app. Then, when the contract renewal date approaches, a reminder notification pops up on the smart glasses.

[2134] Example prompts to input to a generative AI model

[2135] Prompt: How can I develop an application that scans my "food subscription" contract and notifies me when it's due for renewal?

[2136] This allows users to manage and use food delivery services efficiently and economically.

[2137] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2138] Step 1:

[2139] A user launches the smartphone app and creates a new account by entering required information such as name, email address, and password.

[2140] Input: Name, email address, and password entered by the user.

[2141] Data processing: The terminal encrypts the entered password for security purposes.

[2142] Output: Sends the encrypted password, name, and email address to the server.

[2143] Step 2:

[2144] The server stores the received user information in a database and returns a response to the terminal indicating that the information has been successfully stored.

[2145] Input: Encrypted password, name, and email address sent from your device.

[2146] Data processing: The server stores this information in a database.

[2147] Output: Returns a save completion response to the terminal.

[2148] Step 3:

[2149] The user checks the verification email sent to them and clicks on the link to activate their account.

[2150] Input: Click the link in the verification email.

[2151] Data processing: The server activates the user's account.

[2152] Output: Account activation notification.

[2153] Step 4:

[2154] Users log in with an activated account and enter their subscription information.

[2155] Input: Subscription information (service name, provider, contract period, cost, etc.).

[2156] Data processing: The device sends the entered information to the server.

[2157] Output: Submits subscription information to the server.

[2158] Step 5:

[2159] The server stores the submitted subscription information in a database and generates a dashboard based on it.

[2160] Input: Subscription information sent from the device.

[2161] Data processing: The server stores subscription information in a database and generates a dashboard.

[2162] Output: Sends the updated dashboard to the device.

[2163] Step 6:

[2164] The user scans the contract with a smartphone app, and the OCR software extracts the text data.

[2165] Input: Scanned contract image data.

[2166] Data processing: OCR software extracts text information from image data.

[2167] Output: The extracted character data is sent to the server.

[2168] Step 7:

[2169] The server analyzes the character data received from the OCR software and stores it in a database as subscription information.

[2170] Input: The extracted character data.

[2171] Data processing: The server parses the text data and formats it as subscription information.

[2172] Output: Formatted subscription information stored in the database.

[2173] Step 8:

[2174] The server monitors contract renewal dates in the database and generates reminders before a pre-set period.

[2175] Input: Subscription information in the database.

[2176] Data processing: The server checks the contract renewal date and generates a reminder.

[2177] Output: Send reminder notification to device.

[2178] Step 9:

[2179] The terminal receives the generated reminder and displays a notification to the user.

[2180] Input: Reminder notification sent from the server.

[2181] Data processing: The device displays reminder notifications.

[2182] Output: Notify the user of the reminder.

[2183] Step 10:

[2184] The user registers accounts for family members and sets up sharing of subscription information.

[2185] Input: Family member's account information.

[2186] Data processing: The device sends the share setting information to the server.

[2187] Output: Sends shared configuration information to the server.

[2188] Step 11:

[2189] The server stores the shared setting information in a database and shares the subscription information among family members.

[2190] Input: Shared configuration information.

[2191] Data processing: The server stores the shared setting information in a database and checks the integrity of the shared information.

[2192] Output: Sharing subscription information between family members.

[2193] Step 12:

[2194] The server collects subscription usage data, analyzes it, and generates optimal offers for users.

[2195] Input: Subscription usage data.

[2196] Data processing: The server analyzes usage patterns and generates optimal plans and savings proposals.

[2197] Output: Notify the device of the suggestion.

[2198] Step 13:

[2199] The terminal notifies the user of the optimization proposal received from the server, and the user confirms it.

[2200] Input: Optimization suggestions sent by the server.

[2201] Data processing: The device will display optimization suggestions.

[2202] Output: Notify user of optimization suggestions.

[2203] The above is the specific processing flow of the program of the system that realizes the application example.

[2204] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2205] This invention relates to a system that centrally manages subscription information provided by users, shares it among family members, and combines it with an emotion engine that recognizes the user's emotions. This system not only has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions, but also uses the emotion engine to make suggestions and notifications based on the user's emotions.

[2206] System Overview

[2207] User Registration and Login

[2208] A user accesses an application or website and creates a new account by entering required information such as name, email address, and password. The information entered by the user is encrypted for security purposes and sent from the device to the server.

[2209] The server saves the received information in its database and returns a response indicating successful saving to the terminal. The user checks the authentication email sent and clicks on the link to activate their account.

[2210] The user accesses the login screen with an activated account and logs in by entering their email address and password. Authentication is performed on the server, and if successful, the user can access the dashboard.

[2211] Manage your subscription information

[2212] Users can input various subscription information (service name, provider, contract period, cost, etc.) that they have signed up for. This information is sent to the server via the terminal and stored in a database.

[2213] Based on the entered subscription information, the server generates an interface for centralized management on the dashboard and provides it to the user.

[2214] Automatically retrieve subscription information

[2215] Users can take a photo of a paper contract or receipt using the app's scanning function, and the image is sent to character recognition software (OCR) by the device, where text data is extracted.

[2216] The server analyzes the extracted character data and stores it in the database as appropriate subscription information. After storing it, it sends a confirmation notice to the user so that the user can confirm it.

[2217] Contract Renewal Reminders

[2218] The server periodically checks the contract renewal date in the database and generates a reminder a pre-set period before the contract renewal date, thereby notifying the user before the contract renewal date.

[2219] The device will receive the reminder and display a notification to the user, so that the user does not miss the timing of automatic renewal or contract renewal.

[2220] Family sharing

[2221] Users register their family members' accounts in the system and set up specific subscription sharing settings, which are then sent from the device to the server and stored in a database.

[2222] Users (family members) can view shared subscription information on their own dashboard, which helps prevent duplicate spending between family members.

[2223] Usage analysis and optimization suggestions

[2224] The server collects subscription usage data from users and analyzes their usage frequency and patterns, based on which it generates optimal subscription plans and savings advice for users.

[2225] The terminal receives optimization suggestions from the server and notifies the user, who can then review the suggestions and take necessary actions.

[2226] Emotion Engine

[2227] When a user uses the app, the emotion engine analyzes the user's facial expressions and tone of voice to collect emotional data.

[2228] The device transmits emotion data to the server, which collects the emotion data with the user's consent.

[2229] The server analyzes the emotional data to understand the user's emotional state and uses this emotional data to tailor the content of subscription offers and notification methods.

[2230] The device displays subscription suggestions and notifications tailored to the user by the emotion engine, for example, suggesting relaxing entertainment services if the user is feeling stressed.

[2231] Specific examples

[2232] For example, suppose User A uses a "weekly magazine subscription" and a "music streaming service." User A can enter the service information into the app or scan the contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches.

[2233] Additionally, while User A is using the app, the emotion engine reads the user's facial expressions and detects that the user is feeling stressed. The server uses this information to suggest a subscription to a "meditation app" that can help the user relax. User A can accept this suggestion and enjoy customized suggestions based on their emotional state.

[2234] In this way, we will create a system that streamlines user subscription management and provides optimal emotional suggestions, enriching users' lives.

[2235] The processing flow will be explained below.

[2236] User Registration and Login

[2237] Step 1:

[2238] The user accesses the application or website and enters the required information (name, email address, password) on the new registration screen.

[2239] Step 2:

[2240] The device sends the entered information to the server, where the password is hashed to ensure security.

[2241] Step 3:

[2242] The server validates the received information and if validation is successful, saves the user information in the database.

[2243] Step 4:

[2244] The server generates a successful registration response and sends it to the device. The user opens the authentication email sent to them and clicks the authentication link to activate their account.

[2245] Step 5:

[2246] The user accesses the login screen again with the activated account and logs in by entering their email address and password.

[2247] Step 6:

[2248] The terminal transmits the entered login information to the server.

[2249] Step 7:

[2250] The server validates the login information and confirms that the user exists. If successful, it creates a session and sends a success response back to the terminal.

[2251] Manage your subscription information

[2252] Step 1:

[2253] The user enters subscription information (service name, provider, contract period, cost, etc.) on the app's subscription addition screen.

[2254] Step 2:

[2255] The terminal transmits the entered subscription information to the server.

[2256] Step 3:

[2257] The server stores the received information in a database, and if the storage is successful, returns a confirmation response to the terminal.

[2258] Automatically retrieve subscription information

[2259] Step 1:

[2260] Users can take a photo of a paper contract or receipt using the app's scanning function.

[2261] Step 2:

[2262] The device sends the captured image to an OCR engine to extract the text data.

[2263] Step 3:

[2264] The server analyzes the character data received from the OCR engine and identifies the subscription information.

[2265] Step 4:

[2266] The server stores the identified subscription information in a database and sends a confirmation to the user.

[2267] Contract Renewal Reminders

[2268] Step 1:

[2269] The server periodically checks the contract renewal date of the subscription information in the database.

[2270] Step 2:

[2271] The server generates reminders when contract renewal dates approach.

[2272] Step 3:

[2273] The terminal receives the reminder notification from the server and displays the notification to the user.

[2274] Family sharing

[2275] Step 1:

[2276] Users register their family members' accounts in the app and set up sharing of subscription information.

[2277] Step 2:

[2278] The terminal transmits the setting information to the server.

[2279] Step 3:

[2280] The server stores the received sharing settings in a database and sends a notification to the family members with whom the sharing is intended.

[2281] Step 4:

[2282] Users (family members) can view and manage shared subscription information on their own dashboard.

[2283] Usage analysis and optimization suggestions

[2284] Step 1:

[2285] The server collects users' subscription usage data and analyzes their usage frequency and spending patterns.

[2286] Step 2:

[2287] The server generates optimal subscription plans and savings advice based on the analysis results.

[2288] Step 3:

[2289] The terminal notifies the user of the optimization proposal received from the server, and the user can check the proposal and take necessary actions.

[2290] Emotion Engine

[2291] Step 1:

[2292] When a user uses the app, the device uses an emotion engine to analyze the user's facial expressions and tone of voice to collect emotional data. The emotion engine works via the camera and microphone.

[2293] Step 2:

[2294] The device then formats the collected emotion data appropriately and sends it to the server. The emotion data is encrypted to protect the user's privacy.

[2295] Step 3:

[2296] The server analyzes the received emotion data and identifies the user's emotional state, which can be classified as joy, sadness, stress, excitement, etc.

[2297] Step 4:

[2298] The server takes emotional data into account to tailor subscription suggestions and notifications, for example generating suggestions for relaxing entertainment services if the user is feeling stressed.

[2299] Step 5:

[2300] The device displays suggestions and notifications tailored by the emotion engine to the user, who can then review the suggestions and accept them if necessary.

[2301] Specific examples

[2302] For example, suppose User B uses a "music streaming service" and an "online fitness service." User B can enter their subscription information into the app or scan their contract to automatically obtain the information. The server then centrally manages this information and sends reminders when the renewal date approaches.

[2303] Additionally, while User B is using the app, the emotion engine reads the user's facial expressions and detects "stress." Based on this information, the server suggests subscribing to a "meditation app" to help them relax. This suggestion is displayed on User B's device, and User B may be able to confirm the suggestion and accept it if necessary.

[2304] In this way, the system streamlines users' subscription management and provides optimal emotional recommendations, enriching their lives.

[2305] Example 2

[2306] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2307] Conventional subscription management systems have the drawbacks of making it difficult to manage individual subscription information and sharing information among family members. Furthermore, there is a high risk of forgetting subscription renewal dates and incurring duplicate payments. Furthermore, proposals do not take into account the user's lifestyle or emotional state, making it difficult to select the optimal subscription for the user.

[2308] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2309] In this invention, the server includes means for inputting user information provided by the user, means for centrally managing subscription information, means for monitoring the update date of the subscription information and generating reminders, means for sharing the subscription information among family members, means for analyzing usage status and providing optimal subscription suggestions, means for understanding the emotional state of the user by analyzing facial expressions and tone of voice, and means for adjusting suggestions and notifications based on the emotional state. This enables centralized management of subscription information, update date reminders, information sharing among family members, optimal suggestions based on the analysis of usage status, and subscription suggestions based on the emotional state.

[2310] "User Information" means personal information provided by a User, such as name, email address, and password.

[2311] "Subscription information" is detailed information such as the name of the service to which the user has subscribed, the provider, the contract period, and the cost.

[2312] "Centrally managing" means integrating and managing multiple subscription information in a single system or interface.

[2313] "Monitoring renewal dates" means that the system periodically checks the renewal date of your subscription contract and notifies you a specific period in advance.

[2314] "Reminder" is a notification function that notifies users of important information or tasks in advance.

[2315] "Sharing information" means allowing family members and related parties to see each other's subscription information.

[2316] "Analyzing usage" means analyzing data on the frequency and patterns of users' subscription usage.

[2317] "Optimal subscription proposals" refers to providing users with the most suitable subscription plans and savings advice based on the analysis results.

[2318] "Analyzing facial expressions and tone of voice" refers to identifying the emotional state of a user by analyzing the movement of the user's facial muscles and the tone of their voice.

[2319] An "emotional state" refers to the emotions or moods that a user is currently experiencing.

[2320] "Adjust" means to change the content or method of a proposal or notification to suit specific conditions or circumstances.

[2321] This invention relates to a system that centrally manages subscription information provided by users, shares it among family members, and combines it with an emotion engine that recognizes the user's emotions. This system not only has functions for registering subscription information, generating reminders, sharing information among family members, analyzing usage patterns, and making optimal suggestions, but also uses the emotion engine to make suggestions and notifications based on the user's emotions.

[2322] Hardware and software used

[2323] Terminal: A device used for input and display, such as a smartphone, tablet, or computer.

[2324] Server: A central management system that manages the database, analyzes data, generates reminders, and analyzes sentiment data.

[2325] OCR software: Optical character recognition software is used to extract text data from paper contracts and receipts.

[2326] Emotion engine: Software containing machine learning models for analyzing a user's facial expressions and tone of voice.

[2327] Encryption Algorithm: A cryptographic technique used to securely transmit a user's personal information.

[2328] System Overview

[2329] User Registration and Login

[2330] A user accesses an application or website and creates a new account by entering the required personal information, which is then encrypted on the device and sent to the server.

[2331] The server stores the received user information in a database and performs account activation procedures. Using the activated account, the user can access the system from the login screen.

[2332] Manage your subscription information

[2333] The user inputs the subscription information he or she has signed up for and transmits it to the server via the terminal.

[2334] The server stores the transmitted information in a database and generates and provides a dashboard for centralized management.

[2335] Automatically retrieve subscription information

[2336] Users take a photo of a paper contract or receipt with their smartphone and send the image to OCR software to extract the text data.

[2337] The extracted text data is sent from the device to the server, where it is analyzed and stored in a database. It is then notified so that it can be viewed on the device.

[2338] Contract Renewal Reminders

[2339] The server periodically checks the subscription information in the database and generates reminders when contract renewals are due.

[2340] The reminder is sent to the device and the user is notified.

[2341] Family sharing

[2342] Users register their family members in the system and set up subscription sharing, which is then sent from the device to the server and stored in a database.

[2343] Users (family members) can check shared subscription information and prevent duplicate spending.

[2344] Usage analysis and optimization suggestions

[2345] The server collects and analyzes subscription usage data to generate optimal plans and savings advice for users.

[2346] The terminal notifies the user of the optimization proposal.

[2347] Emotion Engine

[2348] The emotion engine analyzes the user's facial expressions and tone of voice to collect emotional data.

[2349] Emotional data is sent from the device to a server, where it is stored and analyzed with the user's consent.

[2350] The server then tailors suggestions and notifications based on the user's emotional state and sends them to the device. For example, if the user is feeling stressed, the server suggests services that can help them relax.

[2351] Specific examples

[2352] For example, suppose User A uses a "weekly magazine subscription" and a "music streaming service." User A can enter this service information into the app or scan a contract to automatically obtain the information. This allows User A to centrally manage this information and receive reminders when the renewal date approaches. Additionally, while using the app, the emotion engine analyzes the user's facial expressions and detects stress. Based on this information, the server suggests a subscription to a "meditation app" to help them relax.

[2353] Prompt Sentence Examples

[2354] You are developing a system that manages user subscriptions and makes suggestions based on an emotional engine. The system provides a dashboard for users to register and manage various services. It also makes optimal service suggestions based on the user's emotional state. For example, if a user has a weekly magazine subscription and a music streaming service, the system will send renewal reminders and make new suggestions based on the user's emotional state. Please explain the specific process steps.

[2355] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2356] Step 1: User Registration

[2357] A user visits a website or application, enters personal information such as name, email address, password, etc. Once completed, the user clicks the submit button.

[2358] Input: User information (name, email address, password)

[2359] The terminal encrypts the input information and transmits it to the server.

[2360] The server stores the received information in a database and returns a response indicating that registration is complete to the terminal.

[2361] Output: Account registration completion notification

[2362] Step 2: Activate your account

[2363] The user checks the verification email sent to them and clicks on the account activation link.

[2364] Input: Click the link in the verification email

[2365] The server updates the account status to "activated."

[2366] Output: Activation status update notification

[2367] Step 3: Log in

[2368] The user logs in by entering the registered email address and password.

[2369] Input: Email address, password

[2370] The server checks the entered information against a database and redirects the user to the dashboard if authentication is successful.

[2371] Output: Dashboard access permissions

[2372] Step 4: Enter your subscription information

[2373] The user enters their subscription details, including the service name, provider, contract period, cost, etc.

[2374] Input: Subscription information (service name, provider, contract period, cost)

[2375] The terminal transmits the entered subscription information to the server.

[2376] The server stores the received information in a database and updates the dashboard.

[2377] Output: Updated dashboard

[2378] Step 5: Automatically retrieve subscription information

[2379] The user takes a photo of a paper contract or receipt using their smartphone camera.

[2380] Input: Image of contract or receipt

[2381] The device sends the captured image to OCR software, which extracts the text data.

[2382] Output: Extracted character data

[2383] The terminal transmits the extracted character data to the server.

[2384] The server analyzes the character data and stores it in a database as subscription information.

[2385] Output: Parsed subscription information

[2386] Step 6: Generate renewal reminders

[2387] The server periodically checks the subscription information in the database to detect information whose contract renewal date is approaching.

[2388] Input: Subscription information in the database

[2389] Output: Information that needs to be updated

[2390] The server generates a reminder based on the information that needs to be updated and sends it to the device.

[2391] The terminal displays a reminder notification to the user.

[2392] Output: Reminder notification

[2393] Step 7: Set up Family Sharing

[2394] Users enter information about their family members into the system and set up sharing of subscription information.

[2395] Input: Family member information, sharing settings

[2396] The terminal transmits the sharing setting information to the server.

[2397] The server stores the received shared setting information in a database.

[2398] Family members can view shared subscription information on their dashboard.

[2399] Output: Shared dashboard

[2400] Step 8: Usage analysis and optimization recommendations

[2401] The server collects subscription usage data and analyzes usage frequency and patte...

Claims

1. means for inputting user-provided subscription information; A means to centrally manage subscription information; A means for monitoring renewal dates of subscription information and generating reminders; A way to share subscription information between family members, A means to analyze usage and provide optimal subscription proposals; A system including:

2. A means to scan paper contracts and receipts and extract text data, means for parsing the extracted character data to identify subscription information; The system of claim 1 .

3. Further including a means to avoid duplicate spending by sharing subscription information between family members; The system of claim 1 .

Images