System

Abstract

A system is provided.SOLUTION: An account registration system, comprising: means for inputting account information; means for transmitting the account information to a server; means for storing the account information in a database; and means for receiving a response of account registration success from the server.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, people are busy and have difficulty contacting the people they care about. This problem becomes more pronounced as people get older, and relationships with family and friends tend to weaken. Communication with elderly family members is particularly lacking. There is a need to improve this situation and provide a means for people to maintain regular contact with their loved ones. [Means for solving the problem]

[0005] This invention provides a system that allows users to register account information and contact information using a smartphone app and create and send messages and photo data. Specifically, the system includes a means for inputting account information and sending it to a server, a means for inputting contact information and sending it to the server, and a means for inputting messages and photo data and sending it to the server. The server then stores the received information in a database and returns a successful save response to the user, allowing the user to easily contact important people.

[0006] "Account information" refers to personal authentication information such as name, email address, and password that a user enters to use the service.

[0007] A "server" is a computing system responsible for receiving data sent by users and storing it in a database.

[0008] A "database" is an information management system that structures and stores received information and allows data to be retrieved as needed.

[0009] "Contact information" refers to contact information for important people (e.g., family, friends), including names, contact methods, LINE ID, email addresses, addresses, etc.

[0010] A "message" is a text message that a user sends to important people.

[0011] "Photo data" is an image file that a user sends to important people.

[0012] The "account registration system" is a system for sending account information entered by a user to a server and storing it in a database.

[0013] A "contact registration system" is a system for sending contact information entered by a user to a server and storing it in a database.

[0014] The "letter sending system" is a system for sending messages and photo data created by users to contacts. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] The present invention provides a system for assisting users in periodically sending letters with photographs to important people. Specific embodiments of the system will be described below.

[0037] Account Registration Implementation

[0038] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[0039] The terminal transmits the entered account information to the server.

[0040] The server stores the received data in a database and returns a response to the terminal indicating that the account registration was successful.

[0041] The terminal displays the response and notifies the user.

[0042] Contact registration embodiment

[0043] Users enter the name, contact method (LINE, email, address), and contact information (LINE ID, email address, address) on the "Add Contact" screen within the app.

[0044] The terminal transmits the entered contact data to the server.

[0045] The server stores the received contact data in a database and returns a response indicating successful contact registration to the terminal.

[0046] The terminal displays the response and notifies the user.

[0047] Example of creating a letter

[0048] The user enters a message and selects the photo they want to send on the "Create a letter" screen within the app. After confirming that the information entered is correct, the user presses the "Create" button.

[0049] The device sends the message and photo data to the server.

[0050] The server stores the received letter data in a database and returns a response indicating that the letter was successfully created and a new letter ID to the terminal.

[0051] The terminal displays the response and notifies the user.

[0052] Example of sending a letter

[0053] On the "Send Letter" screen, the user selects the letter they want to send and the contact information they want to send it to. After confirming that the recipient is correct, the user presses the "Send" button.

[0054] The terminal sends the selected letter ID and the recipient list to the server.

[0055] The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The sending method can be LINE message, email, or printed postcard. After sending, the server returns a successful response to the device.

[0056] The terminal displays the response and notifies the user.

[0057] Reminder setting implementation example

[0058] The user selects the frequency of the reminder (e.g., weekly, monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button.

[0059] The device sends the set reminder frequency to the server.

[0060] The server registers a periodic reminder sending task in the scheduler based on the received reminder information. When the reminder time comes, the server sends the user a LINE message or app notification, prompting them to write a letter.

[0061] Specific examples

[0062] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[0063] 1. Register an account and add your grandmother's LINE ID as a contact.

[0064] 2. Set a reminder for the first of every month.

[0065] 3. When you receive a reminder, select a new message and a recent family photo, then compose and send the letter.

[0066] 4. The server sends a message and photo to the grandmother's LINE ID based on the letter data received.

[0067] The system of the present invention allows users to easily stay in touch with important people even in their busy daily lives. This system facilitates communication between people and helps deepen relationships with family and friends.

[0068] The processing flow will be explained below.

[0069] Account registration process

[0070] Step 1:

[0071] The user installs the app and accesses the "New Registration" screen.

[0072] The user enters their name, email address, and password.

[0073] Step 2:

[0074] The terminal transmits the entered account information to the server.

[0075] Step 3:

[0076] The server stores the received account information in a database.

[0077] Step 4:

[0078] The server generates a response indicating successful account registration and sends it to the terminal.

[0079] Step 5:

[0080] The terminal receives the response from the server and displays a notification to the user that the account registration was successful.

[0081] Contact registration process

[0082] Step 1:

[0083] The user accesses the "Add Contact" screen within the app.

[0084] The user enters the contact's name, contact method (LINE, email, address), and corresponding contact information.

[0085] Step 2:

[0086] The device sends the entered contact information to the server.

[0087] Step 3:

[0088] The server stores the received contact information in a database.

[0089] Step 4:

[0090] The server generates a response indicating that the contact registration was successful and sends it to the device.

[0091] Step 5:

[0092] The terminal receives the response from the server and displays a notification to the user that the contact registration was successful.

[0093] Processing of letter creation

[0094] Step 1:

[0095] The user accesses the "Create Letter" screen within the app.

[0096] The user enters a message and selects the photos they want to send.

[0097] Step 2:

[0098] The device sends the message and photo data to the server.

[0099] Step 3:

[0100] The server stores the received letter data in a database and generates a stored letter ID.

[0101] Step 4:

[0102] The server sends a response indicating that the letter was successfully created and the generated letter ID to the terminal.

[0103] Step 5:

[0104] The terminal receives the response from the server and displays a notification to the user that the letter was successfully created.

[0105] Processing of letter transmission

[0106] Step 1:

[0107] The user accesses the "Send Letter" screen within the app.

[0108] Users select the letter they want to send and select the contacts to send it to.

[0109] Step 2:

[0110] The terminal sends the selected letter ID and the recipient list to the server.

[0111] Step 3:

[0112] The server retrieves the specified letter content from the database.

[0113] Step 4:

[0114] The server sends the letter to each contact based on the contact list, using either a LINE message, email, or a printed postcard.

[0115] Step 5:

[0116] The server generates a response indicating that the letter was sent successfully and sends it to the terminal.

[0117] Step 6:

[0118] The terminal receives the response from the server and displays a notification to the user that the letter was sent successfully.

[0119] Handling reminder settings

[0120] Step 1:

[0121] The user accesses the "Reminder Settings" screen within the app.

[0122] The user selects the frequency of the reminder (e.g., weekly, monthly).

[0123] Step 2:

[0124] The device sends the set reminder frequency to the server.

[0125] Step 3:

[0126] Based on the reminder information received by the server, a periodic reminder sending task is registered in the scheduler.

[0127] Step 4:

[0128] When the server reaches the time of the reminder, it will send a LINE message or app notification to the user.

[0129] Step 5:

[0130] Users receive a reminder and are prompted to take action to create and send a new letter.

[0131] The above is the flow of specific processing steps for carrying out the present invention.

[0132] Example 1

[0133] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0134] In today's society, it is not easy to maintain contact with loved ones amidst our busy daily lives. Regular contact with elderly people and family members who live far away is especially important to convey gratitude and affection, but we often forget when to do so. Furthermore, with so many different communication methods available, it can be tedious to know which method to choose and to set it up each time. A system that can solve these problems is needed.

[0135] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0136] In this invention, the server includes a means for inputting account information, a means for inputting contact information, and a means for inputting a message and image data. This allows a user to easily register an account, add contacts, and select and send a message and image. Furthermore, by combining a means for receiving a response indicating successful contact registration, a means for receiving a response indicating successful message and image data transmission, a means for sending a message and image data to a specified target person, a means for setting the frequency of reminders, and a means for receiving reminder notifications, the user can periodically send messages to important people and avoid missing a chance to contact them.

[0137] "Account information" refers to identification data such as name, email address, and password that a user uses to register with the system.

[0138] "Server" means a computer system that stores account information, contact information, messages, and image data and performs necessary processing.

[0139] "Database" means a system located on the server for structuring, managing, and storing account information, contact information, messages, and image data.

[0140] "Contact information" refers to the name of the person the user wants to contact, the means of contact (LINE, email, address, etc.), and specific contact information (LINE ID, email address, address, etc.).

[0141] A "message" is text data that a user wants to send.

[0142] "Image data" refers to image files such as photographs and drawings that a user wants to send.

[0143] A "response" is a processing result or success notification returned from the server to the terminal.

[0144] "Reminder" is a function that sends notifications to users at specific times to encourage them to take action.

[0145] "Reminder frequency" refers to the period or timing at which reminder notifications are sent, and is set by the user.

[0146] A "scheduler" is a program that manages periodic tasks on the server side and sends reminder notifications.

[0147] "Frequency" means the time interval at which reminders or notifications are sent.

[0148] A "notification" is a message or alert sent to a user to prompt them to take action.

[0149] "Contact method" refers to the communication method (e.g., LINE, email, mail, etc.) used to send messages and image data.

[0150] A "destination list" is a list of contact information for recipients to whom messages and image data are to be sent.

[0151] This invention is a system that helps users to send regular letters with photos to their loved ones. This system consists of three main components: a server, a terminal, and a user.

[0152] Account Registration

[0153] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[0154] The terminal sends the account information entered by the user to the server using an HTTP POST request.

[0155] The server analyzes the received account information and saves it in a database. If the save is successful, the server generates a response indicating that the account registration was successful and sends it to the terminal.

[0156] The terminal receives this response and notifies the user that "registration was successful."

[0157] Contact registration

[0158] Within the app, users access the "Add Contact" screen and enter the name, contact method, and specific contact information of the person they want to contact.

[0159] The device sends the contact information entered by the user to the server, again using an HTTP POST request.

[0160] The server analyzes the received contact information and saves it in the database. If the save is successful, the server generates a response indicating that the contact information was successfully registered and sends it to the device.

[0161] The terminal receives this response and notifies the user that "contact registration was successful."

[0162] Creating a letter

[0163] The user accesses the "Create a letter" screen within the app, enters a message, selects the photos they want to send, and presses the "Create" button.

[0164] The device sends the message and photo data to the server using an HTTP POST request, with the data sent in JSON format.

[0165] The server analyzes the received letter data and saves it in the database. If the save is successful, the server generates a response indicating that the letter was created successfully and a new letter ID, and sends them to the device.

[0166] The terminal receives this response and notifies the user that "the letter has been created successfully."

[0167] Send a letter

[0168] On the "Send Letter" screen, the user selects the letter they want to send and the recipient, and presses the "Send" button.

[0169] The device sends the letter ID and the recipient list to the server using an HTTP POST request, with the data sent in JSON format.

[0170] The server retrieves the letter content from the database and sends it based on the contact list, using the LINE API, a mail server, and a mail printing service.

[0171] If the transmission is successful, the server generates a response indicating the success of the transmission and sends it to the terminal.

[0172] The terminal receives this response and notifies the user that "the letter has been sent successfully."

[0173] Reminder settings

[0174] The user selects the reminder frequency on the "Reminder Settings" screen and presses the "Set" button.

[0175] The device sends the reminder frequency information to the server using an HTTP POST request.

[0176] The server registers the received reminder information in a scheduler, which uses a cron job.

[0177] When the time for the reminder arrives, the server will send a reminder to the user via LINE message or app notification, prompting them to write the letter.

[0178] Specific examples

[0179] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[0180] 1. The user registers an account and adds the grandmother's contact information (e.g., LINE ID) to the contacts.

[0181] 2. Set a reminder for the first of every month.

[0182] 3. Upon receiving the reminder, the user selects a new message and a recent family photo, composes the letter, and sends it.

[0183] 4. Based on the letter data received by the server, a message and photo are sent to the grandmother's LINE ID.

[0184] Example prompts to input to a generative AI model:

[0185] "Please tell me how to register an account to send a photo message to my grandmother once a month, add her LINE ID to my contacts, and set a reminder for the first of every month. Also, please provide detailed instructions on how to create and send the message after receiving the reminder."

[0186] The system of the present invention allows users to easily stay in touch with important people and deepen relationships with family and friends even in the midst of their busy lives.

[0187] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0188] Step 1: Enter your account information

[0189] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password. The input is "Yamada Taro", "taro@example.com", and "password123". This is the input for this step. This information is ready to be processed in the next step.

[0190] Step 2: Submit your account information

[0191] The device sends the account information entered by the user to the server using an HTTP POST request. The data is then processed on the device into the following JSON format:

[0192] json

[0193] {

[0194] "name": "Yamada Taro",

[0195] "email": "taro@example.com",

[0196] "password": "password123"

[0197] }

[0198] The processed data is the output of this step and is sent to the server.

[0199] Step 3: Save your account information

[0200] The server analyzes the received account data and saves it in a database. SQL queries are used for saving, and MySQL (registered trademark) is used as the database management system. The input to this step is the JSON data sent in step 2. If the server is successful in saving the data, it generates response data with a "success" status, which becomes the output for the next step.

[0201] Step 4: Send and display the response

[0202] The server generates a JSON response like this and sends it to the device:

[0203] json

[0204] {

[0205] "status": "success",

[0206] "message": "Registration successful"

[0207] }

[0208] This response is the input for step 4. The terminal receives this response and notifies the user that "registration was successful." This is the final output.

[0209] Step 5: Enter your contact information

[0210] The user accesses the "Add Contact" screen within the app and enters the name of the person they want to contact, their contact method, and specific contact information. The input is "Grandmother," "LINE," and "grandma123." This is the input for this step.

[0211] Step 6: Submit your contact information

[0212] The device sends the entered contact data to the server using an HTTP POST request, and the data is formatted as JSON:

[0213] json

[0214] {

[0215] "name": "Grandmother",

[0216] "method": "LINE",

[0217] "contact": "grandma123"

[0218] }

[0219] The processed data is the output of this step and is sent to the server.

[0220] Step 7: Save your contact information

[0221] The server parses the received contact data and saves it in a database. It uses SQL queries to save the data and MySQL as the database management system. The input to this step is the JSON data sent in step 6. If the server successfully saves the data, it generates a response data with a "success" status, which becomes the output for the next step.

[0222] Step 8: Send and Display the Response

[0223] The server generates a JSON response like this and sends it to the device:

[0224] json

[0225] {

[0226] "status": "success",

[0227] "message": "Contact registration successful"

[0228] }

[0229] This response is the input for step 8. The device receives this response and notifies the user that "Contact registration was successful." This is the final output.

[0230] Step 9: Write a message and select a photo

[0231] The user accesses the "Create a letter" screen, enters a message, and selects the photo they want to send. The input is "How are you?" and the selected photo file. This is the input for this step.

[0232] Step 10: Send your letter

[0233] The device sends the entered message and photo data to the server using an HTTP POST request, and the data is processed into the following JSON format:

[0234] json

[0235] {

[0236] "message": "How are you?",

[0237] "photo": "<base64_encoded_photo> "

[0238] }

[0239] The processed data is the output of this step and is sent to the server.

[0240] Step 11: Save your letter data

[0241] The server parses the received letter data and saves it in a database. SQL queries are used for saving, and MySQL is used as the database management system. The input to this step is the JSON data sent in step 10. If the server successfully saves the data, it generates response data with a "success" status and a new letter ID, which becomes the output of the next step.

[0242] Step 12: Send and Display the Response

[0243] The server generates a JSON response like this and sends it to the device:

[0244] json

[0245] {

[0246] "status": "success",

[0247] "message": "Letter created successfully",

[0248] "letter_id": "12345"

[0249] }

[0250] This response is the input to step 12. The terminal receives this response and notifies the user that "The letter was created successfully." This is the final output.

[0251] Step 13: Select the message you want to send and who you want to send it to

[0252] On the "Send Letter" screen, the user selects the letter they want to send and the recipient. The input is the letter ID "12345" and the recipient information "Grandmother's LINE ID (grandma123)." This is the input for this step.

[0253] Step 14: Sending outgoing data

[0254] The device sends the letter ID and destination information to the server using an HTTP POST request, and the data is processed into the following JSON format:

[0255] json

[0256] {

[0257] "letter_id": "12345",

[0258] "recipients": [

[0259] {

[0260] "method": "LINE",

[0261] "contact": "grandma123"

[0262] }

[0263] ]

[0264] }

[0265] The processed data is the output of this step and is sent to the server.

[0266] Step 15: Send your letter

[0267] The server retrieves the letter content from the database and sends it based on the contact list. To send the letter, it uses the LINE API, a mail server, and a mail printing service. The letter data is processed to suit the appropriate sending method and sent to each service. This is the specific operation. The input to this step is the JSON data sent in step 14, and the output is the sending result from each service.

[0268] Step 16: Sending and Displaying the Response

[0269] The server generates a successful response and sends it to the device:

[0270] json

[0271] {

[0272] "status": "success",

[0273] "message": "Your message was sent successfully"

[0274] }

[0275] This response is the input to step 16. The terminal receives this response and notifies the user that "your letter has been sent successfully." This is the final output.

[0276] Step 17: Select Reminder Frequency

[0277] The user selects the frequency of the reminder on the "Reminder Settings" screen. The input is "1st of every month." This is the input for this step.

[0278] Step 18: Send Reminder Settings

[0279] The device sends the reminder frequency information to the server using an HTTP POST request, and the data is formatted as JSON:

[0280] json

[0281] {

[0282] "frequency": "1st of every month"

[0283] }

[0284] The processed data is the output of this step and is sent to the server.

[0285] Step 19: Register a reminder task

[0286] The server registers a reminder task in the scheduler based on the received reminder information. A cron job is used as the scheduler. The input of this step is the JSON data sent in step 18. The server sets a task in the scheduler based on the reminder information, which is the output of the next step.

[0287] Step 20: Reminders

[0288] When the reminder time comes, the server sends a reminder to the user via LINE message or app notification, prompting them to write a letter. The notification message is "Don't forget to write a letter." The input to this step is the reminder notification trigger from the scheduler, and the output is the notification message to the user.

[0289] This allows users to easily stay in touch with loved ones and send regular photo messages.

[0290] (Application example 1)

[0291] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0292] Today, many people face the challenge of finding time to maintain communication with loved ones in their busy lives. As a result, relationships with family and friends tend to become estranged, especially when they live far apart. Furthermore, sending messages and photos regularly takes time and effort, and people often forget to do so. Furthermore, when users want to create timely and personal messages, they often find themselves at a loss as to what to include and how to include them.

[0293] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0294] In this invention, the server includes means for inputting account information, means for transmitting the account information to the server, means for saving the account information in a database, means for receiving a response from the server indicating successful account registration, means for inputting message and photo data, means for transmitting the message and photo data to the server, means for saving the message and photo data in a database, means for scheduling periodic transmission, a reminder means for sending a notification based on the scheduling information, means for automatically sending the message and photo data to designated contacts, means for assisting a user in creating a message using a generative AI model, and means for automatically generating an appropriate message by inputting a prompt sentence, thereby enabling a user to contact important people efficiently and in a timely manner and helping to maintain and strengthen relationships.

[0295] "Account information" refers to identification information such as name, email address, and password that a user uses to register with the system.

[0296] "Server" refers to a central system for storing and managing account information, message data, and the like.

[0297] A "database" is a system for systematically storing and managing account information, contact information, message data, etc. within a server.

[0298] A "message" is text data that a user inputs to send to other users.

[0299] "Photo data" is an image file that a user selects to attach to a message.

[0300] "Contact information" refers to the name and contact method (email address, telephone number, etc.) that a user registers as a message recipient.

[0301] A "response" is a reply or response message sent from a server to a client device.

[0302] "Scheduling" refers to creating a plan to automatically send messages and photo data based on a preset date, time, and frequency.

[0303] "Reminder" is a notification function that prompts the user to create and send a message.

[0304] A "generative AI model" is an artificial intelligence technology that automatically generates appropriate messages based on prompts entered by users.

[0305] A "prompt" is a simple instruction that is input to a generative AI model, and is the text that a message is generated based on.

[0306] The present invention is a system that helps users regularly send letters with photos to their loved ones. The system includes account registration, contact registration, message and photo data input and sending, periodic sending scheduling, reminder notifications, and message generation support using a generative AI model.

[0307] Account Registration Implementation

[0308] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password, and presses the "Register" button. The device sends the entered account information to the server. The server stores the received data in a database and returns a response to the device indicating successful account registration. The device displays the response and notifies the user.

[0309] Contact registration embodiment

[0310] The user enters their name, contact method (email address, phone number, etc.), and contact information on the "Add Contact" screen within the app. The device sends the entered contact data to the server. The server saves the received contact data in a database and returns a response to the device indicating that the contact was successfully registered. The device displays the response and notifies the user.

[0311] Embodiments of inputting and sending message and photo data

[0312] The user enters a message and selects the photo they want to send on the "Create a letter" screen within the app. After confirming that the input is correct, the user presses the "Create" button. The device then sends the message and photo data to the server. The server stores the received letter data in a database and returns a response indicating that the letter was successfully created and a new letter ID to the device. The device then displays the response and notifies the user.

[0313] Periodic Transmission Scheduling Embodiments

[0314] The user selects the reminder frequency (e.g., weekly or monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button. The device sends the set reminder frequency to the server. Based on the received reminder information, the server registers a periodic reminder sending task in the scheduler. When the time for the reminder arrives, the server sends the user an app notification prompting them to create a letter.

[0315] Implementation of automatic sending to designated contacts

[0316] On the "Send Letter" screen, the user selects the letter they wish to send and the contacts to whom they wish to send it. After confirming that the recipients are correct, the user presses the "Send" button. The device sends the selected letter ID and recipient list to the server. The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The sending method can be email, etc. After sending, the server returns a response to the device indicating that the message was sent successfully. The device displays the response and notifies the user.

[0317] Implementation of message generation support using generative AI model

[0318] If a user has difficulty creating a message, they can use a generative AI model to generate an appropriate message. The user enters a short prompt, and the AI ​​generates a message based on that prompt. This prompt can include specific content, such as "A message about a recent family trip." The generated message can then be reviewed by the user, and modified as needed.

[0319] Prompt Sentence Examples

[0320] Example 1: "A message about a recent family trip"

[0321] Example 2: "New Year's greeting message"

[0322] This allows users to connect with important people in an efficient and timely manner, helping them maintain and strengthen relationships, and the generative AI model allows users to easily create personalized messages.

[0323] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0324] Step 1:

[0325] A user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password, and presses the "Register" button. The device receives the user's name, email address, and password as input and sends them to the server. The server stores the input data in a database, generates a response indicating successful account registration, and sends it back to the device. The device displays this response and notifies the user, thereby letting them know that the user's account has been created successfully.

[0326] Step 2:

[0327] The user enters their name, contact method (email address, phone number, etc.), and contact information on the "Add Contact" screen within the app. The device receives the user's contact information as input and sends it to the server. The server stores the received contact data in a database, generates a response indicating successful contact registration, and sends it back to the device. The device displays this response and notifies the user, allowing the user to register the appropriate contact.

[0328] Step 3:

[0329] The user enters a message and selects the photo they want to send on the "Create a letter" screen within the app. The device receives the message and photo data as input and sends it to the server. The server stores the received data in a database, generates a response indicating that the letter was created successfully, and a new letter ID, which it returns to the device. The device displays this response and notifies the user. This effectively saves the user's letter data.

[0330] Step 4:

[0331] The user selects the frequency of the reminder (e.g., weekly or monthly) on the "Reminder Settings" screen within the app. The device receives the reminder frequency information as input and sends it to the server. The server then registers a periodic reminder sending task in the scheduler based on the received data. When the time for the reminder arrives, the server sends a notification to the user, prompting them to create a letter. This allows the user to create letters on a regular basis.

[0332] Step 5:

[0333] On the "Send Letter" screen, the user selects the letter they want to send and the contacts to whom they want to send it. The terminal receives the letter ID and recipient list as input, and sends this to the server. The server retrieves the specified letter content from the database and automatically sends the message and photo data based on the contact list. The server generates a response indicating successful sending and sends it back to the terminal. The terminal displays this response and notifies the user. This causes the user's letter to be automatically sent to the appropriate contacts.

[0334] Step 6:

[0335] If a user has difficulty creating a message, they can use the app's "AI Generation Assistance" function. The device receives a prompt sentence (e.g., "A message about a recent family trip") as input and sends it to the generative AI model. The generative AI model generates an appropriate message based on the prompt sentence and sends it back to the device. The device displays the generated message to the user, who can modify it as needed. This allows the user to effectively create personalized messages using the generative AI model.

[0336] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0337] The present invention provides an account registration system that combines an emotion engine and a system that supports users in periodically sending letters with photos to important people. Specific embodiments of the system will be described below.

[0338] Account Registration Implementation

[0339] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[0340] The terminal transmits the entered account information to the server.

[0341] The server stores the received account information in a database, generates a response indicating that the account registration was successful, and sends it to the terminal.

[0342] The terminal receives the response and displays a notification to the user that the account registration was successful.

[0343] Contact registration embodiment

[0344] Users enter the contact's name, contact method (LINE, email, address), and corresponding contact information on the "Add Contact" screen within the app.

[0345] The terminal transmits the entered contact information to the server.

[0346] The server stores the received contact information in a database, generates a response indicating that the contact registration was successful, and sends it to the terminal.

[0347] The terminal receives the response and displays a notification to the user that the contact registration was successful.

[0348] Letter creation and emotion engine implementation

[0349] Users can enter a message and select the photo they want to send on the "Create a letter" screen within the app.

[0350] The terminal transmits the input message and photo data to the server.

[0351] The server stores the received letter data in a database, generates a response indicating that the letter was successfully created, and a new letter ID, which it then sends to the terminal.

[0352] The terminal receives the response and displays a notification to the user that the letter was successfully created.

[0353] Specific functions of the emotion engine

[0354] The emotion engine identifies emotions based on user input. For example, if a user enters keywords such as "thank you" or "happy," the emotion engine will detect positive emotions.

[0355] The emotion engine suggests template messages according to the identified emotion. Furthermore, when the user selects a photo, the emotion engine filters photos that match the emotion and displays suggestions, allowing the user to easily create a letter that matches the emotion.

[0356] Example of sending a letter

[0357] On the "Send Letter" screen, the user selects the letter they want to send and the contact information they want to send it to. After confirming that the recipient is correct, the user presses the "Send" button.

[0358] The terminal sends the selected letter ID and the recipient list to the server.

[0359] The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The letter can be sent by LINE message, email, or printed postcard. After sending, the server sends a successful response to the device.

[0360] The terminal receives the response and displays a notification to the user that the letter was sent successfully.

[0361] Reminder setting implementation example

[0362] The user selects the frequency of the reminder (e.g., weekly, monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button.

[0363] The device sends the set reminder frequency to the server.

[0364] The server registers a periodic reminder sending task in the scheduler based on the received reminder information. When the reminder time comes, the server sends the user a LINE message or app notification, prompting them to write a letter.

[0365] Reminders using an emotion engine

[0366] The emotion engine analyzes the user's past messages and behavior to infer the user's current emotional state before sending a reminder.

[0367] The server receives input from the emotion engine and generates and sends reminder content appropriate to the user's mood. For example, if a user has been feeling stressed recently, the reminder might suggest something like, "Now is the time to express gratitude to someone important to you."

[0368] Specific examples

[0369] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[0370] 1. Register an account and add your grandmother's LINE ID as a contact.

[0371] 2. Set a reminder for the first day of each month. The emotion engine analyzes the user's emotions and suggests appropriate content for the message.

[0372] 3. When the user receives the reminder notification, they select a new message and a recent family photo, and then create and send a letter based on suggestions from the emotion engine.

[0373] 4. The server sends a message and photo to the grandmother's LINE ID based on the letter data received.

[0374] The system of the present invention allows users to easily stay in touch with important people even in their busy daily lives. This system facilitates communication between people and helps deepen relationships with family and friends. The introduction of an emotion engine makes it possible to provide a personalized experience that is in tune with the user's emotions.

[0375] The processing flow will be explained below.

[0376] Account registration process

[0377] Step 1:

[0378] A user installs the app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[0379] Step 2:

[0380] The terminal transmits the entered account information to the server.

[0381] Step 3:

[0382] The server stores the received account information in a database.

[0383] Step 4:

[0384] The server generates a response indicating successful account registration and sends it to the terminal.

[0385] Step 5:

[0386] The terminal receives the response from the server and displays a notification to the user that the account registration was successful.

[0387] Contact registration process

[0388] Step 1:

[0389] A user accesses the "Add Contact" screen within the app. The user enters the contact's name, contact method (LINE, email, address), and corresponding contact information.

[0390] Step 2:

[0391] The device sends the entered contact information to the server.

[0392] Step 3:

[0393] The server stores the received contact information in a database.

[0394] Step 4:

[0395] The server generates a response indicating that the contact registration was successful and sends it to the device.

[0396] Step 5:

[0397] The terminal receives the response from the server and displays a notification to the user that the contact registration was successful.

[0398] Processing of letter creation

[0399] Step 1:

[0400] The user accesses the "Make a Message" screen within the app, enters a message, and selects the photo they want to send.

[0401] Step 2:

[0402] The terminal transmits the input message and photo data to the server.

[0403] Step 3:

[0404] The server stores the received letter data in a database, generates a response indicating that the letter was successfully created, and a new letter ID, which it then sends to the terminal.

[0405] Step 4:

[0406] The terminal receives the response from the server and displays a notification to the user that the letter was successfully created.

[0407] Emotion engine processing

[0408] Step 1:

[0409] The terminal sends the message entered by the user to the emotion engine.

[0410] Step 2:

[0411] The emotion engine analyzes the message and identifies the user's emotion (e.g., positive, negative, neutral).

[0412] Step 3:

[0413] An emotion engine generates template message and associated photo suggestions based on the identified emotions.

[0414] Step 4:

[0415] The terminal receives the suggestions from the emotion engine and displays them to the user.

[0416] Step 5:

[0417] The user reviews the proposed template message and photo and modifies them as necessary.

[0418] Processing of letter transmission

[0419] Step 1:

[0420] The user accesses the "Send Letter" screen within the app, selects the letter they want to send, and selects the contacts to whom they want to send it.

[0421] Step 2:

[0422] The terminal sends the selected letter ID and the recipient list to the server.

[0423] Step 3:

[0424] The server retrieves the specified letter content from the database.

[0425] Step 4:

[0426] The server will send the letter to each contact based on the contact list, either via LINE message, email, or printed postcard.

[0427] Step 5:

[0428] The server generates a response indicating that the letter was sent successfully and sends it to the terminal.

[0429] Step 6:

[0430] The terminal receives the response from the server and displays a notification to the user that the letter was sent successfully.

[0431] Handling reminder settings

[0432] Step 1:

[0433] The user accesses the "Reminder Settings" screen within the app. The user selects the frequency of the reminder (e.g., weekly, monthly).

[0434] Step 2:

[0435] The device sends the set reminder frequency to the server.

[0436] Step 3:

[0437] Based on the reminder information received by the server, a periodic reminder sending task is registered in the scheduler.

[0438] Step 4:

[0439] When the server reaches the time for the reminder, it will send a LINE message or app notification to the user, prompting them to write a letter.

[0440] Applying emotion engines to handle reminders

[0441] Step 1:

[0442] The emotion engine analyzes the user's past messages and behavioral data to infer their current emotional state.

[0443] Step 2:

[0444] The server receives input from the emotion engine.

[0445] Step 3:

[0446] The server generates reminder content according to the user's current emotions.

[0447] Step 4:

[0448] The server sends the generated reminder to the user.

[0449] Step 5:

[0450] The user will receive a reminder and be prompted to take action to create and send a new letter.

[0451] The above is the flow of specific processing steps in the system of the present invention that combines an emotion engine.

[0452] Example 2

[0453] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0454] Conventional account registration systems simply manage account information and contact information, making it difficult to create and send messages that reflect the user's emotions. Furthermore, reminder settings cannot provide personalized notifications based on the user's emotional state. As a result, they are insufficiently able to help users effectively send letters with photos to their loved ones, and they are unable to improve the quality of communication.

[0455] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0456] In this invention, the server includes a means for storing account information in a database, a means for inputting and storing message and photo data, a means for performing sentiment analysis and proposing template messages, and a means for selecting appropriate photos based on the emotions. This allows users to easily create and send messages that reflect their emotions. Furthermore, by setting periodic reminders and generating and notifying reminder content based on the user's emotional state, users can ensure that they are in touch with important people and improve the quality of their communication.

[0457] "Account information" refers to information such as a name, email address, and password used to personally identify a user.

[0458] A "server" is a computer system that processes and stores various data over a network.

[0459] A "database" is a digital storage system that organizes and stores information and retrieves it as needed.

[0460] A "response" is a reaction or response data that a server returns in response to a request from a terminal.

[0461] A "message" is data entered by a user in the form of a sentence or text that describes what the user wants to communicate.

[0462] "Photo data" is the data of an image file selected by the user.

[0463] "Sentiment analysis" is a technique for identifying and classifying emotions from input messages.

[0464] A "template message" is a standard format for a message that corresponds to a specific emotion or situation.

[0465] A "reminder" is a notification or announcement that encourages a user to take a specific action.

[0466] "Contact information" refers to the name, contact method (e.g., LINE, email) and contact details of the person registered by the user.

[0467] "Reminder settings" is the process by which a user sets information to receive notifications at specific frequencies and times.

[0468] A "scheduler" is a system for executing tasks or processes at specific times or intervals.

[0469] MODE FOR CARRYING OUT THE INVENTION

[0470] The present invention provides an account registration system that combines an emotion engine and a system that supports users in sending regular letters with photos to important people. Each element of the present invention will be described in detail below.

[0471] Account Registration

[0472] The user installs the smartphone app and accesses the "New Registration" screen. After entering their name, email address, and password, the user presses the "Register" button.

[0473] The terminal transmits the entered account information to the server.

[0474] The server stores the received account information in a database, then generates a response indicating that the account registration was successful and sends it to the terminal.

[0475] The terminal receives the response and displays a notification to the user that the account registration was successful.

[0476] Contact registration

[0477] On the "Add Contact" screen within the app, the user enters the contact's name, contact method (e.g., LINE, email), and corresponding contact information.

[0478] The terminal transmits the entered contact information to the server.

[0479] The server stores the received contact information in a database, generates a response indicating that the contact registration was successful, and sends it to the terminal.

[0480] The terminal receives the response and displays a notification to the user that the contact registration was successful.

[0481] Letter creation and emotion engine

[0482] Users can enter a message and select the photo they want to send on the "Create a letter" screen within the app.

[0483] The terminal transmits the input message and photo data to the server.

[0484] The server stores the received letter data in a database, generates a response indicating that the letter was successfully created and a new letter ID, and sends them to the terminal.

[0485] The terminal receives the response and displays a notification to the user that the letter was successfully created.

[0486] The emotion engine has the ability to identify emotions based on user input. For example, if a user enters keywords such as "thank you" or "happy," the emotion engine will detect positive emotions.

[0487] The emotion engine suggests template messages according to the identified emotion. Furthermore, when the user selects a photo, the emotion engine filters photos that match the emotion and displays candidates, allowing the user to easily create a letter that matches the emotion.

[0488] Send a letter

[0489] On the "Send Letter" screen, the user selects the letter they want to send and the contact information they want to send it to. After confirming that the recipient is correct, the user presses the "Send" button.

[0490] The terminal sends the selected letter ID and the recipient list to the server.

[0491] The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The letter can be sent via LINE message, email, or printed postcard. After sending, the server sends a successful response to the device.

[0492] The terminal receives the response and displays a notification to the user that the letter was sent successfully.

[0493] Reminder settings

[0494] The user selects the frequency of the reminder (e.g., weekly, monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button.

[0495] The device sends the set reminder frequency to the server.

[0496] The server registers a periodic reminder sending task in the scheduler based on the received reminder information. When the reminder time comes, the server sends a LINE message or app notification to the user, prompting them to write a letter.

[0497] Reminders using an emotion engine

[0498] The emotion engine analyzes the user's past messages and behavior to infer the user's current emotional state before sending a reminder.

[0499] The server receives input from the emotion engine and generates and sends reminder content appropriate to the user's mood. For example, if a user has been feeling stressed recently, the reminder might suggest something like, "Now is the time to express gratitude to someone important to you."

[0500] Specific examples

[0501] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[0502] 1. Register an account and add your grandmother's LINE ID as a contact.

[0503] 2. Set a reminder for the first day of each month. The emotion engine analyzes the user's emotions and suggests appropriate content for the message.

[0504] 3. When the user receives the reminder notification, they select a new message and a recent family photo, and then create and send a letter based on suggestions from the emotion engine.

[0505] 4. The server sends a message and photo to the grandmother's LINE ID based on the letter data received.

[0506] This system allows users to easily stay in touch with loved ones even in the midst of their busy daily lives. Below is an example of a prompt sentence for sentiment analysis using a generative AI model:

[0507] "The user types a message such as 'Thank you' or 'I appreciate it.' The emotion engine should identify positive emotions in the user's message and suggest appropriate template messages."

[0508] Using this prompt sentence, the emotion engine can suggest the most suitable template message.

[0509] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0510] Step 1:

[0511] The user opens the smartphone app and accesses the "New Registration" screen.

[0512] Specifically, the user launches the app and taps the "New Registration" button, which displays the account information entry screen.

[0513] Step 2:

[0514] The user enters their name, email address, and password and clicks the "Register" button.

[0515] Specifically, the user fills in the relevant fields and taps the "Register" button. The input data, such as name, email address, and password, is constructed as form data.

[0516] Step 3:

[0517] The terminal sends the entered account information to the server in JSON format.

[0518] Input: Form data (name, email address, password)

[0519] Output: Generates a request containing account information in JSON format.

[0520] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / register").

[0521] Step 4:

[0522] The server analyzes the received account information and stores it in a database.

[0523] Input: JSON data received by the server

[0524] Output: New record added to the database

[0525] Specifically, the server parses the JSON data and saves the new account information in a database, such as MySQL.

[0526] Step 5:

[0527] The server generates a response indicating successful account registration and sends it to the terminal.

[0528] Input: Registration information after saving to the database

[0529] Output: JSON response containing the registration success status

[0530] Specifically, the server generates a response including a status code (e.g., 200) and a message (e.g., "Registration successful") indicating successful registration, and sends this response to the terminal as an HTTP response.

[0531] Step 6:

[0532] The terminal analyzes the response received and displays a notification to the user that the account registration was successful.

[0533] Input: Response from the server

[0534] Output: Account registration success message displayed

[0535] Specifically, the device analyzes the response and displays a notification such as "Account registration successful" on the screen.

[0536] Step 7:

[0537] The user accesses the "Add Contact" screen within the app.

[0538] Specifically, the user taps the "Add Contact" button within the app, and a screen for entering contact information appears.

[0539] Step 8:

[0540] The user enters the contact name, contact method, and contact information.

[0541] Specifically, the user enters "Name," "Contact Method" (e.g., LINE, email), and "Contact Information," and then taps the "Save" button.

[0542] Step 9:

[0543] The device sends the entered contact information to the server.

[0544] Input: Form data (name, contact method, contact information)

[0545] Output: Generates a request containing contact information in JSON format.

[0546] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / add_contact").

[0547] Step 10:

[0548] The server parses the received contact information and stores it in a database.

[0549] Input: JSON data received by the server

[0550] Output: New record added to the database

[0551] Specifically, the JSON data is parsed on the server side and the new contact information is saved in the database.

[0552] Step 11:

[0553] The server generates a response indicating that the contact registration was successful and sends it to the device.

[0554] Input: Contact information after saving to database

[0555] Output: JSON response containing the contact registration success status

[0556] Specifically, the server generates a response including a status code (e.g., 200) indicating successful registration and a message (e.g., "Contact registration successful"), and sends it to the terminal as an HTTP response.

[0557] Step 12:

[0558] The terminal analyzes the response received and displays a notification to the user that the contact registration was successful.

[0559] Input: Response from the server

[0560] Output: Contact registration success message displayed

[0561] Specifically, the device analyzes the response and displays a notification on the screen such as "Contact registration successful."

[0562] Step 13:

[0563] The user accesses the "Create Letter" screen within the app.

[0564] Specifically, the user taps the "Create a letter" button within the app, and the letter creation screen appears.

[0565] Step 14:

[0566] The user types a message and selects a photo.

[0567] Specifically, the user enters text in the "Message" field, taps the "Select Photo" button to select a photo, and taps the "Save" button.

[0568] Step 15:

[0569] The terminal transmits the input message and photo data to the server.

[0570] Input: Form data for message and photo data

[0571] Output: Generates a multipart form-data request containing the message and photo data.

[0572] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / send_letter").

[0573] Step 16:

[0574] The server analyzes the received mail data and stores it in a database.

[0575] Input: Multipart form data received by the server

[0576] Output: New record added to the database

[0577] Specifically, the multipart form data is parsed on the server side and the new letter information is saved in the database.

[0578] Step 17:

[0579] The server generates a response indicating that the letter was created successfully and a new letter ID, and sends them to the terminal.

[0580] Input: Letter information after saving to database

[0581] Output: JSON response containing the letter creation success status and the new letter ID.

[0582] Specifically, the server generates a response including a status code indicating successful creation and a new letter ID, and sends it to the terminal as an HTTP response.

[0583] Step 18:

[0584] The terminal analyzes the response received and displays a notification to the user that the letter was successfully created.

[0585] Input: Response from the server

[0586] Output: Display of a message that the letter was created successfully

[0587] Specifically, the device analyzes the response and displays a notification on the screen such as "A letter has been created."

[0588] Step 19:

[0589] The emotion engine analyzes the message in real time and detects the keyword "thank you," using a generative AI model (e.g., GPT-3 (registered trademark)).

[0590] Input: The message entered by the user

[0591] Output: Sentiment category (e.g., positive) as a result of sentiment analysis

[0592] Specifically, the emotion engine analyzes the message and detects emotion-related keywords such as "thank you."

[0593] Step 20:

[0594] The sentiment engine identifies positive sentiment from keywords.

[0595] Input: Message parsing result

[0596] Output: Emotion identification result (e.g., positive)

[0597] Specifically, the emotion engine classifies the emotion of the message into positive, negative, neutral, etc. based on the analysis results.

[0598] Step 21:

[0599] The emotion engine suggests template messages based on positive emotions, e.g., "Thank you for everything. How are you?"

[0600] Input: Emotion identification result

[0601] Output: Template message suggestions

[0602] Specifically, the emotion engine selects from a list of pre-set template messages corresponding to positive emotions and suggests them to the user.

[0603] Step 22:

[0604] When a user selects a photo, photos that match positive emotions (e.g., photos of smiling faces or landscapes) are filtered and displayed from a large number of photos.

[0605] Input: User-selected photos and emotion recognition results

[0606] Output: A list of photos based on emotions

[0607] Specifically, the emotion engine filters photos that match the emotion of the selected message and displays a list of candidates to the user.

[0608] Step 23:

[0609] The user accesses the "Send Letter" screen.

[0610] Specifically, the user taps the "Send letter" button within the app, and the letter sending screen appears.

[0611] Step 24:

[0612] The user selects the letter they want to send and selects the contact information to which they want to send it. After confirming that the address is correct, the user presses the "Send" button.

[0613] Specifically, the user selects the letter and contacts to send and taps the "Send" button.

[0614] Step 25:

[0615] The device sends the selected letter ID and the recipient list to the server in JSON format.

[0616] Input: Letter ID and recipient list

[0617] Output: Send request

[0618] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / send_message").

[0619] Step 26:

[0620] The server retrieves the specified letter content from the database and sends it based on the contact list. The sending method can be the LINE API, email, or printed postcard.

[0621] Input: Letter ID and recipient list

[0622] Output: Message sent by each sending method

[0623] Specifically, the server retrieves the contents of the letter from the database and sends the message according to the sending method.

[0624] Step 27:

[0625] The server generates a successful response and sends it to the terminal.

[0626] Input: Message sending result

[0627] Output: Successful sending response

[0628] As a specific operation, the server generates a response including a status code and a message indicating that the transmission was successful, and sends it to the terminal.

[0629] Step 28:

[0630] The terminal analyzes the response received and displays a notification to the user that the letter was sent successfully.

[0631] Input: Response from the server

[0632] Output: Message of successful sending

[0633] Specifically, the device analyzes the response and displays a notification such as "Your letter has been sent" on the screen.

[0634] Step 29:

[0635] The user accesses the "Reminder Settings" screen within the app.

[0636] Specifically, the user taps the "Set reminder" button within the app, and the reminder setting screen appears.

[0637] Step 30:

[0638] The user selects the frequency of the reminder (weekly, monthly, etc.) and presses the "Set" button.

[0639] Specifically, the user selects the frequency of the reminder and taps the "Set" button.

[0640] Step 31:

[0641] The device sends the set reminder frequency in JSON format to the server.

[0642] Input: Reminder setting information

[0643] Output: Reminder setting request

[0644] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / set_reminder").

[0645] Step 32:

[0646] The server analyzes the received reminder information and registers a periodic reminder sending task in the scheduler.

[0647] Input: Reminder setting information

[0648] Output: Task registration to scheduler

[0649] Specifically, the server registers the task as a periodic task in the reminder scheduler using a Cron expression or similar.

[0650] Step 33:

[0651] When the time for the reminder arrives, the server sends a notification to the user using the LINE API or push notification.

[0652] Input: Scheduled reminder execution timing

[0653] Output: Send notification message

[0654] Specifically, the server sends a notification to the user's device via the LINE API or push notification service based on the reminder content.

[0655] Step 34:

[0656] The emotion engine analyzes a user's past messages and behavior to infer their current emotional state.

[0657] Input: Past messages and behavioral data

[0658] Output: Current emotional state

[0659] Specifically, the emotion engine analyzes past message history and infers the user's current emotional state.

[0660] Step 35:

[0661] The server receives input from the emotion engine and generates reminder content based on the emotional state.

[0662] Input: Emotional state data

[0663] Output: personalized reminder content

[0664] Specifically, the server generates a reminder notification based on the emotion data. For example, it might say, "You seem tired lately. Let's send a letter to refresh your mind."

[0665] Step 36:

[0666] The server transmits the generated reminder content to the user terminal.

[0667] Input: Personalized reminder content

[0668] Output: Send reminder notification

[0669] Specifically, the server uses the LINE API and push notifications to send personalized reminder content to the user's device.

[0670] (Application example 2)

[0671] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0672] Conventional account registration systems and message sending systems have difficulty in providing personalized suggestions based on the user's emotional state. In addition, there is a lack of methods to appropriately suggest content that matches the user's emotions when providing specific services, and there is a need to improve the user experience.

[0673] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting account information, means for transmitting the account information to the server, means for saving the account information in a database, means for receiving a response from the server indicating that account registration was successful, means for inputting emotion analysis data, means for proposing appropriate information based on the emotion analysis data, and means for providing services using the proposed information. This makes it possible to provide information and services personalized based on the user's emotional state.

[0674] "Account information" refers to personal identification information such as a user's name, email address, and password.

[0675] A "server" is a device that stores and manages information over a network.

[0676] A "database" is a system for systematically storing, searching, and managing information.

[0677] "Emotion analysis data" is data resulting from an analysis of a user's emotions based on the text and actions entered by the user.

[0678] "Appropriate information" is information about content or services that are suggested based on the user's emotional state.

[0679] "Personalization" refers to providing content that is adapted to each user's individual preferences and feelings.

[0680] "Image data" is visual information such as photographs or pictures that a user selects or uploads.

[0681] A "response" is response information returned from a server to a client (user's terminal).

[0682] A "message" is text data that a user sends or receives.

[0683] A "means" is a method, device, or element of a system for achieving a specific purpose.

[0684] The present invention provides a food delivery system that analyzes user emotions and provides suggestions and information based on the analysis. Specific embodiments of the system are described below.

[0685] Account Registration

[0686] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button. The device sends the entered account information to the server. The server stores the received account information in a database, generates a response indicating successful account registration, and sends it to the device. The device receives the response and displays a notification to the user indicating successful account registration.

[0687] Input of sentiment analysis data

[0688] The user enters their current mood and emotions into the app's "Mood Input" screen. The device then sends the entered emotion analysis data to the server. The server then analyzes the received emotion analysis data using a generative AI model to determine the user's emotional state.

[0689] Generate suggestions

[0690] Based on the emotion analysis, the server generates information to suggest menus and services that match the user's emotional state. For example, if the emotion analysis results in "stress," the server selects "relaxing drinks" and "soothing menus" from the database and generates information to suggest to the user.

[0691] Providing proposal information

[0692] Users can check the menu information suggested by the server on the "Suggested Menu" screen within the app. The device receives this information from the server and displays a menu based on the analysis results. This allows users to easily choose a meal that suits their mood that day.

[0693] Hardware and software used

[0694] The system is implemented using the following hardware and software:

[0695] Hardware: User's smartphone

[0696] software:

[0697] Emotion analysis model (generative AI model)

[0698] Food Delivery API

[0699] For data processing and calculation, the text entered by the user is sent to an emotion analysis model, and based on the output results, menu suggestions are made using a food delivery API.

[0700] Specific examples

[0701] For example, a user accesses the app and inputs "I'm tired." The device sends this input to the server, which then analyzes the "feeling of fatigue" using an emotion analysis model. Based on the results, the server generates information suggesting "relaxing drinks" and "relaxing foods," and sends it to the user's smartphone.

[0702] Prompt Sentence Examples

[0703] The user inputs "I'm tired." After analyzing it using a sentiment analysis model, "feeling tired" is detected. Based on this, suggest "drinks that will help you relax."

[0704] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0705] Step 1:

[0706] The user enters their account information through a smartphone app. The entered account information includes their name, email address, and password. The device receives this information and sends it to the server. Input: User's account information. Output: Account information sent to the server.

[0707] Step 2:

[0708] The server stores the received account information in a database. It then generates a response indicating that the account registration was successful and sends it to the terminal. Input: Account information sent to the server. Output: Response indicating that the account registration was successful.

[0709] Step 3:

[0710] The terminal receives the response from the server and displays a notification to the user that the account registration was successful. Input: Response that the account registration was successful. Output: Notification that the account registration was successful displayed to the user.

[0711] Step 4:

[0712] The user enters their current mood and emotions in text on the "Mood Input" screen within the app. The device receives this input emotion data and sends it to the server. Input: Text data of the user's mood and emotions. Output: Emotion data sent to the server.

[0713] Step 5:

[0714] The server analyzes the received emotion data using a generative AI model. It obtains the emotion analysis results and determines the user's emotional state. Input: Emotion data sent to the server. Output: Emotion analysis results.

[0715] Step 6:

[0716] Based on the emotion analysis results, the server generates menu and service suggestion information that matches the user's emotional state. For example, if the emotion analysis result is "stress," the server selects "relaxing drinks" or "soothing menus" from the database. Input: Emotion analysis results. Output: Suggestion information.

[0717] Step 7:

[0718] The server sends the generated proposal information to the terminal. Input: Proposal information. Output: Proposal information sent to the terminal.

[0719] Step 8:

[0720] The device receives the suggestion information from the server and displays it to the user on the "Suggestion Menu" screen within the app. Input: Suggestion information from the server. Output: Suggestion menu displayed to the user.

[0721] This allows users to easily select meals and services that suit their mood that day.

[0722] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0723] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0724] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0725] [Second embodiment]

[0726] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0727] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0728] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0729] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0730] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0731] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0732] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0733] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0734] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0735] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0736] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0737] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0738] The present invention provides a system for assisting users in periodically sending letters with photographs to important people. Specific embodiments of the system will be described below.

[0739] Account Registration Implementation

[0740] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[0741] The terminal transmits the entered account information to the server.

[0742] The server stores the received data in a database and returns a response to the terminal indicating that the account registration was successful.

[0743] The terminal displays the response and notifies the user.

[0744] Contact registration embodiment

[0745] Users enter the name, contact method (LINE, email, address), and contact information (LINE ID, email address, address) on the "Add Contact" screen within the app.

[0746] The terminal transmits the entered contact data to the server.

[0747] The server stores the received contact data in a database and returns a response indicating successful contact registration to the terminal.

[0748] The terminal displays the response and notifies the user.

[0749] Example of creating a letter

[0750] The user enters a message and selects the photo they want to send on the "Create a letter" screen within the app. After confirming that the information entered is correct, the user presses the "Create" button.

[0751] The device sends the message and photo data to the server.

[0752] The server stores the received letter data in a database and returns a response indicating that the letter was successfully created and a new letter ID to the terminal.

[0753] The terminal displays the response and notifies the user.

[0754] Example of sending a letter

[0755] On the "Send Letter" screen, the user selects the letter they want to send and the contact information they want to send it to. After confirming that the recipient is correct, the user presses the "Send" button.

[0756] The terminal sends the selected letter ID and the recipient list to the server.

[0757] The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The sending method can be LINE message, email, or printed postcard. After sending, the server returns a successful response to the device.

[0758] The terminal displays the response and notifies the user.

[0759] Reminder setting implementation example

[0760] The user selects the frequency of the reminder (e.g., weekly, monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button.

[0761] The device sends the set reminder frequency to the server.

[0762] The server registers a periodic reminder sending task in the scheduler based on the received reminder information. When the reminder time comes, the server sends the user a LINE message or app notification, prompting them to write a letter.

[0763] Specific examples

[0764] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[0765] 1. Register an account and add your grandmother's LINE ID as a contact.

[0766] 2. Set a reminder for the first of every month.

[0767] 3. When you receive a reminder, select a new message and a recent family photo, then compose and send the letter.

[0768] 4. The server sends a message and photo to the grandmother's LINE ID based on the letter data received.

[0769] The system of the present invention allows users to easily stay in touch with important people even in their busy daily lives. This system facilitates communication between people and helps deepen relationships with family and friends.

[0770] The processing flow will be explained below.

[0771] Account registration process

[0772] Step 1:

[0773] The user installs the app and accesses the "New Registration" screen.

[0774] The user enters their name, email address, and password.

[0775] Step 2:

[0776] The terminal transmits the entered account information to the server.

[0777] Step 3:

[0778] The server stores the received account information in a database.

[0779] Step 4:

[0780] The server generates a response indicating successful account registration and sends it to the terminal.

[0781] Step 5:

[0782] The terminal receives the response from the server and displays a notification to the user that the account registration was successful.

[0783] Contact registration process

[0784] Step 1:

[0785] The user accesses the "Add Contact" screen within the app.

[0786] The user enters the contact's name, contact method (LINE, email, address), and corresponding contact information.

[0787] Step 2:

[0788] The device sends the entered contact information to the server.

[0789] Step 3:

[0790] The server stores the received contact information in a database.

[0791] Step 4:

[0792] The server generates a response indicating that the contact registration was successful and sends it to the device.

[0793] Step 5:

[0794] The terminal receives the response from the server and displays a notification to the user that the contact registration was successful.

[0795] Processing of letter creation

[0796] Step 1:

[0797] The user accesses the "Create Letter" screen within the app.

[0798] The user enters a message and selects the photos they want to send.

[0799] Step 2:

[0800] The device sends the message and photo data to the server.

[0801] Step 3:

[0802] The server stores the received letter data in a database and generates a stored letter ID.

[0803] Step 4:

[0804] The server sends a response indicating that the letter was successfully created and the generated letter ID to the terminal.

[0805] Step 5:

[0806] The terminal receives the response from the server and displays a notification to the user that the letter was successfully created.

[0807] Processing of letter transmission

[0808] Step 1:

[0809] The user accesses the "Send Letter" screen within the app.

[0810] Users select the letter they want to send and select the contacts to send it to.

[0811] Step 2:

[0812] The terminal sends the selected letter ID and the recipient list to the server.

[0813] Step 3:

[0814] The server retrieves the specified letter content from the database.

[0815] Step 4:

[0816] The server sends the letter to each contact based on the contact list, using either a LINE message, email, or a printed postcard.

[0817] Step 5:

[0818] The server generates a response indicating that the letter was sent successfully and sends it to the terminal.

[0819] Step 6:

[0820] The terminal receives the response from the server and displays a notification to the user that the letter was sent successfully.

[0821] Handling reminder settings

[0822] Step 1:

[0823] The user accesses the "Reminder Settings" screen within the app.

[0824] The user selects the frequency of the reminder (e.g., weekly, monthly).

[0825] Step 2:

[0826] The device sends the set reminder frequency to the server.

[0827] Step 3:

[0828] Based on the reminder information received by the server, a periodic reminder sending task is registered in the scheduler.

[0829] Step 4:

[0830] When the server reaches the time of the reminder, it will send a LINE message or app notification to the user.

[0831] Step 5:

[0832] Users receive a reminder and are prompted to take action to create and send a new letter.

[0833] The above is the flow of specific processing steps for carrying out the present invention.

[0834] Example 1

[0835] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0836] In today's society, it is not easy to maintain contact with loved ones amidst our busy daily lives. Regular contact with elderly people and family members who live far away is especially important to convey gratitude and affection, but we often forget when to do so. Furthermore, with so many different communication methods available, it can be tedious to know which method to choose and to set it up each time. A system that can solve these problems is needed.

[0837] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0838] In this invention, the server includes a means for inputting account information, a means for inputting contact information, and a means for inputting a message and image data. This allows a user to easily register an account, add contacts, and select and send a message and image. Furthermore, by combining a means for receiving a response indicating successful contact registration, a means for receiving a response indicating successful message and image data transmission, a means for sending a message and image data to a specified target person, a means for setting the frequency of reminders, and a means for receiving reminder notifications, the user can periodically send messages to important people and avoid missing a chance to contact them.

[0839] "Account information" refers to identification data such as name, email address, and password that a user uses to register with the system.

[0840] "Server" means a computer system that stores account information, contact information, messages, and image data and performs necessary processing.

[0841] "Database" means a system located on the server for structuring, managing, and storing account information, contact information, messages, and image data.

[0842] "Contact information" refers to the name of the person the user wants to contact, the means of contact (LINE, email, address, etc.), and specific contact information (LINE ID, email address, address, etc.).

[0843] A "message" is text data that a user wants to send.

[0844] "Image data" refers to image files such as photographs and drawings that a user wants to send.

[0845] A "response" is a processing result or success notification returned from the server to the terminal.

[0846] "Reminder" is a function that sends notifications to users at specific times to encourage them to take action.

[0847] "Reminder frequency" refers to the period or timing at which reminder notifications are sent, and is set by the user.

[0848] A "scheduler" is a program that manages periodic tasks on the server side and sends reminder notifications.

[0849] "Frequency" means the time interval at which reminders or notifications are sent.

[0850] A "notification" is a message or alert sent to a user to prompt them to take action.

[0851] "Contact method" refers to the communication method (e.g., LINE, email, mail, etc.) used to send messages and image data.

[0852] A "destination list" is a list of contact information for recipients to whom messages and image data are to be sent.

[0853] This invention is a system that helps users to send regular letters with photos to their loved ones. This system consists of three main components: a server, a terminal, and a user.

[0854] Account Registration

[0855] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[0856] The terminal sends the account information entered by the user to the server using an HTTP POST request.

[0857] The server analyzes the received account information and saves it in a database. If the save is successful, the server generates a response indicating that the account registration was successful and sends it to the terminal.

[0858] The terminal receives this response and notifies the user that "registration was successful."

[0859] Contact registration

[0860] Within the app, users access the "Add Contact" screen and enter the name, contact method, and specific contact information of the person they want to contact.

[0861] The device sends the contact information entered by the user to the server, again using an HTTP POST request.

[0862] The server analyzes the received contact information and saves it in the database. If the save is successful, the server generates a response indicating that the contact information was successfully registered and sends it to the device.

[0863] The terminal receives this response and notifies the user that "contact registration was successful."

[0864] Creating a letter

[0865] The user accesses the "Create a letter" screen within the app, enters a message, selects the photos they want to send, and presses the "Create" button.

[0866] The device sends the message and photo data to the server using an HTTP POST request, with the data sent in JSON format.

[0867] The server analyzes the received letter data and saves it in the database. If the save is successful, the server generates a response indicating that the letter was created successfully and a new letter ID, and sends them to the device.

[0868] The terminal receives this response and notifies the user that "the letter has been created successfully."

[0869] Send a letter

[0870] On the "Send Letter" screen, the user selects the letter they want to send and the recipient, and presses the "Send" button.

[0871] The device sends the letter ID and the recipient list to the server using an HTTP POST request, with the data sent in JSON format.

[0872] The server retrieves the letter content from the database and sends it based on the contact list, using the LINE API, a mail server, and a mail printing service.

[0873] If the transmission is successful, the server generates a response indicating the success of the transmission and sends it to the terminal.

[0874] The terminal receives this response and notifies the user that "the letter has been sent successfully."

[0875] Reminder settings

[0876] The user selects the reminder frequency on the "Reminder Settings" screen and presses the "Set" button.

[0877] The device sends the reminder frequency information to the server using an HTTP POST request.

[0878] The server registers the received reminder information in a scheduler, which uses a cron job.

[0879] When the time for the reminder arrives, the server will send a reminder to the user via LINE message or app notification, prompting them to write the letter.

[0880] Specific examples

[0881] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[0882] 1. The user registers an account and adds the grandmother's contact information (e.g., LINE ID) to the contacts.

[0883] 2. Set a reminder for the first of every month.

[0884] 3. Upon receiving the reminder, the user selects a new message and a recent family photo, composes the letter, and sends it.

[0885] 4. Based on the letter data received by the server, a message and photo are sent to the grandmother's LINE ID.

[0886] Example prompts to input to a generative AI model:

[0887] "Please tell me how to register an account to send a photo message to my grandmother once a month, add her LINE ID to my contacts, and set a reminder for the first of every month. Also, please provide detailed instructions on how to create and send the message after receiving the reminder."

[0888] The system of the present invention allows users to easily stay in touch with important people and deepen relationships with family and friends even in the midst of their busy lives.

[0889] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0890] Step 1: Enter your account information

[0891] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password. The input is "Yamada Taro", "taro@example.com", and "password123". This is the input for this step. This information is ready to be processed in the next step.

[0892] Step 2: Submit your account information

[0893] The device sends the account information entered by the user to the server using an HTTP POST request. The data is then processed on the device into the following JSON format:

[0894] json

[0895] {

[0896] "name": "Yamada Taro",

[0897] "email": "taro@example.com",

[0898] "password": "password123"

[0899] }

[0900] The processed data is the output of this step and is sent to the server.

[0901] Step 3: Save your account information

[0902] The server parses the received account data and saves it in a database. SQL queries are used for saving, and MySQL is used as the database management system. The input to this step is the JSON data sent in step 2. If the server successfully saves the data, it generates response data with a "success" status, which becomes the output for the next step.

[0903] Step 4: Send and display the response

[0904] The server generates a JSON response like this and sends it to the device:

[0905] json

[0906] {

[0907] "status": "success",

[0908] "message": "Registration successful"

[0909] }

[0910] This response is the input for step 4. The terminal receives this response and notifies the user that "registration was successful." This is the final output.

[0911] Step 5: Enter your contact information

[0912] The user accesses the "Add Contact" screen within the app and enters the name of the person they want to contact, their contact method, and specific contact information. The input is "Grandmother," "LINE," and "grandma123." This is the input for this step.

[0913] Step 6: Submit your contact information

[0914] The device sends the entered contact data to the server using an HTTP POST request, and the data is formatted as JSON:

[0915] json

[0916] {

[0917] "name": "Grandmother",

[0918] "method": "LINE",

[0919] "contact": "grandma123"

[0920] }

[0921] The processed data is the output of this step and is sent to the server.

[0922] Step 7: Save your contact information

[0923] The server parses the received contact data and saves it in a database. It uses SQL queries to save the data and MySQL as the database management system. The input to this step is the JSON data sent in step 6. If the server successfully saves the data, it generates a response data with a "success" status, which becomes the output for the next step.

[0924] Step 8: Send and Display the Response

[0925] The server generates a JSON response like this and sends it to the device:

[0926] json

[0927] {

[0928] "status": "success",

[0929] "message": "Contact registration successful"

[0930] }

[0931] This response is the input for step 8. The device receives this response and notifies the user that "Contact registration was successful." This is the final output.

[0932] Step 9: Write a message and select a photo

[0933] The user accesses the "Create a letter" screen, enters a message, and selects the photo they want to send. The input is "How are you?" and the selected photo file. This is the input for this step.

[0934] Step 10: Send your letter

[0935] The device sends the entered message and photo data to the server using an HTTP POST request, and the data is processed into the following JSON format:

[0936] json

[0937] {

[0938] "message": "How are you?",

[0939] "photo": "<base64_encoded_photo> "

[0940] }

[0941] The processed data is the output of this step and is sent to the server.

[0942] Step 11: Save your letter data

[0943] The server parses the received letter data and saves it in a database. SQL queries are used for saving, and MySQL is used as the database management system. The input to this step is the JSON data sent in step 10. If the server successfully saves the data, it generates response data with a "success" status and a new letter ID, which becomes the output of the next step.

[0944] Step 12: Send and Display the Response

[0945] The server generates a JSON response like this and sends it to the device:

[0946] json

[0947] {

[0948] "status": "success",

[0949] "message": "Letter created successfully",

[0950] "letter_id": "12345"

[0951] }

[0952] This response is the input to step 12. The terminal receives this response and notifies the user that "The letter was created successfully." This is the final output.

[0953] Step 13: Select the message you want to send and who you want to send it to

[0954] On the "Send Letter" screen, the user selects the letter they want to send and the recipient. The input is the letter ID "12345" and the recipient information "Grandmother's LINE ID (grandma123)." This is the input for this step.

[0955] Step 14: Sending outgoing data

[0956] The device sends the letter ID and destination information to the server using an HTTP POST request, and the data is processed into the following JSON format:

[0957] json

[0958] {

[0959] "letter_id": "12345",

[0960] "recipients": [

[0961] {

[0962] "method": "LINE",

[0963] "contact": "grandma123"

[0964] }

[0965] ]

[0966] }

[0967] The processed data is the output of this step and is sent to the server.

[0968] Step 15: Send your letter

[0969] The server retrieves the letter content from the database and sends it based on the contact list. To send the letter, it uses the LINE API, a mail server, and a mail printing service. The letter data is processed to suit the appropriate sending method and sent to each service. This is the specific operation. The input to this step is the JSON data sent in step 14, and the output is the sending result from each service.

[0970] Step 16: Sending and Displaying the Response

[0971] The server generates a successful response and sends it to the device:

[0972] json

[0973] {

[0974] "status": "success",

[0975] "message": "Your message was sent successfully"

[0976] }

[0977] This response is the input to step 16. The terminal receives this response and notifies the user that "your letter has been sent successfully." This is the final output.

[0978] Step 17: Select Reminder Frequency

[0979] The user selects the frequency of the reminder on the "Reminder Settings" screen. The input is "1st of every month." This is the input for this step.

[0980] Step 18: Send Reminder Settings

[0981] The device sends the reminder frequency information to the server using an HTTP POST request, and the data is formatted as JSON:

[0982] json

[0983] {

[0984] "frequency": "1st of every month"

[0985] }

[0986] The processed data is the output of this step and is sent to the server.

[0987] Step 19: Register a reminder task

[0988] The server registers a reminder task in the scheduler based on the received reminder information. A cron job is used as the scheduler. The input of this step is the JSON data sent in step 18. The server sets a task in the scheduler based on the reminder information, which is the output of the next step.

[0989] Step 20: Reminders

[0990] When the reminder time comes, the server sends a reminder to the user via LINE message or app notification, prompting them to write a letter. The notification message is "Don't forget to write a letter." The input to this step is the reminder notification trigger from the scheduler, and the output is the notification message to the user.

[0991] This allows users to easily stay in touch with loved ones and send regular photo messages.

[0992] (Application example 1)

[0993] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0994] Today, many people face the challenge of finding time to maintain communication with loved ones in their busy lives. As a result, relationships with family and friends tend to become estranged, especially when they live far apart. Furthermore, sending messages and photos regularly takes time and effort, and people often forget to do so. Furthermore, when users want to create timely and personal messages, they often find themselves at a loss as to what to include and how to include them.

[0995] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0996] In this invention, the server includes means for inputting account information, means for transmitting the account information to the server, means for saving the account information in a database, means for receiving a response from the server indicating successful account registration, means for inputting message and photo data, means for transmitting the message and photo data to the server, means for saving the message and photo data in a database, means for scheduling periodic transmission, a reminder means for sending a notification based on the scheduling information, means for automatically sending the message and photo data to designated contacts, means for assisting a user in creating a message using a generative AI model, and means for automatically generating an appropriate message by inputting a prompt sentence, thereby enabling a user to contact important people efficiently and in a timely manner and helping to maintain and strengthen relationships.

[0997] "Account information" refers to identification information such as name, email address, and password that a user uses to register with the system.

[0998] "Server" refers to a central system for storing and managing account information, message data, and the like.

[0999] A "database" is a system for systematically storing and managing account information, contact information, message data, etc. within a server.

[1000] A "message" is text data that a user inputs to send to other users.

[1001] "Photo data" is an image file that a user selects to attach to a message.

[1002] "Contact information" refers to the name and contact method (email address, telephone number, etc.) that a user registers as a message recipient.

[1003] A "response" is a reply or response message sent from a server to a client device.

[1004] "Scheduling" refers to creating a plan to automatically send messages and photo data based on a preset date, time, and frequency.

[1005] "Reminder" is a notification function that prompts the user to create and send a message.

[1006] A "generative AI model" is an artificial intelligence technology that automatically generates appropriate messages based on prompts entered by users.

[1007] A "prompt" is a simple instruction that is input to a generative AI model, and is the text that a message is generated based on.

[1008] The present invention is a system that helps users regularly send letters with photos to their loved ones. The system includes account registration, contact registration, message and photo data input and sending, periodic sending scheduling, reminder notifications, and message generation support using a generative AI model.

[1009] Account Registration Implementation

[1010] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password, and presses the "Register" button. The device sends the entered account information to the server. The server stores the received data in a database and returns a response to the device indicating successful account registration. The device displays the response and notifies the user.

[1011] Contact registration embodiment

[1012] The user enters their name, contact method (email address, phone number, etc.), and contact information on the "Add Contact" screen within the app. The device sends the entered contact data to the server. The server saves the received contact data in a database and returns a response to the device indicating that the contact was successfully registered. The device displays the response and notifies the user.

[1013] Embodiments of inputting and sending message and photo data

[1014] The user enters a message and selects the photo they want to send on the "Create a letter" screen within the app. After confirming that the input is correct, the user presses the "Create" button. The device then sends the message and photo data to the server. The server stores the received letter data in a database and returns a response indicating that the letter was successfully created and a new letter ID to the device. The device then displays the response and notifies the user.

[1015] Periodic Transmission Scheduling Embodiments

[1016] The user selects the reminder frequency (e.g., weekly or monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button. The device sends the set reminder frequency to the server. Based on the received reminder information, the server registers a periodic reminder sending task in the scheduler. When the time for the reminder arrives, the server sends the user an app notification prompting them to create a letter.

[1017] Implementation of automatic sending to designated contacts

[1018] On the "Send Letter" screen, the user selects the letter they wish to send and the contacts to whom they wish to send it. After confirming that the recipients are correct, the user presses the "Send" button. The device sends the selected letter ID and recipient list to the server. The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The sending method can be email, etc. After sending, the server returns a response to the device indicating that the message was sent successfully. The device displays the response and notifies the user.

[1019] Implementation of message generation support using generative AI model

[1020] If a user has difficulty creating a message, they can use a generative AI model to generate an appropriate message. The user enters a short prompt, and the AI ​​generates a message based on that prompt. This prompt can include specific content, such as "A message about a recent family trip." The generated message can then be reviewed by the user, and modified as needed.

[1021] Prompt Sentence Examples

[1022] Example 1: "A message about a recent family trip"

[1023] Example 2: "New Year's greeting message"

[1024] This allows users to connect with important people in an efficient and timely manner, helping them maintain and strengthen relationships, and the generative AI model allows users to easily create personalized messages.

[1025] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1026] Step 1:

[1027] A user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password, and presses the "Register" button. The device receives the user's name, email address, and password as input and sends them to the server. The server stores the input data in a database, generates a response indicating successful account registration, and sends it back to the device. The device displays this response and notifies the user, thereby letting them know that the user's account has been created successfully.

[1028] Step 2:

[1029] The user enters their name, contact method (email address, phone number, etc.), and contact information on the "Add Contact" screen within the app. The device receives the user's contact information as input and sends it to the server. The server stores the received contact data in a database, generates a response indicating successful contact registration, and sends it back to the device. The device displays this response and notifies the user, allowing the user to register the appropriate contact.

[1030] Step 3:

[1031] The user enters a message and selects the photo they want to send on the "Create a letter" screen within the app. The device receives the message and photo data as input and sends it to the server. The server stores the received data in a database, generates a response indicating that the letter was created successfully, and a new letter ID, which it returns to the device. The device displays this response and notifies the user. This effectively saves the user's letter data.

[1032] Step 4:

[1033] The user selects the frequency of the reminder (e.g., weekly or monthly) on the "Reminder Settings" screen within the app. The device receives the reminder frequency information as input and sends it to the server. The server then registers a periodic reminder sending task in the scheduler based on the received data. When the time for the reminder arrives, the server sends a notification to the user, prompting them to create a letter. This allows the user to create letters on a regular basis.

[1034] Step 5:

[1035] On the "Send Letter" screen, the user selects the letter they want to send and the contacts to whom they want to send it. The terminal receives the letter ID and recipient list as input, and sends this to the server. The server retrieves the specified letter content from the database and automatically sends the message and photo data based on the contact list. The server generates a response indicating successful sending and sends it back to the terminal. The terminal displays this response and notifies the user. This causes the user's letter to be automatically sent to the appropriate contacts.

[1036] Step 6:

[1037] If a user has difficulty creating a message, they can use the app's "AI Generation Assistance" function. The device receives a prompt sentence (e.g., "A message about a recent family trip") as input and sends it to the generative AI model. The generative AI model generates an appropriate message based on the prompt sentence and sends it back to the device. The device displays the generated message to the user, who can modify it as needed. This allows the user to effectively create personalized messages using the generative AI model.

[1038] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1039] The present invention provides an account registration system that combines an emotion engine and a system that supports users in periodically sending letters with photos to important people. Specific embodiments of the system will be described below.

[1040] Account Registration Implementation

[1041] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[1042] The terminal transmits the entered account information to the server.

[1043] The server stores the received account information in a database, generates a response indicating that the account registration was successful, and sends it to the terminal.

[1044] The terminal receives the response and displays a notification to the user that the account registration was successful.

[1045] Contact registration embodiment

[1046] Users enter the contact's name, contact method (LINE, email, address), and corresponding contact information on the "Add Contact" screen within the app.

[1047] The terminal transmits the entered contact information to the server.

[1048] The server stores the received contact information in a database, generates a response indicating that the contact registration was successful, and sends it to the terminal.

[1049] The terminal receives the response and displays a notification to the user that the contact registration was successful.

[1050] Letter creation and emotion engine implementation

[1051] Users can enter a message and select the photo they want to send on the "Create a letter" screen within the app.

[1052] The terminal transmits the input message and photo data to the server.

[1053] The server stores the received letter data in a database, generates a response indicating that the letter was successfully created, and a new letter ID, which it then sends to the terminal.

[1054] The terminal receives the response and displays a notification to the user that the letter was successfully created.

[1055] Specific functions of the emotion engine

[1056] The emotion engine identifies emotions based on user input. For example, if a user enters keywords such as "thank you" or "happy," the emotion engine will detect positive emotions.

[1057] The emotion engine suggests template messages according to the identified emotion. Furthermore, when the user selects a photo, the emotion engine filters photos that match the emotion and displays suggestions, allowing the user to easily create a letter that matches the emotion.

[1058] Example of sending a letter

[1059] On the "Send Letter" screen, the user selects the letter they want to send and the contact information they want to send it to. After confirming that the recipient is correct, the user presses the "Send" button.

[1060] The terminal sends the selected letter ID and the recipient list to the server.

[1061] The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The letter can be sent by LINE message, email, or printed postcard. After sending, the server sends a successful response to the device.

[1062] The terminal receives the response and displays a notification to the user that the letter was sent successfully.

[1063] Reminder setting implementation example

[1064] The user selects the frequency of the reminder (e.g., weekly, monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button.

[1065] The device sends the set reminder frequency to the server.

[1066] The server registers a periodic reminder sending task in the scheduler based on the received reminder information. When the reminder time comes, the server sends the user a LINE message or app notification, prompting them to write a letter.

[1067] Reminders using an emotion engine

[1068] The emotion engine analyzes the user's past messages and behavior to infer the user's current emotional state before sending a reminder.

[1069] The server receives input from the emotion engine and generates and sends reminder content appropriate to the user's mood. For example, if a user has been feeling stressed recently, the reminder might suggest something like, "Now is the time to express gratitude to someone important to you."

[1070] Specific examples

[1071] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[1072] 1. Register an account and add your grandmother's LINE ID as a contact.

[1073] 2. Set a reminder for the first day of each month. The emotion engine analyzes the user's emotions and suggests appropriate content for the message.

[1074] 3. When the user receives the reminder notification, they select a new message and a recent family photo, and then create and send a letter based on suggestions from the emotion engine.

[1075] 4. The server sends a message and photo to the grandmother's LINE ID based on the letter data received.

[1076] The system of the present invention allows users to easily stay in touch with important people even in their busy daily lives. This system facilitates communication between people and helps deepen relationships with family and friends. The introduction of an emotion engine makes it possible to provide a personalized experience that is in tune with the user's emotions.

[1077] The processing flow will be explained below.

[1078] Account registration process

[1079] Step 1:

[1080] A user installs the app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[1081] Step 2:

[1082] The terminal transmits the entered account information to the server.

[1083] Step 3:

[1084] The server stores the received account information in a database.

[1085] Step 4:

[1086] The server generates a response indicating successful account registration and sends it to the terminal.

[1087] Step 5:

[1088] The terminal receives the response from the server and displays a notification to the user that the account registration was successful.

[1089] Contact registration process

[1090] Step 1:

[1091] A user accesses the "Add Contact" screen within the app. The user enters the contact's name, contact method (LINE, email, address), and corresponding contact information.

[1092] Step 2:

[1093] The device sends the entered contact information to the server.

[1094] Step 3:

[1095] The server stores the received contact information in a database.

[1096] Step 4:

[1097] The server generates a response indicating that the contact registration was successful and sends it to the device.

[1098] Step 5:

[1099] The terminal receives the response from the server and displays a notification to the user that the contact registration was successful.

[1100] Processing of letter creation

[1101] Step 1:

[1102] The user accesses the "Make a Message" screen within the app, enters a message, and selects the photo they want to send.

[1103] Step 2:

[1104] The terminal transmits the input message and photo data to the server.

[1105] Step 3:

[1106] The server stores the received letter data in a database, generates a response indicating that the letter was successfully created, and a new letter ID, which it then sends to the terminal.

[1107] Step 4:

[1108] The terminal receives the response from the server and displays a notification to the user that the letter was successfully created.

[1109] Emotion engine processing

[1110] Step 1:

[1111] The terminal sends the message entered by the user to the emotion engine.

[1112] Step 2:

[1113] The emotion engine analyzes the message and identifies the user's emotion (e.g., positive, negative, neutral).

[1114] Step 3:

[1115] An emotion engine generates template message and associated photo suggestions based on the identified emotions.

[1116] Step 4:

[1117] The terminal receives the suggestions from the emotion engine and displays them to the user.

[1118] Step 5:

[1119] The user reviews the proposed template message and photo and modifies them as necessary.

[1120] Processing of letter transmission

[1121] Step 1:

[1122] The user accesses the "Send Letter" screen within the app, selects the letter they want to send, and selects the contacts to whom they want to send it.

[1123] Step 2:

[1124] The terminal sends the selected letter ID and the recipient list to the server.

[1125] Step 3:

[1126] The server retrieves the specified letter content from the database.

[1127] Step 4:

[1128] The server will send the letter to each contact based on the contact list, either via LINE message, email, or printed postcard.

[1129] Step 5:

[1130] The server generates a response indicating that the letter was sent successfully and sends it to the terminal.

[1131] Step 6:

[1132] The terminal receives the response from the server and displays a notification to the user that the letter was sent successfully.

[1133] Handling reminder settings

[1134] Step 1:

[1135] The user accesses the "Reminder Settings" screen within the app. The user selects the frequency of the reminder (e.g., weekly, monthly).

[1136] Step 2:

[1137] The device sends the set reminder frequency to the server.

[1138] Step 3:

[1139] Based on the reminder information received by the server, a periodic reminder sending task is registered in the scheduler.

[1140] Step 4:

[1141] When the server reaches the time for the reminder, it will send a LINE message or app notification to the user, prompting them to write a letter.

[1142] Applying emotion engines to handle reminders

[1143] Step 1:

[1144] The emotion engine analyzes the user's past messages and behavioral data to infer their current emotional state.

[1145] Step 2:

[1146] The server receives input from the emotion engine.

[1147] Step 3:

[1148] The server generates reminder content according to the user's current emotions.

[1149] Step 4:

[1150] The server sends the generated reminder to the user.

[1151] Step 5:

[1152] The user will receive a reminder and be prompted to take action to create and send a new letter.

[1153] The above is the flow of specific processing steps in the system of the present invention that combines an emotion engine.

[1154] Example 2

[1155] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1156] Conventional account registration systems simply manage account information and contact information, making it difficult to create and send messages that reflect the user's emotions. Furthermore, reminder settings cannot provide personalized notifications based on the user's emotional state. As a result, they are insufficiently able to help users effectively send letters with photos to their loved ones, and they are unable to improve the quality of communication.

[1157] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1158] In this invention, the server includes a means for storing account information in a database, a means for inputting and storing message and photo data, a means for performing sentiment analysis and proposing template messages, and a means for selecting appropriate photos based on the emotions. This allows users to easily create and send messages that reflect their emotions. Furthermore, by setting periodic reminders and generating and notifying reminder content based on the user's emotional state, users can ensure that they are in touch with important people and improve the quality of their communication.

[1159] "Account information" refers to information such as a name, email address, and password used to personally identify a user.

[1160] A "server" is a computer system that processes and stores various data over a network.

[1161] A "database" is a digital storage system that organizes and stores information and retrieves it as needed.

[1162] A "response" is a reaction or response data that a server returns in response to a request from a terminal.

[1163] A "message" is data entered by a user in the form of a sentence or text that describes what the user wants to communicate.

[1164] "Photo data" is the data of an image file selected by the user.

[1165] "Sentiment analysis" is a technique for identifying and classifying emotions from input messages.

[1166] A "template message" is a standard format for a message that corresponds to a specific emotion or situation.

[1167] A "reminder" is a notification or announcement that encourages a user to take a specific action.

[1168] "Contact information" refers to the name, contact method (e.g., LINE, email) and contact details of the person registered by the user.

[1169] "Reminder settings" is the process by which a user sets information to receive notifications at specific frequencies and times.

[1170] A "scheduler" is a system for executing tasks or processes at specific times or intervals.

[1171] MODE FOR CARRYING OUT THE INVENTION

[1172] The present invention provides an account registration system that combines an emotion engine and a system that supports users in sending regular letters with photos to important people. Each element of the present invention will be described in detail below.

[1173] Account Registration

[1174] The user installs the smartphone app and accesses the "New Registration" screen. After entering their name, email address, and password, the user presses the "Register" button.

[1175] The terminal transmits the entered account information to the server.

[1176] The server stores the received account information in a database, then generates a response indicating that the account registration was successful and sends it to the terminal.

[1177] The terminal receives the response and displays a notification to the user that the account registration was successful.

[1178] Contact registration

[1179] On the "Add Contact" screen within the app, the user enters the contact's name, contact method (e.g., LINE, email), and corresponding contact information.

[1180] The terminal transmits the entered contact information to the server.

[1181] The server stores the received contact information in a database, generates a response indicating that the contact registration was successful, and sends it to the terminal.

[1182] The terminal receives the response and displays a notification to the user that the contact registration was successful.

[1183] Letter creation and emotion engine

[1184] Users can enter a message and select the photo they want to send on the "Create a letter" screen within the app.

[1185] The terminal transmits the input message and photo data to the server.

[1186] The server stores the received letter data in a database, generates a response indicating that the letter was successfully created and a new letter ID, and sends them to the terminal.

[1187] The terminal receives the response and displays a notification to the user that the letter was successfully created.

[1188] The emotion engine has the ability to identify emotions based on user input. For example, if a user enters keywords such as "thank you" or "happy," the emotion engine will detect positive emotions.

[1189] The emotion engine suggests template messages according to the identified emotion. Furthermore, when the user selects a photo, the emotion engine filters photos that match the emotion and displays candidates, allowing the user to easily create a letter that matches the emotion.

[1190] Send a letter

[1191] On the "Send Letter" screen, the user selects the letter they want to send and the contact information they want to send it to. After confirming that the recipient is correct, the user presses the "Send" button.

[1192] The terminal sends the selected letter ID and the recipient list to the server.

[1193] The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The letter can be sent via LINE message, email, or printed postcard. After sending, the server sends a successful response to the device.

[1194] The terminal receives the response and displays a notification to the user that the letter was sent successfully.

[1195] Reminder settings

[1196] The user selects the frequency of the reminder (e.g., weekly, monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button.

[1197] The device sends the set reminder frequency to the server.

[1198] The server registers a periodic reminder sending task in the scheduler based on the received reminder information. When the reminder time comes, the server sends a LINE message or app notification to the user, prompting them to write a letter.

[1199] Reminders using an emotion engine

[1200] The emotion engine analyzes the user's past messages and behavior to infer the user's current emotional state before sending a reminder.

[1201] The server receives input from the emotion engine and generates and sends reminder content appropriate to the user's mood. For example, if a user has been feeling stressed recently, the reminder might suggest something like, "Now is the time to express gratitude to someone important to you."

[1202] Specific examples

[1203] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[1204] 1. Register an account and add your grandmother's LINE ID as a contact.

[1205] 2. Set a reminder for the first day of each month. The emotion engine analyzes the user's emotions and suggests appropriate content for the message.

[1206] 3. When the user receives the reminder notification, they select a new message and a recent family photo, and then create and send a letter based on suggestions from the emotion engine.

[1207] 4. The server sends a message and photo to the grandmother's LINE ID based on the letter data received.

[1208] This system allows users to easily stay in touch with loved ones even in the midst of their busy daily lives. Below is an example of a prompt sentence for sentiment analysis using a generative AI model:

[1209] "The user types a message such as 'Thank you' or 'I appreciate it.' The emotion engine should identify positive emotions in the user's message and suggest appropriate template messages."

[1210] Using this prompt sentence, the emotion engine can suggest the most suitable template message.

[1211] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1212] Step 1:

[1213] The user opens the smartphone app and accesses the "New Registration" screen.

[1214] Specifically, the user launches the app and taps the "New Registration" button, which displays the account information entry screen.

[1215] Step 2:

[1216] The user enters their name, email address, and password and clicks the "Register" button.

[1217] Specifically, the user fills in the relevant fields and taps the "Register" button. The input data, such as name, email address, and password, is constructed as form data.

[1218] Step 3:

[1219] The terminal sends the entered account information to the server in JSON format.

[1220] Input: Form data (name, email address, password)

[1221] Output: Generates a request containing account information in JSON format.

[1222] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / register").

[1223] Step 4:

[1224] The server analyzes the received account information and stores it in a database.

[1225] Input: JSON data received by the server

[1226] Output: New record added to the database

[1227] Specifically, the server parses the JSON data and saves the new account information in a database, such as MySQL.

[1228] Step 5:

[1229] The server generates a response indicating successful account registration and sends it to the terminal.

[1230] Input: Registration information after saving to the database

[1231] Output: JSON response containing the registration success status

[1232] Specifically, the server generates a response including a status code (e.g., 200) and a message (e.g., "Registration successful") indicating successful registration, and sends this response to the terminal as an HTTP response.

[1233] Step 6:

[1234] The terminal analyzes the response received and displays a notification to the user that the account registration was successful.

[1235] Input: Response from the server

[1236] Output: Account registration success message displayed

[1237] Specifically, the device analyzes the response and displays a notification such as "Account registration successful" on the screen.

[1238] Step 7:

[1239] The user accesses the "Add Contact" screen within the app.

[1240] Specifically, the user taps the "Add Contact" button within the app, and a screen for entering contact information appears.

[1241] Step 8:

[1242] The user enters the contact name, contact method, and contact information.

[1243] Specifically, the user enters "Name," "Contact Method" (e.g., LINE, email), and "Contact Information," and then taps the "Save" button.

[1244] Step 9:

[1245] The device sends the entered contact information to the server.

[1246] Input: Form data (name, contact method, contact information)

[1247] Output: Generates a request containing contact information in JSON format.

[1248] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / add_contact").

[1249] Step 10:

[1250] The server parses the received contact information and stores it in a database.

[1251] Input: JSON data received by the server

[1252] Output: New record added to the database

[1253] Specifically, the JSON data is parsed on the server side and the new contact information is saved in the database.

[1254] Step 11:

[1255] The server generates a response indicating that the contact registration was successful and sends it to the device.

[1256] Input: Contact information after saving to database

[1257] Output: JSON response containing the contact registration success status

[1258] Specifically, the server generates a response including a status code (e.g., 200) indicating successful registration and a message (e.g., "Contact registration successful"), and sends it to the terminal as an HTTP response.

[1259] Step 12:

[1260] The terminal analyzes the response received and displays a notification to the user that the contact registration was successful.

[1261] Input: Response from the server

[1262] Output: Contact registration success message displayed

[1263] Specifically, the device analyzes the response and displays a notification on the screen such as "Contact registration successful."

[1264] Step 13:

[1265] The user accesses the "Create Letter" screen within the app.

[1266] Specifically, the user taps the "Create a letter" button within the app, and the letter creation screen appears.

[1267] Step 14:

[1268] The user types a message and selects a photo.

[1269] Specifically, the user enters text in the "Message" field, taps the "Select Photo" button to select a photo, and taps the "Save" button.

[1270] Step 15:

[1271] The terminal transmits the input message and photo data to the server.

[1272] Input: Form data for message and photo data

[1273] Output: Generates a multipart form-data request containing the message and photo data.

[1274] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / send_letter").

[1275] Step 16:

[1276] The server analyzes the received mail data and stores it in a database.

[1277] Input: Multipart form data received by the server

[1278] Output: New record added to the database

[1279] Specifically, the multipart form data is parsed on the server side and the new letter information is saved in the database.

[1280] Step 17:

[1281] The server generates a response indicating that the letter was created successfully and a new letter ID, and sends them to the terminal.

[1282] Input: Letter information after saving to database

[1283] Output: JSON response containing the letter creation success status and the new letter ID.

[1284] Specifically, the server generates a response including a status code indicating successful creation and a new letter ID, and sends it to the terminal as an HTTP response.

[1285] Step 18:

[1286] The terminal analyzes the response received and displays a notification to the user that the letter was successfully created.

[1287] Input: Response from the server

[1288] Output: Display of a message that the letter was created successfully

[1289] Specifically, the device analyzes the response and displays a notification on the screen such as "A letter has been created."

[1290] Step 19:

[1291] The emotion engine analyzes the message in real time and detects the keyword "thank you," for example, using a generative AI model (e.g., GPT-3).

[1292] Input: The message entered by the user

[1293] Output: Sentiment category (e.g., positive) as a result of sentiment analysis

[1294] Specifically, the emotion engine analyzes the message and detects emotion-related keywords such as "thank you."

[1295] Step 20:

[1296] The sentiment engine identifies positive sentiment from keywords.

[1297] Input: Message parsing result

[1298] Output: Emotion identification result (e.g., positive)

[1299] Specifically, the emotion engine classifies the emotion of the message into positive, negative, neutral, etc. based on the analysis results.

[1300] Step 21:

[1301] The emotion engine suggests template messages based on positive emotions, e.g., "Thank you for everything. How are you?"

[1302] Input: Emotion identification result

[1303] Output: Template message suggestions

[1304] Specifically, the emotion engine selects from a list of pre-set template messages corresponding to positive emotions and suggests them to the user.

[1305] Step 22:

[1306] When a user selects a photo, photos that match positive emotions (e.g., photos of smiling faces or landscapes) are filtered and displayed from a large number of photos.

[1307] Input: User-selected photos and emotion recognition results

[1308] Output: A list of photos based on emotions

[1309] Specifically, the emotion engine filters photos that match the emotion of the selected message and displays a list of candidates to the user.

[1310] Step 23:

[1311] The user accesses the "Send Letter" screen.

[1312] Specifically, the user taps the "Send letter" button within the app, and the letter sending screen appears.

[1313] Step 24:

[1314] The user selects the letter they want to send and selects the contact information to which they want to send it. After confirming that the address is correct, the user presses the "Send" button.

[1315] Specifically, the user selects the letter and contacts to send and taps the "Send" button.

[1316] Step 25:

[1317] The device sends the selected letter ID and the recipient list to the server in JSON format.

[1318] Input: Letter ID and recipient list

[1319] Output: Send request

[1320] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / send_message").

[1321] Step 26:

[1322] The server retrieves the specified letter content from the database and sends it based on the contact list. The sending method can be the LINE API, email, or printed postcard.

[1323] Input: Letter ID and recipient list

[1324] Output: Message sent by each sending method

[1325] Specifically, the server retrieves the contents of the letter from the database and sends the message according to the sending method.

[1326] Step 27:

[1327] The server generates a successful response and sends it to the terminal.

[1328] Input: Message sending result

[1329] Output: Successful sending response

[1330] As a specific operation, the server generates a response including a status code and a message indicating that the transmission was successful, and sends it to the terminal.

[1331] Step 28:

[1332] The terminal analyzes the response received and displays a notification to the user that the letter was sent successfully.

[1333] Input: Response from the server

[1334] Output: Message of successful sending

[1335] Specifically, the device analyzes the response and displays a notification such as "Your letter has been sent" on the screen.

[1336] Step 29:

[1337] The user accesses the "Reminder Settings" screen within the app.

[1338] Specifically, the user taps the "Set reminder" button within the app, and the reminder setting screen appears.

[1339] Step 30:

[1340] The user selects the frequency of the reminder (weekly, monthly, etc.) and presses the "Set" button.

[1341] Specifically, the user selects the frequency of the reminder and taps the "Set" button.

[1342] Step 31:

[1343] The device sends the set reminder frequency in JSON format to the server.

[1344] Input: Reminder setting information

[1345] Output: Reminder setting request

[1346] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / set_reminder").

[1347] Step 32:

[1348] The server analyzes the received reminder information and registers a periodic reminder sending task in the scheduler.

[1349] Input: Reminder setting information

[1350] Output: Task registration to scheduler

[1351] Specifically, the server registers the task as a periodic task in the reminder scheduler using a Cron expression or similar.

[1352] Step 33:

[1353] When the time for the reminder arrives, the server sends a notification to the user using the LINE API or push notification.

[1354] Input: Scheduled reminder execution timing

[1355] Output: Send notification message

[1356] Specifically, the server sends a notification to the user's device via the LINE API or push notification service based on the reminder content.

[1357] Step 34:

[1358] The emotion engine analyzes a user's past messages and behavior to infer their current emotional state.

[1359] Input: Past messages and behavioral data

[1360] Output: Current emotional state

[1361] Specifically, the emotion engine analyzes past message history and infers the user's current emotional state.

[1362] Step 35:

[1363] The server receives input from the emotion engine and generates reminder content based on the emotional state.

[1364] Input: Emotional state data

[1365] Output: personalized reminder content

[1366] Specifically, the server generates a reminder notification based on the emotion data. For example, it might say, "You seem tired lately. Let's send a letter to refresh your mind."

[1367] Step 36:

[1368] The server transmits the generated reminder content to the user terminal.

[1369] Input: Personalized reminder content

[1370] Output: Send reminder notification

[1371] Specifically, the server uses the LINE API and push notifications to send personalized reminder content to the user's device.

[1372] (Application example 2)

[1373] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1374] Conventional account registration systems and message sending systems have difficulty in providing personalized suggestions based on the user's emotional state. In addition, there is a lack of methods to appropriately suggest content that matches the user's emotions when providing specific services, and there is a need to improve the user experience.

[1375] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting account information, means for transmitting the account information to the server, means for saving the account information in a database, means for receiving a response from the server indicating that account registration was successful, means for inputting emotion analysis data, means for proposing appropriate information based on the emotion analysis data, and means for providing services using the proposed information. This makes it possible to provide information and services personalized based on the user's emotional state.

[1376] "Account information" refers to personal identification information such as a user's name, email address, and password.

[1377] A "server" is a device that stores and manages information over a network.

[1378] A "database" is a system for systematically storing, searching, and managing information.

[1379] "Emotion analysis data" is data resulting from an analysis of a user's emotions based on the text and actions entered by the user.

[1380] "Appropriate information" is information about content or services that are suggested based on the user's emotional state.

[1381] "Personalization" refers to providing content that is adapted to each user's individual preferences and feelings.

[1382] "Image data" is visual information such as photographs or pictures that a user selects or uploads.

[1383] A "response" is response information returned from a server to a client (user's terminal).

[1384] A "message" is text data that a user sends or receives.

[1385] A "means" is a method, device, or element of a system for achieving a specific purpose.

[1386] The present invention provides a food delivery system that analyzes user emotions and provides suggestions and information based on the analysis. Specific embodiments of the system are described below.

[1387] Account Registration

[1388] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button. The device sends the entered account information to the server. The server stores the received account information in a database, generates a response indicating successful account registration, and sends it to the device. The device receives the response and displays a notification to the user indicating successful account registration.

[1389] Input of sentiment analysis data

[1390] The user enters their current mood and emotions into the app's "Mood Input" screen. The device then sends the entered emotion analysis data to the server. The server then analyzes the received emotion analysis data using a generative AI model to determine the user's emotional state.

[1391] Generate suggestions

[1392] Based on the emotion analysis, the server generates information to suggest menus and services that match the user's emotional state. For example, if the emotion analysis results in "stress," the server selects "relaxing drinks" and "soothing menus" from the database and generates information to suggest to the user.

[1393] Providing proposal information

[1394] Users can check the menu information suggested by the server on the "Suggested Menu" screen within the app. The device receives this information from the server and displays a menu based on the analysis results. This allows users to easily choose a meal that suits their mood that day.

[1395] Hardware and software used

[1396] The system is implemented using the following hardware and software:

[1397] Hardware: User's smartphone

[1398] software:

[1399] Emotion analysis model (generative AI model)

[1400] Food Delivery API

[1401] For data processing and calculation, the text entered by the user is sent to an emotion analysis model, and based on the output results, menu suggestions are made using a food delivery API.

[1402] Specific examples

[1403] For example, a user accesses the app and inputs "I'm tired." The device sends this input to the server, which then analyzes the "feeling of fatigue" using an emotion analysis model. Based on the results, the server generates information suggesting "relaxing drinks" and "relaxing foods," and sends it to the user's smartphone.

[1404] Prompt Sentence Examples

[1405] The user inputs "I'm tired." After analyzing it using a sentiment analysis model, "feeling tired" is detected. Based on this, suggest "drinks that will help you relax."

[1406] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1407] Step 1:

[1408] The user enters their account information through a smartphone app. The entered account information includes their name, email address, and password. The device receives this information and sends it to the server. Input: User's account information. Output: Account information sent to the server.

[1409] Step 2:

[1410] The server stores the received account information in a database. It then generates a response indicating that the account registration was successful and sends it to the terminal. Input: Account information sent to the server. Output: Response indicating that the account registration was successful.

[1411] Step 3:

[1412] The terminal receives the response from the server and displays a notification to the user that the account registration was successful. Input: Response that the account registration was successful. Output: Notification that the account registration was successful displayed to the user.

[1413] Step 4:

[1414] The user enters their current mood and emotions in text on the "Mood Input" screen within the app. The device receives this input emotion data and sends it to the server. Input: Text data of the user's mood and emotions. Output: Emotion data sent to the server.

[1415] Step 5:

[1416] The server analyzes the received emotion data using a generative AI model. It obtains the emotion analysis results and determines the user's emotional state. Input: Emotion data sent to the server. Output: Emotion analysis results.

[1417] Step 6:

[1418] Based on the emotion analysis results, the server generates menu and service suggestion information that matches the user's emotional state. For example, if the emotion analysis result is "stress," the server selects "relaxing drinks" or "soothing menus" from the database. Input: Emotion analysis results. Output: Suggestion information.

[1419] Step 7:

[1420] The server sends the generated proposal information to the terminal. Input: Proposal information. Output: Proposal information sent to the terminal.

[1421] Step 8:

[1422] The device receives the suggestion information from the server and displays it to the user on the "Suggestion Menu" screen within the app. Input: Suggestion information from the server. Output: Suggestion menu displayed to the user.

[1423] This allows users to easily select meals and services that suit their mood that day.

[1424] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1425] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1426] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1427] [Third embodiment]

[1428] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1429] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1430] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1431] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1432] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1433] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1434] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1435] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1436] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1437] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1438] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1439] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1440] The present invention provides a system for assisting users in periodically sending letters with photographs to important people. Specific embodiments of the system will be described below.

[1441] Account Registration Implementation

[1442] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[1443] The terminal transmits the entered account information to the server.

[1444] The server stores the received data in a database and returns a response to the terminal indicating that the account registration was successful.

[1445] The terminal displays the response and notifies the user.

[1446] Contact registration embodiment

[1447] Users enter the name, contact method (LINE, email, address), and contact information (LINE ID, email address, address) on the "Add Contact" screen within the app.

[1448] The terminal transmits the entered contact data to the server.

[1449] The server stores the received contact data in a database and returns a response indicating successful contact registration to the terminal.

[1450] The terminal displays the response and notifies the user.

[1451] Example of creating a letter

[1452] The user enters a message and selects the photo they want to send on the "Create a letter" screen within the app. After confirming that the information entered is correct, the user presses the "Create" button.

[1453] The device sends the message and photo data to the server.

[1454] The server stores the received letter data in a database and returns a response indicating that the letter was successfully created and a new letter ID to the terminal.

[1455] The terminal displays the response and notifies the user.

[1456] Example of sending a letter

[1457] On the "Send Letter" screen, the user selects the letter they want to send and the contact information they want to send it to. After confirming that the recipient is correct, the user presses the "Send" button.

[1458] The terminal sends the selected letter ID and the recipient list to the server.

[1459] The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The sending method can be LINE message, email, or printed postcard. After sending, the server returns a successful response to the device.

[1460] The terminal displays the response and notifies the user.

[1461] Reminder setting implementation example

[1462] The user selects the frequency of the reminder (e.g., weekly, monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button.

[1463] The device sends the set reminder frequency to the server.

[1464] The server registers a periodic reminder sending task in the scheduler based on the received reminder information. When the reminder time comes, the server sends the user a LINE message or app notification, prompting them to write a letter.

[1465] Specific examples

[1466] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[1467] 1. Register an account and add your grandmother's LINE ID as a contact.

[1468] 2. Set a reminder for the first of every month.

[1469] 3. When you receive a reminder, select a new message and a recent family photo, then compose and send the letter.

[1470] 4. The server sends a message and photo to the grandmother's LINE ID based on the letter data received.

[1471] The system of the present invention allows users to easily stay in touch with important people even in their busy daily lives. This system facilitates communication between people and helps deepen relationships with family and friends.

[1472] The processing flow will be explained below.

[1473] Account registration process

[1474] Step 1:

[1475] The user installs the app and accesses the "New Registration" screen.

[1476] The user enters their name, email address, and password.

[1477] Step 2:

[1478] The terminal transmits the entered account information to the server.

[1479] Step 3:

[1480] The server stores the received account information in a database.

[1481] Step 4:

[1482] The server generates a response indicating successful account registration and sends it to the terminal.

[1483] Step 5:

[1484] The terminal receives the response from the server and displays a notification to the user that the account registration was successful.

[1485] Contact registration process

[1486] Step 1:

[1487] The user accesses the "Add Contact" screen within the app.

[1488] The user enters the contact's name, contact method (LINE, email, address), and corresponding contact information.

[1489] Step 2:

[1490] The device sends the entered contact information to the server.

[1491] Step 3:

[1492] The server stores the received contact information in a database.

[1493] Step 4:

[1494] The server generates a response indicating that the contact registration was successful and sends it to the device.

[1495] Step 5:

[1496] The terminal receives the response from the server and displays a notification to the user that the contact registration was successful.

[1497] Processing of letter creation

[1498] Step 1:

[1499] The user accesses the "Create Letter" screen within the app.

[1500] The user enters a message and selects the photos they want to send.

[1501] Step 2:

[1502] The device sends the message and photo data to the server.

[1503] Step 3:

[1504] The server stores the received letter data in a database and generates a stored letter ID.

[1505] Step 4:

[1506] The server sends a response indicating that the letter was successfully created and the generated letter ID to the terminal.

[1507] Step 5:

[1508] The terminal receives the response from the server and displays a notification to the user that the letter was successfully created.

[1509] Processing of letter transmission

[1510] Step 1:

[1511] The user accesses the "Send Letter" screen within the app.

[1512] Users select the letter they want to send and select the contacts to send it to.

[1513] Step 2:

[1514] The terminal sends the selected letter ID and the recipient list to the server.

[1515] Step 3:

[1516] The server retrieves the specified letter content from the database.

[1517] Step 4:

[1518] The server sends the letter to each contact based on the contact list, using either a LINE message, email, or a printed postcard.

[1519] Step 5:

[1520] The server generates a response indicating that the letter was sent successfully and sends it to the terminal.

[1521] Step 6:

[1522] The terminal receives the response from the server and displays a notification to the user that the letter was sent successfully.

[1523] Handling reminder settings

[1524] Step 1:

[1525] The user accesses the "Reminder Settings" screen within the app.

[1526] The user selects the frequency of the reminder (e.g., weekly, monthly).

[1527] Step 2:

[1528] The device sends the set reminder frequency to the server.

[1529] Step 3:

[1530] Based on the reminder information received by the server, a periodic reminder sending task is registered in the scheduler.

[1531] Step 4:

[1532] When the server reaches the time of the reminder, it will send a LINE message or app notification to the user.

[1533] Step 5:

[1534] Users receive a reminder and are prompted to take action to create and send a new letter.

[1535] The above is the flow of specific processing steps for carrying out the present invention.

[1536] Example 1

[1537] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1538] In today's society, it is not easy to maintain contact with loved ones amidst our busy daily lives. Regular contact with elderly people and family members who live far away is especially important to convey gratitude and affection, but we often forget when to do so. Furthermore, with so many different communication methods available, it can be tedious to know which method to choose and to set it up each time. A system that can solve these problems is needed.

[1539] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1540] In this invention, the server includes a means for inputting account information, a means for inputting contact information, and a means for inputting a message and image data. This allows a user to easily register an account, add contacts, and select and send a message and image. Furthermore, by combining a means for receiving a response indicating successful contact registration, a means for receiving a response indicating successful message and image data transmission, a means for sending a message and image data to a specified target person, a means for setting the frequency of reminders, and a means for receiving reminder notifications, the user can periodically send messages to important people and avoid missing a chance to contact them.

[1541] "Account information" refers to identification data such as name, email address, and password that a user uses to register with the system.

[1542] "Server" means a computer system that stores account information, contact information, messages, and image data and performs necessary processing.

[1543] "Database" means a system located on the server for structuring, managing, and storing account information, contact information, messages, and image data.

[1544] "Contact information" refers to the name of the person the user wants to contact, the means of contact (LINE, email, address, etc.), and specific contact information (LINE ID, email address, address, etc.).

[1545] A "message" is text data that a user wants to send.

[1546] "Image data" refers to image files such as photographs and drawings that a user wants to send.

[1547] A "response" is a processing result or success notification returned from the server to the terminal.

[1548] "Reminder" is a function that sends notifications to users at specific times to encourage them to take action.

[1549] "Reminder frequency" refers to the period or timing at which reminder notifications are sent, and is set by the user.

[1550] A "scheduler" is a program that manages periodic tasks on the server side and sends reminder notifications.

[1551] "Frequency" means the time interval at which reminders or notifications are sent.

[1552] A "notification" is a message or alert sent to a user to prompt them to take action.

[1553] "Contact method" refers to the communication method (e.g., LINE, email, mail, etc.) used to send messages and image data.

[1554] A "destination list" is a list of contact information for recipients to whom messages and image data are to be sent.

[1555] This invention is a system that helps users to send regular letters with photos to their loved ones. This system consists of three main components: a server, a terminal, and a user.

[1556] Account Registration

[1557] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[1558] The terminal sends the account information entered by the user to the server using an HTTP POST request.

[1559] The server analyzes the received account information and saves it in a database. If the save is successful, the server generates a response indicating that the account registration was successful and sends it to the terminal.

[1560] The terminal receives this response and notifies the user that "registration was successful."

[1561] Contact registration

[1562] Within the app, users access the "Add Contact" screen and enter the name, contact method, and specific contact information of the person they want to contact.

[1563] The device sends the contact information entered by the user to the server, again using an HTTP POST request.

[1564] The server analyzes the received contact information and saves it in the database. If the save is successful, the server generates a response indicating that the contact information was successfully registered and sends it to the device.

[1565] The terminal receives this response and notifies the user that "contact registration was successful."

[1566] Creating a letter

[1567] The user accesses the "Create a letter" screen within the app, enters a message, selects the photos they want to send, and presses the "Create" button.

[1568] The device sends the message and photo data to the server using an HTTP POST request, with the data sent in JSON format.

[1569] The server analyzes the received letter data and saves it in the database. If the save is successful, the server generates a response indicating that the letter was created successfully and a new letter ID, and sends them to the device.

[1570] The terminal receives this response and notifies the user that "the letter has been created successfully."

[1571] Send a letter

[1572] On the "Send Letter" screen, the user selects the letter they want to send and the recipient, and presses the "Send" button.

[1573] The device sends the letter ID and the recipient list to the server using an HTTP POST request, with the data sent in JSON format.

[1574] The server retrieves the letter content from the database and sends it based on the contact list, using the LINE API, a mail server, and a mail printing service.

[1575] If the transmission is successful, the server generates a response indicating the success of the transmission and sends it to the terminal.

[1576] The terminal receives this response and notifies the user that "the letter has been sent successfully."

[1577] Reminder settings

[1578] The user selects the reminder frequency on the "Reminder Settings" screen and presses the "Set" button.

[1579] The device sends the reminder frequency information to the server using an HTTP POST request.

[1580] The server registers the received reminder information in a scheduler, which uses a cron job.

[1581] When the time for the reminder arrives, the server will send a reminder to the user via LINE message or app notification, prompting them to write the letter.

[1582] Specific examples

[1583] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[1584] 1. The user registers an account and adds the grandmother's contact information (e.g., LINE ID) to the contacts.

[1585] 2. Set a reminder for the first of every month.

[1586] 3. Upon receiving the reminder, the user selects a new message and a recent family photo, composes the letter, and sends it.

[1587] 4. Based on the letter data received by the server, a message and photo are sent to the grandmother's LINE ID.

[1588] Example prompts to input to a generative AI model:

[1589] "Please tell me how to register an account to send a photo message to my grandmother once a month, add her LINE ID to my contacts, and set a reminder for the first of every month. Also, please provide detailed instructions on how to create and send the message after receiving the reminder."

[1590] The system of the present invention allows users to easily stay in touch with important people and deepen relationships with family and friends even in the midst of their busy lives.

[1591] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1592] Step 1: Enter your account information

[1593] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password. The input is "Yamada Taro", "taro@example.com", and "password123". This is the input for this step. This information is ready to be processed in the next step.

[1594] Step 2: Submit your account information

[1595] The device sends the account information entered by the user to the server using an HTTP POST request. The data is then processed on the device into the following JSON format:

[1596] json

[1597] {

[1598] "name": "Yamada Taro",

[1599] "email": "taro@example.com",

[1600] "password": "password123"

[1601] }

[1602] The processed data is the output of this step and is sent to the server.

[1603] Step 3: Save your account information

[1604] The server parses the received account data and saves it in a database. SQL queries are used for saving, and MySQL is used as the database management system. The input to this step is the JSON data sent in step 2. If the server successfully saves the data, it generates response data with a "success" status, which becomes the output for the next step.

[1605] Step 4: Send and display the response

[1606] The server generates a JSON response like this and sends it to the device:

[1607] json

[1608] {

[1609] "status": "success",

[1610] "message": "Registration successful"

[1611] }

[1612] This response is the input for step 4. The terminal receives this response and notifies the user that "registration was successful." This is the final output.

[1613] Step 5: Enter your contact information

[1614] The user accesses the "Add Contact" screen within the app and enters the name of the person they want to contact, their contact method, and specific contact information. The input is "Grandmother," "LINE," and "grandma123." This is the input for this step.

[1615] Step 6: Submit your contact information

[1616] The device sends the entered contact data to the server using an HTTP POST request, and the data is formatted as JSON:

[1617] json

[1618] {

[1619] "name": "Grandmother",

[1620] "method": "LINE",

[1621] "contact": "grandma123"

[1622] }

[1623] The processed data is the output of this step and is sent to the server.

[1624] Step 7: Save your contact information

[1625] The server parses the received contact data and saves it in a database. It uses SQL queries to save the data and MySQL as the database management system. The input to this step is the JSON data sent in step 6. If the server successfully saves the data, it generates a response data with a "success" status, which becomes the output for the next step.

[1626] Step 8: Send and Display the Response

[1627] The server generates a JSON response like this and sends it to the device:

[1628] json

[1629] {

[1630] "status": "success",

[1631] "message": "Contact registration successful"

[1632] }

[1633] This response is the input for step 8. The device receives this response and notifies the user that "Contact registration was successful." This is the final output.

[1634] Step 9: Write a message and select a photo

[1635] The user accesses the "Create a letter" screen, enters a message, and selects the photo they want to send. The input is "How are you?" and the selected photo file. This is the input for this step.

[1636] Step 10: Send your letter

[1637] The device sends the entered message and photo data to the server using an HTTP POST request, and the data is processed into the following JSON format:

[1638] json

[1639] {

[1640] "message": "How are you?",

[1641] "photo": "<base64_encoded_photo> "

[1642] }

[1643] The processed data is the output of this step and is sent to the server.

[1644] Step 11: Save your letter data

[1645] The server parses the received letter data and saves it in a database. SQL queries are used for saving, and MySQL is used as the database management system. The input to this step is the JSON data sent in step 10. If the server successfully saves the data, it generates response data with a "success" status and a new letter ID, which becomes the output of the next step.

[1646] Step 12: Send and Display the Response

[1647] The server generates a JSON response like this and sends it to the device:

[1648] json

[1649] {

[1650] "status": "success",

[1651] "message": "Letter created successfully",

[1652] "letter_id": "12345"

[1653] }

[1654] This response is the input to step 12. The terminal receives this response and notifies the user that "The letter was created successfully." This is the final output.

[1655] Step 13: Select the message you want to send and who you want to send it to

[1656] On the "Send Letter" screen, the user selects the letter they want to send and the recipient. The input is the letter ID "12345" and the recipient information "Grandmother's LINE ID (grandma123)." This is the input for this step.

[1657] Step 14: Sending outgoing data

[1658] The device sends the letter ID and destination information to the server using an HTTP POST request, and the data is processed into the following JSON format:

[1659] json

[1660] {

[1661] "letter_id": "12345",

[1662] "recipients": [

[1663] {

[1664] "method": "LINE",

[1665] "contact": "grandma123"

[1666] }

[1667] ]

[1668] }

[1669] The processed data is the output of this step and is sent to the server.

[1670] Step 15: Send your letter

[1671] The server retrieves the letter content from the database and sends it based on the contact list. To send the letter, it uses the LINE API, a mail server, and a mail printing service. The letter data is processed to suit the appropriate sending method and sent to each service. This is the specific operation. The input to this step is the JSON data sent in step 14, and the output is the sending result from each service.

[1672] Step 16: Sending and Displaying the Response

[1673] The server generates a successful response and sends it to the device:

[1674] json

[1675] {

[1676] "status": "success",

[1677] "message": "Your message was sent successfully"

[1678] }

[1679] This response is the input to step 16. The terminal receives this response and notifies the user that "your letter has been sent successfully." This is the final output.

[1680] Step 17: Select Reminder Frequency

[1681] The user selects the frequency of the reminder on the "Reminder Settings" screen. The input is "1st of every month." This is the input for this step.

[1682] Step 18: Send Reminder Settings

[1683] The device sends the reminder frequency information to the server using an HTTP POST request, and the data is formatted as JSON:

[1684] json

[1685] {

[1686] "frequency": "1st of every month"

[1687] }

[1688] The processed data is the output of this step and is sent to the server.

[1689] Step 19: Register a reminder task

[1690] The server registers a reminder task in the scheduler based on the received reminder information. A cron job is used as the scheduler. The input of this step is the JSON data sent in step 18. The server sets a task in the scheduler based on the reminder information, which is the output of the next step.

[1691] Step 20: Reminders

[1692] When the reminder time comes, the server sends a reminder to the user via LINE message or app notification, prompting them to write a letter. The notification message is "Don't forget to write a letter." The input to this step is the reminder notification trigger from the scheduler, and the output is the notification message to the user.

[1693] This allows users to easily stay in touch with loved ones and send regular photo messages.

[1694] (Application example 1)

[1695] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1696] Today, many people face the challenge of finding time to maintain communication with loved ones in their busy lives. As a result, relationships with family and friends tend to become estranged, especially when they live far apart. Furthermore, sending messages and photos regularly takes time and effort, and people often forget to do so. Furthermore, when users want to create timely and personal messages, they often find themselves at a loss as to what to include and how to include them.

[1697] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1698] In this invention, the server includes means for inputting account information, means for transmitting the account information to the server, means for saving the account information in a database, means for receiving a response from the server indicating successful account registration, means for inputting message and photo data, means for transmitting the message and photo data to the server, means for saving the message and photo data in a database, means for scheduling periodic transmission, a reminder means for sending a notification based on the scheduling information, means for automatically sending the message and photo data to designated contacts, means for assisting a user in creating a message using a generative AI model, and means for automatically generating an appropriate message by inputting a prompt sentence, thereby enabling a user to contact important people efficiently and in a timely manner and helping to maintain and strengthen relationships.

[1699] "Account information" refers to identification information such as name, email address, and password that a user uses to register with the system.

[1700] "Server" refers to a central system for storing and managing account information, message data, and the like.

[1701] A "database" is a system for systematically storing and managing account information, contact information, message data, etc. within a server.

[1702] A "message" is text data that a user inputs to send to other users.

[1703] "Photo data" is an image file that a user selects to attach to a message.

[1704] "Contact information" refers to the name and contact method (email address, telephone number, etc.) that a user registers as a message recipient.

[1705] A "response" is a reply or response message sent from a server to a client device.

[1706] "Scheduling" refers to creating a plan to automatically send messages and photo data based on a preset date, time, and frequency.

[1707] "Reminder" is a notification function that prompts the user to create and send a message.

[1708] A "generative AI model" is an artificial intelligence technology that automatically generates appropriate messages based on prompts entered by users.

[1709] A "prompt" is a simple instruction that is input to a generative AI model, and is the text that a message is generated based on.

[1710] The present invention is a system that helps users regularly send letters with photos to their loved ones. The system includes account registration, contact registration, message and photo data input and sending, periodic sending scheduling, reminder notifications, and message generation support using a generative AI model.

[1711] Account Registration Implementation

[1712] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password, and presses the "Register" button. The device sends the entered account information to the server. The server stores the received data in a database and returns a response to the device indicating successful account registration. The device displays the response and notifies the user.

[1713] Contact registration embodiment

[1714] The user enters their name, contact method (email address, phone number, etc.), and contact information on the "Add Contact" screen within the app. The device sends the entered contact data to the server. The server saves the received contact data in a database and returns a response to the device indicating that the contact was successfully registered. The device displays the response and notifies the user.

[1715] Embodiments of inputting and sending message and photo data

[1716] The user enters a message and selects the photo they want to send on the "Create a letter" screen within the app. After confirming that the input is correct, the user presses the "Create" button. The device then sends the message and photo data to the server. The server stores the received letter data in a database and returns a response indicating that the letter was successfully created and a new letter ID to the device. The device then displays the response and notifies the user.

[1717] Periodic Transmission Scheduling Embodiments

[1718] The user selects the reminder frequency (e.g., weekly or monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button. The device sends the set reminder frequency to the server. Based on the received reminder information, the server registers a periodic reminder sending task in the scheduler. When the time for the reminder arrives, the server sends the user an app notification prompting them to create a letter.

[1719] Implementation of automatic sending to designated contacts

[1720] On the "Send Letter" screen, the user selects the letter they wish to send and the contacts to whom they wish to send it. After confirming that the recipients are correct, the user presses the "Send" button. The device sends the selected letter ID and recipient list to the server. The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The sending method can be email, etc. After sending, the server returns a response to the device indicating that the message was sent successfully. The device displays the response and notifies the user.

[1721] Implementation of message generation support using generative AI model

[1722] If a user has difficulty creating a message, they can use a generative AI model to generate an appropriate message. The user enters a short prompt, and the AI ​​generates a message based on that prompt. This prompt can include specific content, such as "A message about a recent family trip." The generated message can then be reviewed by the user, and modified as needed.

[1723] Prompt Sentence Examples

[1724] Example 1: "A message about a recent family trip"

[1725] Example 2: "New Year's greeting message"

[1726] This allows users to connect with important people in an efficient and timely manner, helping them maintain and strengthen relationships, and the generative AI model allows users to easily create personalized messages.

[1727] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1728] Step 1:

[1729] A user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password, and presses the "Register" button. The device receives the user's name, email address, and password as input and sends them to the server. The server stores the input data in a database, generates a response indicating successful account registration, and sends it back to the device. The device displays this response and notifies the user, thereby letting them know that the user's account has been created successfully.

[1730] Step 2:

[1731] The user enters their name, contact method (email address, phone number, etc.), and contact information on the "Add Contact" screen within the app. The device receives the user's contact information as input and sends it to the server. The server stores the received contact data in a database, generates a response indicating successful contact registration, and sends it back to the device. The device displays this response and notifies the user, allowing the user to register the appropriate contact.

[1732] Step 3:

[1733] The user enters a message and selects the photo they want to send on the "Create a letter" screen within the app. The device receives the message and photo data as input and sends it to the server. The server stores the received data in a database, generates a response indicating that the letter was created successfully, and a new letter ID, which it returns to the device. The device displays this response and notifies the user. This effectively saves the user's letter data.

[1734] Step 4:

[1735] The user selects the frequency of the reminder (e.g., weekly or monthly) on the "Reminder Settings" screen within the app. The device receives the reminder frequency information as input and sends it to the server. The server then registers a periodic reminder sending task in the scheduler based on the received data. When the time for the reminder arrives, the server sends a notification to the user, prompting them to create a letter. This allows the user to create letters on a regular basis.

[1736] Step 5:

[1737] On the "Send Letter" screen, the user selects the letter they want to send and the contacts to whom they want to send it. The terminal receives the letter ID and recipient list as input, and sends this to the server. The server retrieves the specified letter content from the database and automatically sends the message and photo data based on the contact list. The server generates a response indicating successful sending and sends it back to the terminal. The terminal displays this response and notifies the user. This causes the user's letter to be automatically sent to the appropriate contacts.

[1738] Step 6:

[1739] If a user has difficulty creating a message, they can use the app's "AI Generation Assistance" function. The device receives a prompt sentence (e.g., "A message about a recent family trip") as input and sends it to the generative AI model. The generative AI model generates an appropriate message based on the prompt sentence and sends it back to the device. The device displays the generated message to the user, who can modify it as needed. This allows the user to effectively create personalized messages using the generative AI model.

[1740] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1741] The present invention provides an account registration system that combines an emotion engine and a system that supports users in periodically sending letters with photos to important people. Specific embodiments of the system will be described below.

[1742] Account Registration Implementation

[1743] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[1744] The terminal transmits the entered account information to the server.

[1745] The server stores the received account information in a database, generates a response indicating that the account registration was successful, and sends it to the terminal.

[1746] The terminal receives the response and displays a notification to the user that the account registration was successful.

[1747] Contact registration embodiment

[1748] Users enter the contact's name, contact method (LINE, email, address), and corresponding contact information on the "Add Contact" screen within the app.

[1749] The terminal transmits the entered contact information to the server.

[1750] The server stores the received contact information in a database, generates a response indicating that the contact registration was successful, and sends it to the terminal.

[1751] The terminal receives the response and displays a notification to the user that the contact registration was successful.

[1752] Letter creation and emotion engine implementation

[1753] Users can enter a message and select the photo they want to send on the "Create a letter" screen within the app.

[1754] The terminal transmits the input message and photo data to the server.

[1755] The server stores the received letter data in a database, generates a response indicating that the letter was successfully created, and a new letter ID, which it then sends to the terminal.

[1756] The terminal receives the response and displays a notification to the user that the letter was successfully created.

[1757] Specific functions of the emotion engine

[1758] The emotion engine identifies emotions based on user input. For example, if a user enters keywords such as "thank you" or "happy," the emotion engine will detect positive emotions.

[1759] The emotion engine suggests template messages according to the identified emotion. Furthermore, when the user selects a photo, the emotion engine filters photos that match the emotion and displays suggestions, allowing the user to easily create a letter that matches the emotion.

[1760] Example of sending a letter

[1761] On the "Send Letter" screen, the user selects the letter they want to send and the contact information they want to send it to. After confirming that the recipient is correct, the user presses the "Send" button.

[1762] The terminal sends the selected letter ID and the recipient list to the server.

[1763] The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The letter can be sent by LINE message, email, or printed postcard. After sending, the server sends a successful response to the device.

[1764] The terminal receives the response and displays a notification to the user that the letter was sent successfully.

[1765] Reminder setting implementation example

[1766] The user selects the frequency of the reminder (e.g., weekly, monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button.

[1767] The device sends the set reminder frequency to the server.

[1768] The server registers a periodic reminder sending task in the scheduler based on the received reminder information. When the reminder time comes, the server sends the user a LINE message or app notification, prompting them to write a letter.

[1769] Reminders using an emotion engine

[1770] The emotion engine analyzes the user's past messages and behavior to infer the user's current emotional state before sending a reminder.

[1771] The server receives input from the emotion engine and generates and sends reminder content appropriate to the user's mood. For example, if a user has been feeling stressed recently, the reminder might suggest something like, "Now is the time to express gratitude to someone important to you."

[1772] Specific examples

[1773] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[1774] 1. Register an account and add your grandmother's LINE ID as a contact.

[1775] 2. Set a reminder for the first day of each month. The emotion engine analyzes the user's emotions and suggests appropriate content for the message.

[1776] 3. When the user receives the reminder notification, they select a new message and a recent family photo, and then create and send a letter based on suggestions from the emotion engine.

[1777] 4. The server sends a message and photo to the grandmother's LINE ID based on the letter data received.

[1778] The system of the present invention allows users to easily stay in touch with important people even in their busy daily lives. This system facilitates communication between people and helps deepen relationships with family and friends. The introduction of an emotion engine makes it possible to provide a personalized experience that is in tune with the user's emotions.

[1779] The processing flow will be explained below.

[1780] Account registration process

[1781] Step 1:

[1782] A user installs the app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[1783] Step 2:

[1784] The terminal transmits the entered account information to the server.

[1785] Step 3:

[1786] The server stores the received account information in a database.

[1787] Step 4:

[1788] The server generates a response indicating successful account registration and sends it to the terminal.

[1789] Step 5:

[1790] The terminal receives the response from the server and displays a notification to the user that the account registration was successful.

[1791] Contact registration process

[1792] Step 1:

[1793] A user accesses the "Add Contact" screen within the app. The user enters the contact's name, contact method (LINE, email, address), and corresponding contact information.

[1794] Step 2:

[1795] The device sends the entered contact information to the server.

[1796] Step 3:

[1797] The server stores the received contact information in a database.

[1798] Step 4:

[1799] The server generates a response indicating that the contact registration was successful and sends it to the device.

[1800] Step 5:

[1801] The terminal receives the response from the server and displays a notification to the user that the contact registration was successful.

[1802] Processing of letter creation

[1803] Step 1:

[1804] The user accesses the "Make a Message" screen within the app, enters a message, and selects the photo they want to send.

[1805] Step 2:

[1806] The terminal transmits the input message and photo data to the server.

[1807] Step 3:

[1808] The server stores the received letter data in a database, generates a response indicating that the letter was successfully created, and a new letter ID, which it then sends to the terminal.

[1809] Step 4:

[1810] The terminal receives the response from the server and displays a notification to the user that the letter was successfully created.

[1811] Emotion engine processing

[1812] Step 1:

[1813] The terminal sends the message entered by the user to the emotion engine.

[1814] Step 2:

[1815] The emotion engine analyzes the message and identifies the user's emotion (e.g., positive, negative, neutral).

[1816] Step 3:

[1817] An emotion engine generates template message and associated photo suggestions based on the identified emotions.

[1818] Step 4:

[1819] The terminal receives the suggestions from the emotion engine and displays them to the user.

[1820] Step 5:

[1821] The user reviews the proposed template message and photo and modifies them as necessary.

[1822] Processing of letter transmission

[1823] Step 1:

[1824] The user accesses the "Send Letter" screen within the app, selects the letter they want to send, and selects the contacts to whom they want to send it.

[1825] Step 2:

[1826] The terminal sends the selected letter ID and the recipient list to the server.

[1827] Step 3:

[1828] The server retrieves the specified letter content from the database.

[1829] Step 4:

[1830] The server will send the letter to each contact based on the contact list, either via LINE message, email, or printed postcard.

[1831] Step 5:

[1832] The server generates a response indicating that the letter was sent successfully and sends it to the terminal.

[1833] Step 6:

[1834] The terminal receives the response from the server and displays a notification to the user that the letter was sent successfully.

[1835] Handling reminder settings

[1836] Step 1:

[1837] The user accesses the "Reminder Settings" screen within the app. The user selects the frequency of the reminder (e.g., weekly, monthly).

[1838] Step 2:

[1839] The device sends the set reminder frequency to the server.

[1840] Step 3:

[1841] Based on the reminder information received by the server, a periodic reminder sending task is registered in the scheduler.

[1842] Step 4:

[1843] When the server reaches the time for the reminder, it will send a LINE message or app notification to the user, prompting them to write a letter.

[1844] Applying emotion engines to handle reminders

[1845] Step 1:

[1846] The emotion engine analyzes the user's past messages and behavioral data to infer their current emotional state.

[1847] Step 2:

[1848] The server receives input from the emotion engine.

[1849] Step 3:

[1850] The server generates reminder content according to the user's current emotions.

[1851] Step 4:

[1852] The server sends the generated reminder to the user.

[1853] Step 5:

[1854] The user will receive a reminder and be prompted to take action to create and send a new letter.

[1855] The above is the flow of specific processing steps in the system of the present invention that combines an emotion engine.

[1856] Example 2

[1857] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1858] Conventional account registration systems simply manage account information and contact information, making it difficult to create and send messages that reflect the user's emotions. Furthermore, reminder settings cannot provide personalized notifications based on the user's emotional state. As a result, they are insufficiently able to help users effectively send letters with photos to their loved ones, and they are unable to improve the quality of communication.

[1859] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1860] In this invention, the server includes a means for storing account information in a database, a means for inputting and storing message and photo data, a means for performing sentiment analysis and proposing template messages, and a means for selecting appropriate photos based on the emotions. This allows users to easily create and send messages that reflect their emotions. Furthermore, by setting periodic reminders and generating and notifying reminder content based on the user's emotional state, users can ensure that they are in touch with important people and improve the quality of their communication.

[1861] "Account information" refers to information such as a name, email address, and password used to personally identify a user.

[1862] A "server" is a computer system that processes and stores various data over a network.

[1863] A "database" is a digital storage system that organizes and stores information and retrieves it as needed.

[1864] A "response" is a reaction or response data that a server returns in response to a request from a terminal.

[1865] A "message" is data entered by a user in the form of a sentence or text that describes what the user wants to communicate.

[1866] "Photo data" is the data of an image file selected by the user.

[1867] "Sentiment analysis" is a technique for identifying and classifying emotions from input messages.

[1868] A "template message" is a standard format for a message that corresponds to a specific emotion or situation.

[1869] A "reminder" is a notification or announcement that encourages a user to take a specific action.

[1870] "Contact information" refers to the name, contact method (e.g., LINE, email) and contact details of the person registered by the user.

[1871] "Reminder settings" is the process by which a user sets information to receive notifications at specific frequencies and times.

[1872] A "scheduler" is a system for executing tasks or processes at specific times or intervals.

[1873] MODE FOR CARRYING OUT THE INVENTION

[1874] The present invention provides an account registration system that combines an emotion engine and a system that supports users in sending regular letters with photos to important people. Each element of the present invention will be described in detail below.

[1875] Account Registration

[1876] The user installs the smartphone app and accesses the "New Registration" screen. After entering their name, email address, and password, the user presses the "Register" button.

[1877] The terminal transmits the entered account information to the server.

[1878] The server stores the received account information in a database, then generates a response indicating that the account registration was successful and sends it to the terminal.

[1879] The terminal receives the response and displays a notification to the user that the account registration was successful.

[1880] Contact registration

[1881] On the "Add Contact" screen within the app, the user enters the contact's name, contact method (e.g., LINE, email), and corresponding contact information.

[1882] The terminal transmits the entered contact information to the server.

[1883] The server stores the received contact information in a database, generates a response indicating that the contact registration was successful, and sends it to the terminal.

[1884] The terminal receives the response and displays a notification to the user that the contact registration was successful.

[1885] Letter creation and emotion engine

[1886] Users can enter a message and select the photo they want to send on the "Create a letter" screen within the app.

[1887] The terminal transmits the input message and photo data to the server.

[1888] The server stores the received letter data in a database, generates a response indicating that the letter was successfully created and a new letter ID, and sends them to the terminal.

[1889] The terminal receives the response and displays a notification to the user that the letter was successfully created.

[1890] The emotion engine has the ability to identify emotions based on user input. For example, if a user enters keywords such as "thank you" or "happy," the emotion engine will detect positive emotions.

[1891] The emotion engine suggests template messages according to the identified emotion. Furthermore, when the user selects a photo, the emotion engine filters photos that match the emotion and displays candidates, allowing the user to easily create a letter that matches the emotion.

[1892] Send a letter

[1893] On the "Send Letter" screen, the user selects the letter they want to send and the contact information they want to send it to. After confirming that the recipient is correct, the user presses the "Send" button.

[1894] The terminal sends the selected letter ID and the recipient list to the server.

[1895] The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The letter can be sent via LINE message, email, or printed postcard. After sending, the server sends a successful response to the device.

[1896] The terminal receives the response and displays a notification to the user that the letter was sent successfully.

[1897] Reminder settings

[1898] The user selects the frequency of the reminder (e.g., weekly, monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button.

[1899] The device sends the set reminder frequency to the server.

[1900] The server registers a periodic reminder sending task in the scheduler based on the received reminder information. When the reminder time comes, the server sends a LINE message or app notification to the user, prompting them to write a letter.

[1901] Reminders using an emotion engine

[1902] The emotion engine analyzes the user's past messages and behavior to infer the user's current emotional state before sending a reminder.

[1903] The server receives input from the emotion engine and generates and sends reminder content appropriate to the user's mood. For example, if a user has been feeling stressed recently, the reminder might suggest something like, "Now is the time to express gratitude to someone important to you."

[1904] Specific examples

[1905] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[1906] 1. Register an account and add your grandmother's LINE ID as a contact.

[1907] 2. Set a reminder for the first day of each month. The emotion engine analyzes the user's emotions and suggests appropriate content for the message.

[1908] 3. When the user receives the reminder notification, they select a new message and a recent family photo, and then create and send a letter based on suggestions from the emotion engine.

[1909] 4. The server sends a message and photo to the grandmother's LINE ID based on the letter data received.

[1910] This system allows users to easily stay in touch with loved ones even in the midst of their busy daily lives. Below is an example of a prompt sentence for sentiment analysis using a generative AI model:

[1911] "The user types a message such as 'Thank you' or 'I appreciate it.' The emotion engine should identify positive emotions in the user's message and suggest appropriate template messages."

[1912] Using this prompt sentence, the emotion engine can suggest the most suitable template message.

[1913] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1914] Step 1:

[1915] The user opens the smartphone app and accesses the "New Registration" screen.

[1916] Specifically, the user launches the app and taps the "New Registration" button, which displays the account information entry screen.

[1917] Step 2:

[1918] The user enters their name, email address, and password and clicks the "Register" button.

[1919] Specifically, the user fills in the relevant fields and taps the "Register" button. The input data, such as name, email address, and password, is constructed as form data.

[1920] Step 3:

[1921] The terminal sends the entered account information to the server in JSON format.

[1922] Input: Form data (name, email address, password)

[1923] Output: Generates a request containing account information in JSON format.

[1924] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / register").

[1925] Step 4:

[1926] The server analyzes the received account information and stores it in a database.

[1927] Input: JSON data received by the server

[1928] Output: New record added to the database

[1929] Specifically, the server parses the JSON data and saves the new account information in a database, such as MySQL.

[1930] Step 5:

[1931] The server generates a response indicating successful account registration and sends it to the terminal.

[1932] Input: Registration information after saving to the database

[1933] Output: JSON response containing the registration success status

[1934] Specifically, the server generates a response including a status code (e.g., 200) and a message (e.g., "Registration successful") indicating successful registration, and sends this response to the terminal as an HTTP response.

[1935] Step 6:

[1936] The terminal analyzes the response received and displays a notification to the user that the account registration was successful.

[1937] Input: Response from the server

[1938] Output: Account registration success message displayed

[1939] Specifically, the device analyzes the response and displays a notification such as "Account registration successful" on the screen.

[1940] Step 7:

[1941] The user accesses the "Add Contact" screen within the app.

[1942] Specifically, the user taps the "Add Contact" button within the app, and a screen for entering contact information appears.

[1943] Step 8:

[1944] The user enters the contact name, contact method, and contact information.

[1945] Specifically, the user enters "Name," "Contact Method" (e.g., LINE, email), and "Contact Information," and then taps the "Save" button.

[1946] Step 9:

[1947] The device sends the entered contact information to the server.

[1948] Input: Form data (name, contact method, contact information)

[1949] Output: Generates a request containing contact information in JSON format.

[1950] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / add_contact").

[1951] Step 10:

[1952] The server parses the received contact information and stores it in a database.

[1953] Input: JSON data received by the server

[1954] Output: New record added to the database

[1955] Specifically, the JSON data is parsed on the server side and the new contact information is saved in the database.

[1956] Step 11:

[1957] The server generates a response indicating that the contact registration was successful and sends it to the device.

[1958] Input: Contact information after saving to database

[1959] Output: JSON response containing the contact registration success status

[1960] Specifically, the server generates a response including a status code (e.g., 200) indicating successful registration and a message (e.g., "Contact registration successful"), and sends it to the terminal as an HTTP response.

[1961] Step 12:

[1962] The terminal analyzes the response received and displays a notification to the user that the contact registration was successful.

[1963] Input: Response from the server

[1964] Output: Contact registration success message displayed

[1965] Specifically, the device analyzes the response and displays a notification on the screen such as "Contact registration successful."

[1966] Step 13:

[1967] The user accesses the "Create Letter" screen within the app.

[1968] Specifically, the user taps the "Create a letter" button within the app, and the letter creation screen appears.

[1969] Step 14:

[1970] The user types a message and selects a photo.

[1971] Specifically, the user enters text in the "Message" field, taps the "Select Photo" button to select a photo, and taps the "Save" button.

[1972] Step 15:

[1973] The terminal transmits the input message and photo data to the server.

[1974] Input: Form data for message and photo data

[1975] Output: Generates a multipart form-data request containing the message and photo data.

[1976] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / send_letter").

[1977] Step 16:

[1978] The server analyzes the received mail data and stores it in a database.

[1979] Input: Multipart form data received by the server

[1980] Output: New record added to the database

[1981] Specifically, the multipart form data is parsed on the server side and the new letter information is saved in the database.

[1982] Step 17:

[1983] The server generates a response indicating that the letter was created successfully and a new letter ID, and sends them to the terminal.

[1984] Input: Letter information after saving to database

[1985] Output: JSON response containing the letter creation success status and the new letter ID.

[1986] Specifically, the server generates a response including a status code indicating successful creation and a new letter ID, and sends it to the terminal as an HTTP response.

[1987] Step 18:

[1988] The terminal analyzes the response received and displays a notification to the user that the letter was successfully created.

[1989] Input: Response from the server

[1990] Output: Display of a message that the letter was created successfully

[1991] Specifically, the device analyzes the response and displays a notification on the screen such as "A letter has been created."

[1992] Step 19:

[1993] The emotion engine analyzes the message in real time and detects the keyword "thank you," for example, using a generative AI model (e.g., GPT-3).

[1994] Input: The message entered by the user

[1995] Output: Sentiment category (e.g., positive) as a result of sentiment analysis

[1996] Specifically, the emotion engine analyzes the message and detects emotion-related keywords such as "thank you."

[1997] Step 20:

[1998] The sentiment engine identifies positive sentiment from keywords.

[1999] Input: Message parsing result

[2000] Output: Emotion identification result (e.g., positive)

[2001] Specifically, the emotion engine classifies the emotion of the message into positive, negative, neutral, etc. based on the analysis results.

[2002] Step 21:

[2003] The emotion engine suggests template messages based on positive emotions, e.g., "Thank you for everything. How are you?"

[2004] Input: Emotion identification result

[2005] Output: Template message suggestions

[2006] Specifically, the emotion engine selects from a list of pre-set template messages corresponding to positive emotions and suggests them to the user.

[2007] Step 22:

[2008] When a user selects a photo, photos that match positive emotions (e.g., photos of smiling faces or landscapes) are filtered and displayed from a large number of photos.

[2009] Input: User-selected photos and emotion recognition results

[2010] Output: A list of photos based on emotions

[2011] Specifically, the emotion engine filters photos that match the emotion of the selected message and displays a list of candidates to the user.

[2012] Step 23:

[2013] The user accesses the "Send Letter" screen.

[2014] Specifically, the user taps the "Send letter" button within the app, and the letter sending screen appears.

[2015] Step 24:

[2016] The user selects the letter they want to send and selects the contact information to which they want to send it. After confirming that the address is correct, the user presses the "Send" button.

[2017] Specifically, the user selects the letter and contacts to send and taps the "Send" button.

[2018] Step 25:

[2019] The device sends the selected letter ID and the recipient list to the server in JSON format.

[2020] Input: Letter ID and recipient list

[2021] Output: Send request

[2022] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / send_message").

[2023] Step 26:

[2024] The server retrieves the specified letter content from the database and sends it based on the contact list. The sending method can be the LINE API, email, or printed postcard.

[2025] Input: Letter ID and recipient list

[2026] Output: Message sent by each sending method

[2027] Specifically, the server retrieves the contents of the letter from the database and sends the message according to the sending method.

[2028] Step 27:

[2029] The server generates a successful response and sends it to the terminal.

[2030] Input: Message sending result

[2031] Output: Successful sending response

[2032] As a specific operation, the server generates a response including a status code and a message indicating that the transmission was successful, and sends it to the terminal.

[2033] Step 28:

[2034] The terminal analyzes the response received and displays a notification to the user that the letter was sent successfully.

[2035] Input: Response from the server

[2036] Output: Message of successful sending

[2037] Specifically, the device analyzes the response and displays a notification such as "Your letter has been sent" on the screen.

[2038] Step 29:

[2039] The user accesses the "Reminder Settings" screen within the app.

[2040] Specifically, the user taps the "Set reminder" button within the app, and the reminder setting screen appears.

[2041] Step 30:

[2042] The user selects the frequency of the reminder (weekly, monthly, etc.) and presses the "Set" button.

[2043] Specifically, the user selects the frequency of the reminder and taps the "Set" button.

[2044] Step 31:

[2045] The device sends the set reminder frequency in JSON format to the server.

[2046] Input: Reminder setting information

[2047] Output: Reminder setting request

[2048] Specifically, the device sends an HTTP POST request to the API endpoint URL (e.g., "https: / / example.com / api / set_reminder").

[2049] Step 32:

[2050] The server analyzes the received reminder information and registers a periodic reminder sending task in the scheduler.

[2051] Input: Reminder setting information

[2052] Output: Task registration to scheduler

[2053] Specifically, the server registers the task as a periodic task in the reminder scheduler using a Cron expression or similar.

[2054] Step 33:

[2055] When the time for the reminder arrives, the server sends a notification to the user using the LINE API or push notification.

[2056] Input: Scheduled reminder execution timing

[2057] Output: Send notification message

[2058] Specifically, the server sends a notification to the user's device via the LINE API or push notification service based on the reminder content.

[2059] Step 34:

[2060] The emotion engine analyzes a user's past messages and behavior to infer their current emotional state.

[2061] Input: Past messages and behavioral data

[2062] Output: Current emotional state

[2063] Specifically, the emotion engine analyzes past message history and infers the user's current emotional state.

[2064] Step 35:

[2065] The server receives input from the emotion engine and generates reminder content based on the emotional state.

[2066] Input: Emotional state data

[2067] Output: personalized reminder content

[2068] Specifically, the server generates a reminder notification based on the emotion data. For example, it might say, "You seem tired lately. Let's send a letter to refresh your mind."

[2069] Step 36:

[2070] The server transmits the generated reminder content to the user terminal.

[2071] Input: Personalized reminder content

[2072] Output: Send reminder notification

[2073] Specifically, the server uses the LINE API and push notifications to send personalized reminder content to the user's device.

[2074] (Application example 2)

[2075] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2076] Conventional account registration systems and message sending systems have difficulty in providing personalized suggestions based on the user's emotional state. In addition, there is a lack of methods to appropriately suggest content that matches the user's emotions when providing specific services, and there is a need to improve the user experience.

[2077] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting account information, means for transmitting the account information to the server, means for saving the account information in a database, means for receiving a response from the server indicating that account registration was successful, means for inputting emotion analysis data, means for proposing appropriate information based on the emotion analysis data, and means for providing services using the proposed information. This makes it possible to provide information and services personalized based on the user's emotional state.

[2078] "Account information" refers to personal identification information such as a user's name, email address, and password.

[2079] A "server" is a device that stores and manages information over a network.

[2080] A "database" is a system for systematically storing, searching, and managing information.

[2081] "Emotion analysis data" is data resulting from an analysis of a user's emotions based on the text and actions entered by the user.

[2082] "Appropriate information" is information about content or services that are suggested based on the user's emotional state.

[2083] "Personalization" refers to providing content that is adapted to each user's individual preferences and feelings.

[2084] "Image data" is visual information such as photographs or pictures that a user selects or uploads.

[2085] A "response" is response information returned from a server to a client (user's terminal).

[2086] A "message" is text data that a user sends or receives.

[2087] A "means" is a method, device, or element of a system for achieving a specific purpose.

[2088] The present invention provides a food delivery system that analyzes user emotions and provides suggestions and information based on the analysis. Specific embodiments of the system are described below.

[2089] Account Registration

[2090] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button. The device sends the entered account information to the server. The server stores the received account information in a database, generates a response indicating successful account registration, and sends it to the device. The device receives the response and displays a notification to the user indicating successful account registration.

[2091] Input of sentiment analysis data

[2092] The user enters their current mood and emotions into the app's "Mood Input" screen. The device then sends the entered emotion analysis data to the server. The server then analyzes the received emotion analysis data using a generative AI model to determine the user's emotional state.

[2093] Generate suggestions

[2094] Based on the emotion analysis, the server generates information to suggest menus and services that match the user's emotional state. For example, if the emotion analysis results in "stress," the server selects "relaxing drinks" and "soothing menus" from the database and generates information to suggest to the user.

[2095] Providing proposal information

[2096] Users can check the menu information suggested by the server on the "Suggested Menu" screen within the app. The device receives this information from the server and displays a menu based on the analysis results. This allows users to easily choose a meal that suits their mood that day.

[2097] Hardware and software used

[2098] The system is implemented using the following hardware and software:

[2099] Hardware: User's smartphone

[2100] software:

[2101] Emotion analysis model (generative AI model)

[2102] Food Delivery API

[2103] For data processing and calculation, the text entered by the user is sent to an emotion analysis model, and based on the output results, menu suggestions are made using a food delivery API.

[2104] Specific examples

[2105] For example, a user accesses the app and inputs "I'm tired." The device sends this input to the server, which then analyzes the "feeling of fatigue" using an emotion analysis model. Based on the results, the server generates information suggesting "relaxing drinks" and "relaxing foods," and sends it to the user's smartphone.

[2106] Prompt Sentence Examples

[2107] The user inputs "I'm tired." After analyzing it using a sentiment analysis model, "feeling tired" is detected. Based on this, suggest "drinks that will help you relax."

[2108] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2109] Step 1:

[2110] The user enters their account information through a smartphone app. The entered account information includes their name, email address, and password. The device receives this information and sends it to the server. Input: User's account information. Output: Account information sent to the server.

[2111] Step 2:

[2112] The server stores the received account information in a database. It then generates a response indicating that the account registration was successful and sends it to the terminal. Input: Account information sent to the server. Output: Response indicating that the account registration was successful.

[2113] Step 3:

[2114] The terminal receives the response from the server and displays a notification to the user that the account registration was successful. Input: Response that the account registration was successful. Output: Notification that the account registration was successful displayed to the user.

[2115] Step 4:

[2116] The user enters their current mood and emotions in text on the "Mood Input" screen within the app. The device receives this input emotion data and sends it to the server. Input: Text data of the user's mood and emotions. Output: Emotion data sent to the server.

[2117] Step 5:

[2118] The server analyzes the received emotion data using a generative AI model. It obtains the emotion analysis results and determines the user's emotional state. Input: Emotion data sent to the server. Output: Emotion analysis results.

[2119] Step 6:

[2120] Based on the emotion analysis results, the server generates menu and service suggestion information that matches the user's emotional state. For example, if the emotion analysis result is "stress," the server selects "relaxing drinks" or "soothing menus" from the database. Input: Emotion analysis results. Output: Suggestion information.

[2121] Step 7:

[2122] The server sends the generated proposal information to the terminal. Input: Proposal information. Output: Proposal information sent to the terminal.

[2123] Step 8:

[2124] The device receives the suggestion information from the server and displays it to the user on the "Suggestion Menu" screen within the app. Input: Suggestion information from the server. Output: Suggestion menu displayed to the user.

[2125] This allows users to easily select meals and services that suit their mood that day.

[2126] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2127] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2128] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2129] [Fourth embodiment]

[2130] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2131] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2132] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2133] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2134] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2135] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2136] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2137] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2138] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2139] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2140] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2141] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2142] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2143] The present invention provides a system for assisting users in periodically sending letters with photographs to important people. Specific embodiments of the system will be described below.

[2144] Account Registration Implementation

[2145] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[2146] The terminal transmits the entered account information to the server.

[2147] The server stores the received data in a database and returns a response to the terminal indicating that the account registration was successful.

[2148] The terminal displays the response and notifies the user.

[2149] Contact registration embodiment

[2150] Users enter the name, contact method (LINE, email, address), and contact information (LINE ID, email address, address) on the "Add Contact" screen within the app.

[2151] The terminal transmits the entered contact data to the server.

[2152] The server stores the received contact data in a database and returns a response indicating successful contact registration to the terminal.

[2153] The terminal displays the response and notifies the user.

[2154] Example of creating a letter

[2155] The user enters a message and selects the photo they want to send on the "Create a letter" screen within the app. After confirming that the information entered is correct, the user presses the "Create" button.

[2156] The device sends the message and photo data to the server.

[2157] The server stores the received letter data in a database and returns a response indicating that the letter was successfully created and a new letter ID to the terminal.

[2158] The terminal displays the response and notifies the user.

[2159] Example of sending a letter

[2160] On the "Send Letter" screen, the user selects the letter they want to send and the contact information they want to send it to. After confirming that the recipient is correct, the user presses the "Send" button.

[2161] The terminal sends the selected letter ID and the recipient list to the server.

[2162] The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The sending method can be LINE message, email, or printed postcard. After sending, the server returns a successful response to the device.

[2163] The terminal displays the response and notifies the user.

[2164] Reminder setting implementation example

[2165] The user selects the frequency of the reminder (e.g., weekly, monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button.

[2166] The device sends the set reminder frequency to the server.

[2167] The server registers a periodic reminder sending task in the scheduler based on the received reminder information. When the reminder time comes, the server sends the user a LINE message or app notification, prompting them to write a letter.

[2168] Specific examples

[2169] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[2170] 1. Register an account and add your grandmother's LINE ID as a contact.

[2171] 2. Set a reminder for the first of every month.

[2172] 3. When you receive a reminder, select a new message and a recent family photo, then compose and send the letter.

[2173] 4. The server sends a message and photo to the grandmother's LINE ID based on the letter data received.

[2174] The system of the present invention allows users to easily stay in touch with important people even in their busy daily lives. This system facilitates communication between people and helps deepen relationships with family and friends.

[2175] The processing flow will be explained below.

[2176] Account registration process

[2177] Step 1:

[2178] The user installs the app and accesses the "New Registration" screen.

[2179] The user enters their name, email address, and password.

[2180] Step 2:

[2181] The terminal transmits the entered account information to the server.

[2182] Step 3:

[2183] The server stores the received account information in a database.

[2184] Step 4:

[2185] The server generates a response indicating successful account registration and sends it to the terminal.

[2186] Step 5:

[2187] The terminal receives the response from the server and displays a notification to the user that the account registration was successful.

[2188] Contact registration process

[2189] Step 1:

[2190] The user accesses the "Add Contact" screen within the app.

[2191] The user enters the contact's name, contact method (LINE, email, address), and corresponding contact information.

[2192] Step 2:

[2193] The device sends the entered contact information to the server.

[2194] Step 3:

[2195] The server stores the received contact information in a database.

[2196] Step 4:

[2197] The server generates a response indicating that the contact registration was successful and sends it to the device.

[2198] Step 5:

[2199] The terminal receives the response from the server and displays a notification to the user that the contact registration was successful.

[2200] Processing of letter creation

[2201] Step 1:

[2202] The user accesses the "Create Letter" screen within the app.

[2203] The user enters a message and selects the photos they want to send.

[2204] Step 2:

[2205] The device sends the message and photo data to the server.

[2206] Step 3:

[2207] The server stores the received letter data in a database and generates a stored letter ID.

[2208] Step 4:

[2209] The server sends a response indicating that the letter was successfully created and the generated letter ID to the terminal.

[2210] Step 5:

[2211] The terminal receives the response from the server and displays a notification to the user that the letter was successfully created.

[2212] Processing of letter transmission

[2213] Step 1:

[2214] The user accesses the "Send Letter" screen within the app.

[2215] Users select the letter they want to send and select the contacts to send it to.

[2216] Step 2:

[2217] The terminal sends the selected letter ID and the recipient list to the server.

[2218] Step 3:

[2219] The server retrieves the specified letter content from the database.

[2220] Step 4:

[2221] The server sends the letter to each contact based on the contact list, using either a LINE message, email, or a printed postcard.

[2222] Step 5:

[2223] The server generates a response indicating that the letter was sent successfully and sends it to the terminal.

[2224] Step 6:

[2225] The terminal receives the response from the server and displays a notification to the user that the letter was sent successfully.

[2226] Handling reminder settings

[2227] Step 1:

[2228] The user accesses the "Reminder Settings" screen within the app.

[2229] The user selects the frequency of the reminder (e.g., weekly, monthly).

[2230] Step 2:

[2231] The device sends the set reminder frequency to the server.

[2232] Step 3:

[2233] Based on the reminder information received by the server, a periodic reminder sending task is registered in the scheduler.

[2234] Step 4:

[2235] When the server reaches the time of the reminder, it will send a LINE message or app notification to the user.

[2236] Step 5:

[2237] Users receive a reminder and are prompted to take action to create and send a new letter.

[2238] The above is the flow of specific processing steps for carrying out the present invention.

[2239] Example 1

[2240] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2241] In today's society, it is not easy to maintain contact with loved ones amidst our busy daily lives. Regular contact with elderly people and family members who live far away is especially important to convey gratitude and affection, but we often forget when to do so. Furthermore, with so many different communication methods available, it can be tedious to know which method to choose and to set it up each time. A system that can solve these problems is needed.

[2242] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2243] In this invention, the server includes a means for inputting account information, a means for inputting contact information, and a means for inputting a message and image data. This allows a user to easily register an account, add contacts, and select and send a message and image. Furthermore, by combining a means for receiving a response indicating successful contact registration, a means for receiving a response indicating successful message and image data transmission, a means for sending a message and image data to a specified target person, a means for setting the frequency of reminders, and a means for receiving reminder notifications, the user can periodically send messages to important people and avoid missing a chance to contact them.

[2244] "Account information" refers to identification data such as name, email address, and password that a user uses to register with the system.

[2245] "Server" means a computer system that stores account information, contact information, messages, and image data and performs necessary processing.

[2246] "Database" means a system located on the server for structuring, managing, and storing account information, contact information, messages, and image data.

[2247] "Contact information" refers to the name of the person the user wants to contact, the means of contact (LINE, email, address, etc.), and specific contact information (LINE ID, email address, address, etc.).

[2248] A "message" is text data that a user wants to send.

[2249] "Image data" refers to image files such as photographs and drawings that a user wants to send.

[2250] A "response" is a processing result or success notification returned from the server to the terminal.

[2251] "Reminder" is a function that sends notifications to users at specific times to encourage them to take action.

[2252] "Reminder frequency" refers to the period or timing at which reminder notifications are sent, and is set by the user.

[2253] A "scheduler" is a program that manages periodic tasks on the server side and sends reminder notifications.

[2254] "Frequency" means the time interval at which reminders or notifications are sent.

[2255] A "notification" is a message or alert sent to a user to prompt them to take action.

[2256] "Contact method" refers to the communication method (e.g., LINE, email, mail, etc.) used to send messages and image data.

[2257] A "destination list" is a list of contact information for recipients to whom messages and image data are to be sent.

[2258] This invention is a system that helps users to send regular letters with photos to their loved ones. This system consists of three main components: a server, a terminal, and a user.

[2259] Account Registration

[2260] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[2261] The terminal sends the account information entered by the user to the server using an HTTP POST request.

[2262] The server analyzes the received account information and saves it in a database. If the save is successful, the server generates a response indicating that the account registration was successful and sends it to the terminal.

[2263] The terminal receives this response and notifies the user that "registration was successful."

[2264] Contact registration

[2265] Within the app, users access the "Add Contact" screen and enter the name, contact method, and specific contact information of the person they want to contact.

[2266] The device sends the contact information entered by the user to the server, again using an HTTP POST request.

[2267] The server analyzes the received contact information and saves it in the database. If the save is successful, the server generates a response indicating that the contact information was successfully registered and sends it to the device.

[2268] The terminal receives this response and notifies the user that "contact registration was successful."

[2269] Creating a letter

[2270] The user accesses the "Create a letter" screen within the app, enters a message, selects the photos they want to send, and presses the "Create" button.

[2271] The device sends the message and photo data to the server using an HTTP POST request, with the data sent in JSON format.

[2272] The server analyzes the received letter data and saves it in the database. If the save is successful, the server generates a response indicating that the letter was created successfully and a new letter ID, and sends them to the device.

[2273] The terminal receives this response and notifies the user that "the letter has been created successfully."

[2274] Send a letter

[2275] On the "Send Letter" screen, the user selects the letter they want to send and the recipient, and presses the "Send" button.

[2276] The device sends the letter ID and the recipient list to the server using an HTTP POST request, with the data sent in JSON format.

[2277] The server retrieves the letter content from the database and sends it based on the contact list, using the LINE API, a mail server, and a mail printing service.

[2278] If the transmission is successful, the server generates a response indicating the success of the transmission and sends it to the terminal.

[2279] The terminal receives this response and notifies the user that "the letter has been sent successfully."

[2280] Reminder settings

[2281] The user selects the reminder frequency on the "Reminder Settings" screen and presses the "Set" button.

[2282] The device sends the reminder frequency information to the server using an HTTP POST request.

[2283] The server registers the received reminder information in a scheduler, which uses a cron job.

[2284] When the time for the reminder arrives, the server will send a reminder to the user via LINE message or app notification, prompting them to write the letter.

[2285] Specific examples

[2286] For example, if a user wants to send a photo message to their grandmother once a month, they would take the following steps:

[2287] 1. The user registers an account and adds the grandmother's contact information (e.g., LINE ID) to the contacts.

[2288] 2. Set a reminder for the first of every month.

[2289] 3. Upon receiving the reminder, the user selects a new message and a recent family photo, composes the letter, and sends it.

[2290] 4. Based on the letter data received by the server, a message and photo are sent to the grandmother's LINE ID.

[2291] Example prompts to input to a generative AI model:

[2292] "Please tell me how to register an account to send a photo message to my grandmother once a month, add her LINE ID to my contacts, and set a reminder for the first of every month. Also, please provide detailed instructions on how to create and send the message after receiving the reminder."

[2293] The system of the present invention allows users to easily stay in touch with important people and deepen relationships with family and friends even in the midst of their busy lives.

[2294] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2295] Step 1: Enter your account information

[2296] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password. The input is "Yamada Taro", "taro@example.com", and "password123". This is the input for this step. This information is ready to be processed in the next step.

[2297] Step 2: Submit your account information

[2298] The device sends the account information entered by the user to the server using an HTTP POST request. The data is then processed on the device into the following JSON format:

[2299] json

[2300] {

[2301] "name": "Yamada Taro",

[2302] "email": "taro@example.com",

[2303] "password": "password123"

[2304] }

[2305] The processed data is the output of this step and is sent to the server.

[2306] Step 3: Save your account information

[2307] The server parses the received account data and saves it in a database. SQL queries are used for saving, and MySQL is used as the database management system. The input to this step is the JSON data sent in step 2. If the server successfully saves the data, it generates response data with a "success" status, which becomes the output for the next step.

[2308] Step 4: Send and display the response

[2309] The server generates a JSON response like this and sends it to the device:

[2310] json

[2311] {

[2312] "status": "success",

[2313] "message": "Registration successful"

[2314] }

[2315] This response is the input for step 4. The terminal receives this response and notifies the user that "registration was successful." This is the final output.

[2316] Step 5: Enter your contact information

[2317] The user accesses the "Add Contact" screen within the app and enters the name of the person they want to contact, their contact method, and specific contact information. The input is "Grandmother," "LINE," and "grandma123." This is the input for this step.

[2318] Step 6: Submit your contact information

[2319] The device sends the entered contact data to the server using an HTTP POST request, and the data is formatted as JSON:

[2320] json

[2321] {

[2322] "name": "Grandmother",

[2323] "method": "LINE",

[2324] "contact": "grandma123"

[2325] }

[2326] The processed data is the output of this step and is sent to the server.

[2327] Step 7: Save your contact information

[2328] The server parses the received contact data and saves it in a database. It uses SQL queries to save the data and MySQL as the database management system. The input to this step is the JSON data sent in step 6. If the server successfully saves the data, it generates a response data with a "success" status, which becomes the output for the next step.

[2329] Step 8: Send and Display the Response

[2330] The server generates a JSON response like this and sends it to the device:

[2331] json

[2332] {

[2333] "status": "success",

[2334] "message": "Contact registration successful"

[2335] }

[2336] This response is the input for step 8. The device receives this response and notifies the user that "Contact registration was successful." This is the final output.

[2337] Step 9: Write a message and select a photo

[2338] The user accesses the "Create a letter" screen, enters a message, and selects the photo they want to send. The input is "How are you?" and the selected photo file. This is the input for this step.

[2339] Step 10: Send your letter

[2340] The device sends the entered message and photo data to the server using an HTTP POST request, and the data is processed into the following JSON format:

[2341] json

[2342] {

[2343] "message": "How are you?",

[2344] "photo": "<base64_encoded_photo> "

[2345] }

[2346] The processed data is the output of this step and is sent to the server.

[2347] Step 11: Save your letter data

[2348] The server parses the received letter data and saves it in a database. SQL queries are used for saving, and MySQL is used as the database management system. The input to this step is the JSON data sent in step 10. If the server successfully saves the data, it generates response data with a "success" status and a new letter ID, which becomes the output of the next step.

[2349] Step 12: Send and Display the Response

[2350] The server generates a JSON response like this and sends it to the device:

[2351] json

[2352] {

[2353] "status": "success",

[2354] "message": "Letter created successfully",

[2355] "letter_id": "12345"

[2356] }

[2357] This response is the input to step 12. The terminal receives this response and notifies the user that "The letter was created successfully." This is the final output.

[2358] Step 13: Select the message you want to send and who you want to send it to

[2359] On the "Send Letter" screen, the user selects the letter they want to send and the recipient. The input is the letter ID "12345" and the recipient information "Grandmother's LINE ID (grandma123)." This is the input for this step.

[2360] Step 14: Sending outgoing data

[2361] The device sends the letter ID and destination information to the server using an HTTP POST request, and the data is processed into the following JSON format:

[2362] json

[2363] {

[2364] "letter_id": "12345",

[2365] "recipients": [

[2366] {

[2367] "method": "LINE",

[2368] "contact": "grandma123"

[2369] }

[2370] ]

[2371] }

[2372] The processed data is the output of this step and is sent to the server.

[2373] Step 15: Send your letter

[2374] The server retrieves the letter content from the database and sends it based on the contact list. To send the letter, it uses the LINE API, a mail server, and a mail printing service. The letter data is processed to suit the appropriate sending method and sent to each service. This is the specific operation. The input to this step is the JSON data sent in step 14, and the output is the sending result from each service.

[2375] Step 16: Sending and Displaying the Response

[2376] The server generates a successful response and sends it to the device:

[2377] json

[2378] {

[2379] "status": "success",

[2380] "message": "Your message was sent successfully"

[2381] }

[2382] This response is the input to step 16. The terminal receives this response and notifies the user that "your letter has been sent successfully." This is the final output.

[2383] Step 17: Select Reminder Frequency

[2384] The user selects the frequency of the reminder on the "Reminder Settings" screen. The input is "1st of every month." This is the input for this step.

[2385] Step 18: Send Reminder Settings

[2386] The device sends the reminder frequency information to the server using an HTTP POST request, and the data is formatted as JSON:

[2387] json

[2388] {

[2389] "frequency": "1st of every month"

[2390] }

[2391] The processed data is the output of this step and is sent to the server.

[2392] Step 19: Register a reminder task

[2393] The server registers a reminder task in the scheduler based on the received reminder information. A cron job is used as the scheduler. The input of this step is the JSON data sent in step 18. The server sets a task in the scheduler based on the reminder information, which is the output of the next step.

[2394] Step 20: Reminders

[2395] When the reminder time comes, the server sends a reminder to the user via LINE message or app notification, prompting them to write a letter. The notification message is "Don't forget to write a letter." The input to this step is the reminder notification trigger from the scheduler, and the output is the notification message to the user.

[2396] This allows users to easily stay in touch with loved ones and send regular photo messages.

[2397] (Application example 1)

[2398] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2399] Today, many people face the challenge of finding time to maintain communication with loved ones in their busy lives. As a result, relationships with family and friends tend to become estranged, especially when they live far apart. Furthermore, sending messages and photos regularly takes time and effort, and people often forget to do so. Furthermore, when users want to create timely and personal messages, they often find themselves at a loss as to what to include and how to include them.

[2400] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2401] In this invention, the server includes means for inputting account information, means for transmitting the account information to the server, means for saving the account information in a database, means for receiving a response from the server indicating successful account registration, means for inputting message and photo data, means for transmitting the message and photo data to the server, means for saving the message and photo data in a database, means for scheduling periodic transmission, a reminder means for sending a notification based on the scheduling information, means for automatically sending the message and photo data to designated contacts, means for assisting a user in creating a message using a generative AI model, and means for automatically generating an appropriate message by inputting a prompt sentence, thereby enabling a user to contact important people efficiently and in a timely manner and helping to maintain and strengthen relationships.

[2402] "Account information" refers to identification information such as name, email address, and password that a user uses to register with the system.

[2403] "Server" refers to a central system for storing and managing account information, message data, and the like.

[2404] A "database" is a system for systematically storing and managing account information, contact information, message data, etc. within a server.

[2405] A "message" is text data that a user inputs to send to other users.

[2406] "Photo data" is an image file that a user selects to attach to a message.

[2407] "Contact information" refers to the name and contact method (email address, telephone number, etc.) that a user registers as a message recipient.

[2408] A "response" is a reply or response message sent from a server to a client device.

[2409] "Scheduling" refers to creating a plan to automatically send messages and photo data based on a preset date, time, and frequency.

[2410] "Reminder" is a notification function that prompts the user to create and send a message.

[2411] A "generative AI model" is an artificial intelligence technology that automatically generates appropriate messages based on prompts entered by users.

[2412] A "prompt" is a simple instruction that is input to a generative AI model, and is the text that a message is generated based on.

[2413] The present invention is a system that helps users regularly send letters with photos to their loved ones. The system includes account registration, contact registration, message and photo data input and sending, periodic sending scheduling, reminder notifications, and message generation support using a generative AI model.

[2414] Account Registration Implementation

[2415] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password, and presses the "Register" button. The device sends the entered account information to the server. The server stores the received data in a database and returns a response to the device indicating successful account registration. The device displays the response and notifies the user.

[2416] Contact registration embodiment

[2417] The user enters their name, contact method (email address, phone number, etc.), and contact information on the "Add Contact" screen within the app. The device sends the entered contact data to the server. The server saves the received contact data in a database and returns a response to the device indicating that the contact was successfully registered. The device displays the response and notifies the user.

[2418] Embodiments of inputting and sending message and photo data

[2419] The user enters a message and selects the photo they want to send on the "Create a letter" screen within the app. After confirming that the input is correct, the user presses the "Create" button. The device then sends the message and photo data to the server. The server stores the received letter data in a database and returns a response indicating that the letter was successfully created and a new letter ID to the device. The device then displays the response and notifies the user.

[2420] Periodic Transmission Scheduling Embodiments

[2421] The user selects the reminder frequency (e.g., weekly or monthly) on the "Reminder Settings" screen within the app. After confirming the selected frequency, the user presses the "Set" button. The device sends the set reminder frequency to the server. Based on the received reminder information, the server registers a periodic reminder sending task in the scheduler. When the time for the reminder arrives, the server sends the user an app notification prompting them to create a letter.

[2422] Implementation of automatic sending to designated contacts

[2423] On the "Send Letter" screen, the user selects the letter they wish to send and the contacts to whom they wish to send it. After confirming that the recipients are correct, the user presses the "Send" button. The device sends the selected letter ID and recipient list to the server. The server retrieves the specified letter content from the database and sends the letter to each contact based on the contact list. The sending method can be email, etc. After sending, the server returns a response to the device indicating that the message was sent successfully. The device displays the response and notifies the user.

[2424] Implementation of message generation support using generative AI model

[2425] If a user has difficulty creating a message, they can use a generative AI model to generate an appropriate message. The user enters a short prompt, and the AI ​​generates a message based on that prompt. This prompt can include specific content, such as "A message about a recent family trip." The generated message can then be reviewed by the user, and modified as needed.

[2426] Prompt Sentence Examples

[2427] Example 1: "A message about a recent family trip"

[2428] Example 2: "New Year's greeting message"

[2429] This allows users to connect with important people in an efficient and timely manner, helping them maintain and strengthen relationships, and the generative AI model allows users to easily create personalized messages.

[2430] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2431] Step 1:

[2432] A user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password, and presses the "Register" button. The device receives the user's name, email address, and password as input and sends them to the server. The server stores the input data in a database, generates a response indicating successful account registration, and sends it back to the device. The device displays this response and notifies the user, thereby letting them know that the user's account has been created successfully.

[2433] Step 2:

[2434] The user enters their name, contact method (email address, phone number, etc.), and contact information on the "Add Contact" screen within the app. The device receives the user's contact information as input and sends it to the server. The server stores the received contact data in a database, generates a response indicating successful contact registration, and sends it back to the device. The device displays this response and notifies the user, allowing the user to register the appropriate contact.

[2435] Step 3:

[2436] The user enters a message and selects the photo they want to send on the "Create a letter" screen within the app. The device receives the message and photo data as input and sends it to the server. The server stores the received data in a database, generates a response indicating that the letter was created successfully, and a new letter ID, which it returns to the device. The device displays this response and notifies the user. This effectively saves the user's letter data.

[2437] Step 4:

[2438] The user selects the frequency of the reminder (e.g., weekly or monthly) on the "Reminder Settings" screen within the app. The device receives the reminder frequency information as input and sends it to the server. The server then registers a periodic reminder sending task in the scheduler based on the received data. When the time for the reminder arrives, the server sends a notification to the user, prompting them to create a letter. This allows the user to create letters on a regular basis.

[2439] Step 5:

[2440] On the "Send Letter" screen, the user selects the letter they want to send and the contacts to whom they want to send it. The terminal receives the letter ID and recipient list as input, and sends this to the server. The server retrieves the specified letter content from the database and automatically sends the message and photo data based on the contact list. The server generates a response indicating successful sending and sends it back to the terminal. The terminal displays this response and notifies the user. This causes the user's letter to be automatically sent to the appropriate contacts.

[2441] Step 6:

[2442] If a user has difficulty creating a message, they can use the app's "AI Generation Assistance" function. The device receives a prompt sentence (e.g., "A message about a recent family trip") as input and sends it to the generative AI model. The generative AI model generates an appropriate message based on the prompt sentence and sends it back to the device. The device displays the generated message to the user, who can modify it as needed. This allows the user to effectively create personalized messages using the generative AI model.

[2443] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2444] The present invention provides an account registration system that combines an emotion engine and a system that supports users in periodically sending letters with photos to important people. Specific embodiments of the system will be described below.

[2445] Account Registration Implementation

[2446] The user installs the smartphone app and accesses the "New Registration" screen. The user enters their name, email address, and password and presses the "Register" button.

[2447] The terminal transmits the entered account information to the server.

[2448] The server stores the received account information in a database, generates a response indicating that the account registration was successful, and sends it to the terminal.

[2449] The terminal receives the response and displays a notification to the user that the account registration was successful.

[2450] Contact registration embodiment

[2451] Users enter the contact's name, contact method (LINE, email, address), and corresponding contact information on the "Add Contact" screen within the app.

[2452] The terminal transmits the entered contact information to the server.

[2453] The server stores the received contact information in a database, generates a respon...

Claims

1. A means of entering account information; means for transmitting the account information to a server; means for storing the account information in a database; means for receiving a response indicating success of account registration from the server; Account registration system.

2. 10. The system of claim 1, a means for entering contact information; means for transmitting the contact information to a server; means for storing said contact information in a database; The system includes means for receiving a response indicating successful registration of the contact.

3. 10. The system of claim 1, a means for inputting message and photo data; means for transmitting the message and photo data to a server; means for storing said message and photo data in a database; The system includes means for receiving a response indicating successful transmission of the message and photo data.

Images