System

Abstract

A system is provided.SOLUTION: Means for acquiring, by a user terminal, a friend list, anniversary information, and a message history through a communication application platform and transmitting the friend list, the anniversary information, and the message history to a server; A system including means for evaluating a relationship score with a user, means for calculating, by a server, a reminder timing of an anniversary or a birthday based on the relationship score, means for scheduling, by the server, a notification based on the reminder timing, means for generating, by the server, a suggestion of a present suitable for the user using a generation model, means for generating, by the server, text of a congratulatory message based on a past message history using the generation model, and means for notifying, by the server, a user terminal of the generated reminder, the suggestion of the present, and the text of the congratulatory message.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Some users of communication application platforms face challenges such as forgetting the birthdays and anniversaries of their friends and acquaintances, and not knowing the right timing for preparing congratulatory messages or gifts. Furthermore, many users struggle to choose the right message or gift for a particular relationship. To address these challenges, an effective method is needed to strengthen human relationships and promote the culture of celebrating anniversaries. [Means for solving the problem]

[0005] The present invention provides a system in which a user terminal acquires a friend list, anniversary information, and message history through a communication application platform and transmits them to a server. The server analyzes the received data and evaluates a relationship score with the user. Based on the relationship score, the server calculates the timing of reminders for anniversaries and birthdays and schedules notifications based on the reminder timing. Furthermore, the server uses a generative model to generate gift suggestions suited to the user and generates congratulatory message text based on past message history. Finally, the server notifies the user terminal of the generated reminders, gift suggestions, and congratulatory message text, allowing the user to remember anniversaries of friends and acquaintances and smoothly prepare for celebrations.

[0006] A "user terminal" is an electronic device capable of transmitting and receiving data via a communication application platform.

[0007] A "server" is a computer system that performs processes such as data analysis, evaluation, and generation, and provides necessary information to user terminals.

[0008] A "communications application platform" is a software environment used by users to exchange messages and information with other users.

[0009] A "friend list" is a list that compiles information about friends and acquaintances registered on a user terminal.

[0010] "Anniversary information" is data that includes birthdays and other important dates of the user's friends and acquaintances.

[0011] "Message history" is a record of messages previously exchanged between a user and their friends and acquaintances.

[0012] The "relationship score" is a numerical value evaluated based on the frequency of communication between the user and the friend, response speed, number of common groups, and the like.

[0013] The "remind timing" is a timing of notification that indicates an appropriate time for the user to remember to celebrate an anniversary or birthday.

[0014] A "generative model" is an algorithm that uses AI technology to suggest gifts and generate message text.

[0015] "Notification" refers to information about reminders, gift suggestions, and message text sent from the server to the user terminal. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10]1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of their friends and acquaintances on a communication application platform.

[0038] First, the user terminal collects data through the communication application platform, including friend lists, anniversary information, and message history, and then transmits this data to the server.

[0039] The server then stores the received data and begins analyzing it. The server evaluates the user's relationship score with their friends based on factors such as message frequency, response speed, and the number of common groups. Based on the relationship score, the server calculates the appropriate reminder timing. For example, the server will remind the user seven days before an anniversary or birthday.

[0040] Once the reminder timing is determined, the server uses the generative model to suggest gifts. The server analyzes the friend's hobbies, preferences, and past interaction data and suggests gifts based on that.

[0041] Furthermore, the server generates the text of the congratulatory message. The server generates an appropriate message based on past message history, taking into account relationships and common anecdotes. This allows users to easily create touching messages to send to their friends.

[0042] The generated reminders, gift suggestions, and congratulatory messages are finally sent from the server to the user's device. The user receives these notifications and can prepare for the celebration of their friends' and acquaintances' anniversaries.

[0043] Specific examples

[0044] For example, consider a case where a user wants to remember to celebrate a friend's birthday. First, the user uses the communication application platform to obtain a list of friends and their birthday information. The user terminal then sends this information and message history to the server.

[0045] The server calculates a relationship score based on the frequency of messages, response time, and number of common groups with this friend, and then determines when to send a reminder seven days before the friend's birthday.

[0046] The server then uses the generative model to suggest suitable gifts for friends. It analyzes a friend's hobbies and preferences, suggesting the latest music albums to a music-loving friend, for example. The server also generates inspiring messages based on past messaging history. For example, it could generate a message along the lines of, "The concert we went to together last year was amazing. I hope this year will be another great one!"

[0047] Finally, this information is sent to the user's terminal, allowing the user to prepare a perfect birthday celebration for their friend. In this way, the present invention helps users remember important anniversaries and effectively strengthen their relationships.

[0048] The processing flow will be explained below.

[0049] Step 1:

[0050] The user terminal obtains the friend list, anniversary information, and message history through the communication application platform.

[0051] Step 2:

[0052] The user terminal encrypts the acquired friend list, anniversary information, and message history and transmits them to the server.

[0053] Step 3:

[0054] The server decrypts the received data and stores it in a secure database.

[0055] Step 4:

[0056] The server analyzes the stored data and calculates a relationship score between the user and each friend, based on metrics such as message frequency, response speed, and number of common groups.

[0057] Step 5:

[0058] The server uses the relationship score to determine when to remind you about each friend's birthday or anniversary, typically seven days before the anniversary or birthday.

[0059] Step 6:

[0060] The server schedules notifications based on reminder timing and saves the schedule information in a database.

[0061] Step 7:

[0062] The server uses the generative model to generate personalized gift suggestions for the user, based on the user's friends' hobbies, preferences, and past interactions.

[0063] Step 8:

[0064] The server generates a congratulatory message tailored to the user's friend based on their past message history, taking into account important past events and relationships.

[0065] Step 9:

[0066] The server compiles the generated reminders, gift suggestions, and congratulatory message texts and notifies them to the user terminal.

[0067] Step 10:

[0068] The user terminal displays the received notification to the user, allowing the user to remember and prepare for the celebration of a friend's birthday or anniversary.

[0069] Example 1

[0070] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0071] In today's society, people often forget the anniversaries and birthdays of friends and acquaintances due to their busy daily lives. This makes it difficult to maintain and deepen relationships, and can lead to weakened relationships. People often struggle to know the appropriate way to celebrate or the message they want to send. It is necessary to solve this problem and provide a way for users to easily celebrate anniversaries in a touching and effective way.

[0072] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0073] In this invention, the server includes a means for analyzing the received data and evaluating a relationship score with the user, a means for scheduling notifications based on reminder timing, a means for generating gift suggestions using a generative AI model, and a means for generating the text of a congratulatory message, thereby enabling users to remember anniversaries of their friends and acquaintances and to celebrate them in a timely and appropriate manner.

[0074] "User terminal" refers to an electronic device for obtaining and transmitting data to a server through a communication application platform.

[0075] A "communications application platform" is a software environment that allows users to send and receive messages and manage their friend lists.

[0076] A "friend list" is a list that includes information about acquaintances and friends with whom a user communicates.

[0077] "Anniversary information" is information about important dates such as birthdays and anniversaries of the user and their friends and acquaintances.

[0078] "Message history" is a record of messages sent and received in the past between a user and their friends and acquaintances.

[0079] A "server" is a central control device that analyzes and stores data received from user terminals and performs various processes based on that data.

[0080] The "relationship score" is a numerical value calculated based on the frequency of messages, response speed, number of common groups, etc., to evaluate the relationship between the user and a friend.

[0081] "Reminder timing" refers to the appropriate time to notify someone of an important date such as an anniversary or birthday.

[0082] "Scheduling a notification" means making and executing a plan to send a notification to a user at a specific time.

[0083] A "generative AI model" is an artificial intelligence model that generates new information or content based on given data.

[0084] "Gift Suggestions" are information generated using a generative AI model to suggest gifts for users to give to friends and acquaintances.

[0085] The "text of a congratulatory message" is a document containing congratulatory words that a user sends to friends and acquaintances.

[0086] MODE FOR CARRYING OUT THE INVENTION

[0087] This invention is an AI concierge system that helps users remember to celebrate the birthdays and anniversaries of their friends and acquaintances on a communication application platform.

[0088] First, the user device collects data through the communication application platform. This data includes friend lists, anniversary information, and message history. The user device then sends this data to the server. The data is transmitted over the Internet using the SSL / TLS protocol to ensure data security.

[0089] Next, the server stores the received data and begins analyzing it. The server saves the data in a database (e.g., MySQL or PostgreSQL) and uses data analysis tools such as Python or R to evaluate the relationship score between the user and their friends based on factors such as message frequency, response speed, and the number of common groups. Based on this relationship score, the server calculates the appropriate reminder timing. For example, it could set the reminder timing to be seven days before an anniversary or birthday.

[0090] Once the reminder timing is determined, the server uses a generative AI model (e.g., GPT-3) to suggest gifts. The server analyzes the friend's hobbies, preferences, and past interactions data and suggests gifts based on that. For example, a friend who likes music will be suggested the latest music album.

[0091] The server also uses the generative AI model to generate congratulatory messages, including appropriate messages that take into account relationships and shared anecdotes based on past messaging history. For example, it might generate a message along the lines of, "The concert we went to together last year was amazing! I hope this year will be even more amazing!"

[0092] The generated reminders, gift suggestions, and congratulatory messages are finally sent from the server to the user's device. The server uses a notification system (e.g., Firebase Cloud Messaging or Apple Push Notification Service) to send notifications to the user's device. The user receives the notifications and can prepare to celebrate their friend's anniversary without forgetting about it.

[0093] Specific examples

[0094] For example, consider a case where a user wants to celebrate the birthday of a friend who loves music. First, the user terminal uses the communication application platform to obtain a list of friends and their birthday information. Then, this information and message history are sent to the server.

[0095] The server then calculates a relationship score by analyzing the frequency of messages with this friend, response speed, and the number of common groups. It then determines when to send a reminder seven days before the friend's birthday. The server then uses the generative AI model to suggest gifts suitable for a music-loving friend. For example, it might suggest the latest music album.

[0096] Next, the server generates an inspiring message based on past message history, such as, "The concert we went to together last year was amazing. I hope this year will be a great one!"

[0097] The generated information is finally sent to the user's device, where the user can receive the notification and prepare a perfect birthday celebration for their friend. This system allows users to easily prepare for celebrations without forgetting important anniversaries.

[0098] Prompt Sentence Examples

[0099] For example, a prompt for the generative AI model might be, "A touching birthday message for a music-loving friend." The generated message might be, "The concert we went to together last year was amazing. I hope this year will be a great one!"

[0100] The above is the mode for carrying out the present invention.

[0101] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0102] Step 1:

[0103] The user terminal obtains the friend list, anniversary information, and message history through the communication application platform.

[0104] Specifically, the application automatically collects friend lists and anniversary information, extracts past message history, and stores the acquired data locally on the user's device.

[0105] Input: friend list, anniversary information, message history from a communication application platform

[0106] Output: Friends list, anniversary information, and message history stored on the user's device

[0107] Step 2:

[0108] The user terminal transmits the collected data to the server.

[0109] Specifically, the user terminal transmits data to the server via the Internet, using the SSL / TLS protocol to enhance data security.

[0110] Input: Friends list, anniversary information, and message history stored on the user's device

[0111] Output: Friends list, anniversary information, message history sent to the server

[0112] Step 3:

[0113] The server stores the received data in a database.

[0114] Specifically, the server securely stores data in a database such as MySQL or PostgreSQL.

[0115] Input: Friends list, anniversary information, message history sent to the server

[0116] Output: Friends list, anniversary information, message history stored in database

[0117] Step 4:

[0118] The server analyzes the stored data and evaluates the relationship score between the user and their friends.

[0119] Specifically, data analysis tools such as Python and R are used to analyze message frequency, response speed, and number of common groups, and calculate a relationship score.

[0120] Input: Friends list, anniversary information, message history stored in the database

[0121] Output: Calculated relationship score

[0122] Step 5:

[0123] The server calculates reminder timing for anniversaries and birthdays based on the relationship score.

[0124] Specifically, it sets priorities based on relationship scores and calculates timing, such as sending a reminder seven days before a birthday.

[0125] Input: Calculated relationship score, anniversary information

[0126] Output: Remind timing

[0127] Step 6:

[0128] The server uses the generative AI model to generate gift suggestions suited to the user.

[0129] Specifically, the system uses a generative AI model such as GPT-3 to generate gift suggestions based on prompts such as a friend's hobbies, preferences, and past interactions. For example, it might suggest the latest music albums to a friend who likes music.

[0130] Input: Friends' hobbies and preferences, past interactions

[0131] Output: Gift Suggestion

[0132] Step 7:

[0133] The server uses a generative AI model to generate the text of the congratulatory message.

[0134] Specifically, the AI ​​model is given a prompt to "generate a touching birthday message," and the generated message is customized based on past message history.

[0135] Input: Past message history, prompt text

[0136] Output: Congratulatory message text

[0137] Step 8:

[0138] The server notifies the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

[0139] Specifically, the generated information is sent to the user's device using a notification system (e.g., Firebase Cloud Messaging or Apple Push Notification Service).

[0140] Input: Reminder timing, gift suggestions, congratulatory message text

[0141] Output: Reminders, gift suggestions, and congratulatory messages sent to the user's device

[0142] By going through these processing steps, a system is constructed that allows users to celebrate the anniversaries of friends and acquaintances at an appropriate time.

[0143] (Application example 1)

[0144] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0145] Users need to be able to remember and appropriately celebrate the anniversaries and birthdays of their friends and family, and to be able to more personalized experiences in specific physical stores. However, with conventional systems, users must manually manage information and set reminders, and it takes a lot of time and effort to think of appropriate gifts and congratulatory messages. Another problem is that the in-store experience is not personalized, making it difficult to fully celebrate special anniversaries.

[0146] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0147] In this invention, the server includes: means for a user terminal to acquire a friend list, anniversary information, and message history through a communication application platform and transmit them to the server; means for the server to analyze the received data and evaluate a relationship score with the user; means for the server to calculate anniversary and birthday reminder timings based on the relationship score; means for the server to schedule notifications based on the reminder timings; means for the server to generate gift suggestions suitable for the user using a generative model; means for the server to generate congratulatory message texts based on past message history using the generative model; means for the user terminal to select a brick-and-mortar store to visit and set a reminder; means for the server to suggest gifts and celebratory services in the store; and means for the server to notify the user terminal of the generated reminders, gift suggestions, and congratulatory message texts. This allows users to automatically prepare to appropriately celebrate anniversaries and birthdays and personalize their in-store experiences.

[0148] A "user terminal" is a computer device that obtains data through a communication application platform and transmits it to a server.

[0149] A "communication application platform" is an online service that allows users to exchange information such as messages, images, and voice with other users.

[0150] A "friend list" is data that lists information about friends and acquaintances that a user has registered on the communication application platform.

[0151] "Anniversary information" is date information of birthdays and special anniversaries of friends and acquaintances.

[0152] "Message history" refers to a record of past messages exchanged by a user with friends and acquaintances through a communication application platform.

[0153] "Server" refers to a central system that receives, analyzes, stores, and provides various services from data sent from user terminals.

[0154] The "relationship score" is an index used by the server to evaluate the relationship between the user and a friend.

[0155] The "remind timing" is the optimum date and time to notify the user so that they do not forget anniversaries or birthdays.

[0156] A "generative model" is an algorithm that automatically generates appropriate gift suggestions and congratulatory message text from input data.

[0157] "Reminder" is a notification function that helps users not forget important appointments and events.

[0158] A "physical store" is a physical store space where users can purchase goods or receive services.

[0159] "Gift suggestions" are gift ideas that the server suggests to users using a generative model based on the hobbies and preferences of friends and acquaintances.

[0160] The "congratulatory message text" is a congratulatory text that the server generates using a generative model and referring to past message history.

[0161] "Notification" refers to information that the server sends to the user terminal, and includes reminders, gift suggestions, and congratulatory messages.

[0162] This invention provides a system that allows users to remember and appropriately celebrate specific anniversaries and birthdays, and to personalize their in-store experiences, by utilizing a user terminal, a server, a generative AI model, and a communication application platform.

[0163] First, the user device acquires the friend list, anniversary information, and message history through the communication application platform and sends this data to the server. The server analyzes the received data and evaluates the relationship score between the user and the friends.

[0164] Next, based on the relationship score, the server calculates the timing of reminders for anniversaries and birthdays. For example, it sets a reminder seven days before an anniversary or birthday. Furthermore, the user's device selects the physical store they plan to visit and sends that information to the server. This allows the server to suggest gift selection and celebration services at the store.

[0165] The server uses the generative model to generate gift suggestions suited to the user. This generative model makes appropriate suggestions based on the friend's hobbies, preferences, and past message history. The server also uses the generative model to create the text of the congratulatory message. This allows the user to send a touching and personalized message.

[0166] The generated reminders, gift suggestions, and congratulatory message texts are finally sent from the server to the user terminal, allowing the user to prepare to celebrate a special anniversary or birthday effectively.

[0167] Hardware and software used

[0168] User device: Smartphone

[0169] Server: Central server system

[0170] Communication Application Platform: Messaging App

[0171] Generative AI models: Natural language generation algorithms (e.g., GPT-3)

[0172] Specific examples

[0173] For example, consider a case where a user wants to celebrate a friend's birthday. The user obtains a friend list and their birthday information through a communication application platform. The user's device sends this information and message history to a server. The server analyzes the frequency of messages with this friend, response speed, and the number of common groups to calculate a relationship score. It then determines when to send a reminder seven days before the friend's birthday.

[0174] Examples of prompts include:

[0175] Friend's name: xxx

[0176] Date of Birth: 2023-12-25

[0177] Hobbies: Music, movies

[0178] Generate the following:

[0179] 1. Gift Suggestions (2 or more)

[0180] 2. Congratulatory Message

[0181] example:

[0182] 1. Suggestion 1: Latest Movie Trailer Tickets

[0183] Suggestion 2: A special music album

[0184] 2. Message: Happy birthday! Last year's music festival was amazing. I hope this year will be a great one too!

[0185] In this way, users can remember special anniversaries and efficiently prepare personalized responses.

[0186] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0187] Step 1:

[0188] The user terminal obtains the friend list, anniversary information, and message history through the communication application platform. Based on this, the data of the user's friends' birthdays and anniversaries is collected and sent to the server. The input is the friend list, anniversary information, and message history, and this is the data sent to the server.

[0189] Step 2:

[0190] The server analyzes the received friend list, anniversary information, and message history to evaluate the relationship score between the user and the friend. The server calculates the relationship score based on data such as message frequency, response speed, and number of common groups. The input is the acquired data, and the output is the relationship score. This quantifies the depth of the relationship with the friend.

[0191] Step 3:

[0192] The server calculates the timing of reminders for anniversaries and birthdays based on the relationship score. It sets appropriate reminder dates and times based on the relationship score. For example, a reminder for an important friend can be sent seven days before their birthday. The input is the relationship score, and the output is the reminder timing.

[0193] Step 4:

[0194] The user's device selects the physical store they plan to visit and sends that information to the server. By selecting the physical store information through the app, the user specifies which store they will use to prepare for the celebration. The input is the physical store information, and this is the data sent to the server.

[0195] Step 5:

[0196] The server proposes gifts and celebration services at the store based on the information about the physical store that the user plans to visit and the timing of the reminder.The server uses a generative AI model to generate gift suggestions based on the friend's hobbies and preferences.The input is the physical store information, the timing of the reminder, and the friend's hobbies and preferences, and the output is gift suggestions.

[0197] Step 6:

[0198] The server uses a generative AI model to generate a congratulatory message based on past message history. The server analyzes the message history and creates a message that takes into account relationships and common episodes. The input is the past message history, and the output is the congratulatory message text. This allows users to send moving messages.

[0199] Step 7:

[0200] The server notifies the user terminal of the generated reminder, gift suggestion, and congratulatory message text. The generated reminder information, suggestion, and message text are sent to the user terminal and notified to the user. The input is the generated reminder, gift suggestion, and congratulatory message text, and the output is the notification to the user terminal.

[0201] By following the steps above, the user can efficiently prepare for a celebration without forgetting an important anniversary.

[0202] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0203] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of friends and acquaintances on a communication application platform without forgetting them, and that recognizes the user's emotions and suggests the most appropriate gifts and messages.

[0204] First, the user device collects data through the communication application platform, including friend lists, anniversary information, message history, and emotion data for recognizing the user's emotions. The emotion engine recognizes emotions from the user's text messages, voice, and facial expressions, and sends the data to the server.

[0205] The server then stores all the received data in a secure database and begins analyzing it. The server evaluates the relationship score between the user and their friends based on message frequency, response speed, number of common groups, and the user's emotional data. This score is calculated by taking into account the depth of the emotional connection between the user and their friends.

[0206] Based on the analysis results, the server calculates the appropriate reminder timing, for example, setting a reminder time seven days before an anniversary or birthday.

[0207] Once the reminder timing is determined, the server uses the generative model to generate optimal gift suggestions for the user, taking into account the friend's hobbies and preferences and the user's recent emotional state.

[0208] Furthermore, the server generates the text of the congratulatory message. It generates an appropriate message based on the user's emotional data as well as past message history, taking into account relationships and common anecdotes. This allows users to easily create more emotional and relatable messages.

[0209] The generated reminders, gift suggestions, and congratulatory messages are finally sent from the server to the user's device. The user receives these notifications and can prepare for the celebration of their friends' and acquaintances' anniversaries.

[0210] Specific examples

[0211] For example, consider a case where a user wants to celebrate a friend's birthday. First, the user uses the communication application platform to obtain a list of friends and their birthday information. The emotion engine on the user's device recognizes the user's current emotional state from their messages and facial expressions, and transmits this information to the server.

[0212] The server calculates a relationship score based on message frequency, response speed, number of common groups, and emotional data, and then determines the timing of the reminder based on this relationship score and the friend's birthday information. The reminder is usually set seven days before the birthday.

[0213] The server then uses the generative model to suggest appropriate gifts, taking into account the emotional data and suggesting gifts that match recent conversations and emotions (e.g., a relaxing spa ticket if the user has been feeling stressed recently).

[0214] Furthermore, based on the emotional data and message history, a congratulatory message including an emotional episode is generated (e.g., "You've been busy lately, but please take your time and enjoy your birthday!").

[0215] Finally, this information is sent to the user's terminal, so that the user can receive the notification and prepare a perfect birthday celebration for their friend. In this way, the present invention helps users remember important anniversaries and celebrate them in a way that is in line with their feelings.

[0216] The processing flow will be explained below.

[0217] Step 1:

[0218] The user device obtains friend lists, anniversary information, and message history through the communication application platform, and the emotion engine on the user device recognizes and collects emotion data from the user's text messages, voice, and facial expressions.

[0219] Step 2:

[0220] The user terminal encrypts the acquired friend list, anniversary information, message history, and emotion data and transmits them securely to the server.

[0221] Step 3:

[0222] The server decrypts the received data and stores it in a secure database.

[0223] Step 4:

[0224] The server analyzes the stored data, including message frequency, response speed, number of common groups, and user sentiment data (e.g., fluctuations in positive / negative sentiment).

[0225] Step 5:

[0226] The server uses this data to calculate a relationship score between the user and their friends, taking into account their communication patterns and emotional depth.

[0227] Step 6:

[0228] The server determines the optimal reminder timing based on the calculated relationship score, usually seven days before a friend's birthday or anniversary.

[0229] Step 7:

[0230] The server schedules notifications based on reminder timing and saves the schedule information in a database.

[0231] Step 8:

[0232] The server uses the generative model to generate gift suggestions suited to the user, taking into account the user's emotional data and their friends' hobbies and preferences, and selecting the most suitable gift (e.g., relaxing items, hobby-related goods, etc.).

[0233] Step 9:

[0234] The server generates an emotional and relatable congratulatory message based on past message history and emotional data. The generated message includes content tailored to specific episodes and emotions.

[0235] Step 10:

[0236] The server notifies the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

[0237] Step 11:

[0238] The user terminal displays the received notification to the user, so that the user can remember to prepare for the celebration of the friend's birthday or anniversary. The user can purchase the suggested gift and send the generated message to the friend.

[0239] As such, an AI concierge system incorporating emotional data can help users prepare for more emotionally consistent celebrations.

[0240] Example 2

[0241] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0242] With conventional communication application platforms, users often forget the birthdays and anniversaries of their friends and acquaintances, and there is a lack of appropriate assistance when selecting congratulatory messages and gifts. This makes it easy for users to forget important dates, making it difficult to congratulate people emotionally. Furthermore, it is difficult to generate appropriate suggestions and messages that take the user's emotions into account, resulting in low user satisfaction.

[0243] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0244] In this invention, the server includes: means for a user terminal to acquire a friend list, anniversary information, message history, and emotion data through a communication application platform and transmit the acquired data to the server; means for the server to store the received data in a secure database and analyze the data based on message frequency, reaction speed, number of common groups, and emotion data; means for the server to evaluate a relationship score based on the data analysis results; means for the server to calculate reminder timing based on the relationship score and anniversary information; means for the server to schedule notifications based on the reminder timing; means for the server to generate gift suggestions suitable for the user using a generative AI model; means for the server to generate congratulatory message text based on past message history and emotion data using the generative AI model; and means for the server to notify the user terminal of the generated reminders, gift suggestions, and congratulatory message text. This allows users to remember anniversaries of their friends and acquaintances and select gifts and generate congratulatory messages that are in line with their emotions.

[0245] A "user terminal" is an electronic device that uses a communication application platform to collect friend lists, anniversary information, message history, and emotion data, and transmits them to a server.

[0246] A "communications application platform" is a collection of software and services that enables users to communicate with other users through text messages, voice, images, and video.

[0247] A "friends list" is a list of friends and acquaintances with whom a user is connected on his or her communication application platform.

[0248] "Anniversary information" is information about birthdays and other important anniversaries of the user's friends and acquaintances.

[0249] "Message history" is a record of past text messages sent and received between a user and their friends and acquaintances.

[0250] "Emotion data" is emotional data analyzed based on the user's text message, voice, facial expression, etc.

[0251] A "server" is a device or system that receives, analyzes, stores, and processes data sent from a user terminal.

[0252] A "secure database" is a database that protects data from unauthorized access from outside and stores data safely.

[0253] "Data analysis" is the process of analyzing numbers and trends based on collected data.

[0254] The "relationship score" is a number that indicates the depth of the relationship between a user and their friend, calculated based on their interactions, commonalities, and emotional data.

[0255] The "remind timing" is the optimum time and date for notifying the user of an anniversary or birthday.

[0256] A "generative AI model" is a model that uses artificial intelligence to generate and recommend text.

[0257] "Gift suggestions" are ideas and recommendations for the best gifts for the user's friends and acquaintances.

[0258] The "text of a congratulatory message" is the content of a message that a user sends to celebrate the anniversary or birthday of a friend or acquaintance.

[0259] "Notification" refers to information sent from the server to the user terminal, and may inform the user of reminders, gift suggestions, congratulatory messages, and the like.

[0260] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of their friends and acquaintances without forgetting them. It also aims to recognize the user's emotions and suggest the most suitable gifts and messages.

[0261] First, the user terminal collects the necessary data through the communication application platform, including:

[0262] Friends list (a list of friends and acquaintances the user is connected to)

[0263] Anniversary information (friends' birthdays and important anniversaries)

[0264] Message history (record of past text messages sent and received)

[0265] Emotional data (obtained from the user's text messages, voice, and facial expressions)

[0266] The user device collects this data and sends it to the server via a secure communication protocol (e.g., HTTPS). The emotion engine analyzes the user's messages and voice and generates emotion data.

[0267] The server then stores all the data it receives in a secure database and parses the data. The server parses the following elements:

[0268] Message frequency (frequency of communication between the user and their friends)

[0269] Response speed (how quickly messages are exchanged)

[0270] Number of common groups (number of common groups that the user and their friends are in)

[0271] Emotion data (data generated by the emotion engine)

[0272] Based on these analysis results, the server calculates a relationship score, which is a numerical representation of the depth of the feelings between the user and their friend. Based on this score, the server calculates the timing of reminders for anniversaries and birthdays. The reminder is usually set to occur seven days before the anniversary.

[0273] The server then uses the generative AI model to generate optimal gift suggestions for the user, which involves the following process:

[0274] Get the user's friends' hobbies and preferences from the database

[0275] Consider your recent emotional state

[0276] Enter a prompt into the generative AI model to generate gift suggestions

[0277] The server also generates congratulatory messages based on past message history and emotional data, allowing users to easily create emotional and relatable messages.

[0278] Finally, the generated reminders, gift suggestions, and congratulatory messages are sent from the server to the user's device, allowing the user to remember the anniversaries of their friends and acquaintances and prepare for their celebrations.

[0279] Specific examples

[0280] For example, if a user wants to remember to celebrate a friend's birthday, the user terminal first uses the communication application platform to obtain the friend list and the friend's birthday information, and the emotion engine recognizes the user's current emotional state from the user's message and facial expression, and then transmits this information to the server.

[0281] The server calculates a relationship score based on message frequency, response speed, number of common groups, and emotional data, and then determines the timing of the reminder based on this relationship score and the friend's birthday information. The reminder is usually set seven days before the birthday.

[0282] The server then uses the generative model to suggest appropriate gifts, such as "tickets to a relaxing spa if you've been feeling stressed lately."

[0283] Furthermore, the server generates a congratulatory message that includes an emotional episode based on the emotion data and message history, such as "You've been busy lately, but please take your time and enjoy your birthday!"

[0284] Finally, this information is sent to the user's terminal, allowing the user to prepare a perfect birthday celebration for their friend.

[0285] Prompt Sentence Examples

[0286] "Suggest the perfect gift and congratulatory message to celebrate a friend's birthday. Take recent conversations and sentiment data into account to make personalized suggestions."

[0287] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0288] Step 1: Data collection

[0289] The user device collects necessary data through the communication application platform, such as friend lists, anniversary information, message history, and emotional data. The emotional data is generated by analyzing the user's text messages, voice, and facial expressions using an emotion engine.

[0290] Input: The communication platform used by the user

[0291] Output: Friend list, anniversary information, message history, emotional data

[0292] Specific behavior:

[0293] The user opens the application

[0294] Data collection module syncs friends list

[0295] Get anniversary information

[0296] Retrieve message history from a local database

[0297] Emotion engine generates emotional data

[0298] Step 2: Send data

[0299] The user device sends the collected data to the server using a secure communication protocol (e.g., HTTPS).

[0300] Input: friend list, anniversary information, message history, emotional data

[0301] Output: Data received by the server

[0302] Specific behavior:

[0303] Convert collected data into JSON format

[0304] Send to server using HTTPS communication

[0305] Step 3: Data analysis

[0306] The server stores the received data in a secure database and performs data analysis, including message frequency, response speed, number of common groups, and sentiment data.

[0307] Input: Collected data (friend list, anniversary information, message history, emotional data)

[0308] Output: Analysis results (message frequency, reaction speed, number of common groups, evaluation of emotional data)

[0309] Specific behavior:

[0310] Save the received data to the database

[0311] Run data analysis algorithms to analyze each element

[0312] Step 4: Calculate the relationship score

[0313] The server calculates a relationship score based on the analysis results, which quantifies the depth of the feelings between the user and their friends.

[0314] Input: Analysis results (message frequency, reaction speed, number of common groups, evaluation of emotional data)

[0315] Output: Relationship score

[0316] Specific behavior:

[0317] Each element is weighted to calculate an overall relationship score

[0318] Step 5: Calculate the reminder timing

[0319] The server calculates the reminder timing based on the relationship score and anniversary information, usually set 7 days before the anniversary.

[0320] Input: Relationship score, anniversary information

[0321] Output: Remind timing

[0322] Specific behavior:

[0323] Get anniversary date

[0324] Calculate 7 days before the anniversary

[0325] Schedule reminders

[0326] Step 6: Generate gift suggestions

[0327] The server uses a generative AI model to generate optimal gift suggestions for the user, taking into account the user's friends' hobbies and preferences and the user's recent emotional state.

[0328] Input: Relationship score, emotional data, friends' hobbies and preferences

[0329] Output: Gift Suggestion

[0330] Specific behavior:

[0331] Enter a prompt into the generative AI model

[0332] Generate gift suggestions and match them with your preferences data

[0333] Step 7: Generate a congratulatory message

[0334] The server uses a generative AI model to generate the text of the congratulatory message, based on past message history and emotional data.

[0335] Input: Message history, emotion data

[0336] Output: Congratulatory message text

[0337] Specific behavior:

[0338] Analyze emotional data and message history

[0339] Enter a prompt into the generative AI model to generate a message

[0340] Step 8: Sending notifications

[0341] The server notifies the user terminal of the generated reminder, gift suggestion, and congratulatory message text.

[0342] Input: Reminder timing, gift suggestions, congratulatory message text

[0343] Output: Notification to user terminal

[0344] Specific behavior:

[0345] Build notification data

[0346] Send to user device using PUSH notification API

[0347] The notification appears on the user's device.

[0348] (Application example 2)

[0349] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0350] There is currently no technical means to help users remember to celebrate important anniversaries and birthdays in communication applications. Furthermore, current systems have difficulty properly analyzing a user's emotional state and suggesting personalized gifts and messages based on that analysis. Therefore, there is a need for a system that allows users to celebrate the anniversaries of friends and family in a way that is sensitive to their emotions.

[0351] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring a friend list, anniversary information, and message history including emotion data, means for analyzing the received data and evaluating a relationship score with the user, and means for calculating reminder timing for anniversaries and birthdays based on the relationship score and emotion data. This allows the user to remember important anniversaries and celebrate them with gifts and messages appropriate for the situation.

[0352] A "user terminal" is a device that obtains friend lists, anniversary information, message history, and emotion data through the communication application platform and transmits them to the server.

[0353] A "communications application platform" is a software environment that allows users to send and receive messages and manage their friend lists.

[0354] A "friends list" is a collection of data containing information about friends and acquaintances associated with a user.

[0355] "Anniversary information" is data indicating birthdays and other special date information relating to the user and their friends.

[0356] "Message history" is data that contains a record of messages that a user has sent and received in the past.

[0357] "Emotion data" refers to data that indicates the emotional state of a user as recognized from their text message, voice, facial expression, and the like.

[0358] A "server" is a central processing unit that receives and analyzes data sent from a user terminal, generates appropriate results, and returns them to the user terminal.

[0359] The "relationship score" is numerical data calculated by the server to evaluate the depth of the relationship between the user and his / her friends.

[0360] "Reminder timing" refers to the time and date settings that are calculated to appropriately remind you about a particular anniversary or birthday.

[0361] A "generative model" is a machine learning model used by the server to generate gift suggestions and message texts that are suitable for the user.

[0362] "Gift suggestions" are information that the server recommends to the user the best gift for a particular anniversary.

[0363] The "congratulatory message text" is the content of a message that the server creates using a generative model and that the user sends to friends and acquaintances.

[0364] "Notifications" are alerts or messages sent by the server to a user's device to remind them of a particular anniversary or birthday.

[0365] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of friends and acquaintances on a communication application platform without forgetting them, and that recognizes the user's emotions and suggests the most appropriate gifts and messages.

[0366] System Overview

[0367] The user terminal collects friend lists, anniversary information, message history, and emotion data through the communication application platform and transmits the collected data to the server, which analyzes the received data and evaluates the relationship score with the user.

[0368] User terminal hardware and software

[0369] Mobile devices such as smartphones and tablets

[0370] Emotion recognition API (e.g. Emotion AI API)

[0371] Communication Application Platform

[0372] Server hardware and software

[0373] A secure database (e.g., a SQL database)

[0374] Data Analysis Engine

[0375] Generative models using machine learning models

[0376] Data collection and analysis flow

[0377] 1. Data Collection:

[0378] The user's device collects friend lists, anniversary information, message history, and emotional data through the communication application platform and sends this data to the server. Emotional data is obtained from text messages, voice, facial expressions, etc. and analyzed using the Emotion AI API.

[0379] 2. Data Analysis:

[0380] The server stores the received data in a secure database and begins analysis. It calculates a relationship score with the user based on message frequency, response speed, number of common groups, and emotional data. The emotional engine analyzes the text messages and recognizes the user's current emotional state.

[0381] 3. Decide on the timing of the reminder:

[0382] The server calculates the timing of anniversary and birthday reminders based on the relationship score, typically set to seven days before a particular anniversary or birthday.

[0383] 4. Generate gift and message suggestions:

[0384] The server uses the generative model to generate optimal gift suggestions for the user. The gift suggestions are selected based on the user's emotional state and recent conversations. The server also generates congratulatory message text based on past message history and emotional data.

[0385] 5. Sending notifications:

[0386] The generated reminder, gift suggestion, and congratulatory message text are notified to the user terminal from the server.

[0387] Specific examples

[0388] For example, consider a case where a user wants to celebrate a friend's birthday. The user uses a communication application platform to obtain a friend list and their birthday information. The emotion engine recognizes the user's current emotional state from their messages and facial expressions and sends this information to the server. The server calculates a relationship score based on message frequency, reaction speed, number of common groups, and emotion data. The timing of the reminder is determined based on this relationship score and the friend's birthday information. A reminder is typically set seven days before the birthday. The server then uses a generative model to suggest an appropriate gift. Taking into account the emotion data, the server suggests a gift that matches the user's recent conversations and emotions (e.g., if the user has been feeling stressed recently, a relaxing spa ticket would be suggested). Furthermore, based on the emotion data and message history, a congratulatory message is generated that includes an emotional episode (e.g., "You've been busy lately, but please take some time to enjoy your birthday!"). This information is finally sent to the user's device.

[0389] Prompt Sentence Examples

[0390] User message: "I've been busy and tired lately, but I want to remember to celebrate your birthday."

[0391] The system will suggest reminders and gifts based on the following information:

[0392] User ID: 12345

[0393] Friend ID: friend1

[0394] Friend's Birthday: 2023-10-20

[0395] Relationship score: 85

[0396] Current Emotion: Stress

[0397] Reminder date: 2023-10-13

[0398] Suggested gift: Spa tickets

[0399] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0400] Step 1:

[0401] The user terminal collects friend lists, anniversary information, message history, and emotion data from the communication application platform and sends them to the server. This input data includes the user's friend list, anniversary information associated with each friend, a record of past messages, and the user's emotion analysis results. The server receives this data and stores it in a secure database.

[0402] Step 2:

[0403] The server analyzes the received data and evaluates the relationship score with the user. The server calculates the relationship score with the user based on message frequency, reaction speed, number of common groups, and emotional data. This relationship score quantifies the depth of the relationship between the user and their friends. The server uses multiple algorithms based on the input data to calculate and output the final score.

[0404] Step 3:

[0405] The server calculates the timing of reminders for anniversaries and birthdays based on the relationship score and emotion data. The server receives information about anniversaries and birthdays as input data and typically sets the reminder timing seven days before a specific date. The server outputs the reminder date based on this calculation.

[0406] Step 4:

[0407] The server uses the generative model to generate suitable gift suggestions for the user. The input data includes the user's emotional state and recent message history, which the generative model analyzes to select the most suitable gift. The output gift suggestion is an appropriate gift item (e.g., a spa ticket if the user is stressed).

[0408] Step 5:

[0409] The server uses the generative model to generate a congratulatory message based on past message history and emotion data. The server uses past messages and emotion data as input data, and generates a congratulatory message including an emotional episode based on this. The server outputs the generated message text.

[0410] Step 6:

[0411] The server notifies the user terminal of the generated reminder, gift suggestions, and congratulatory message. In this notification process, the server sends the reminder date, suggested gifts, and congratulatory message to the user terminal and notifies them. The user terminal receives them and displays them to the user.

[0412] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0413] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0414] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0415] [Second embodiment]

[0416] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0417] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0418] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0419] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0420] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0421] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0422] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0423] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0424] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0425] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0426] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0427] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0428] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of their friends and acquaintances on a communication application platform.

[0429] First, the user terminal collects data through the communication application platform, including friend lists, anniversary information, and message history, and then transmits this data to the server.

[0430] The server then stores the received data and begins analyzing it. The server evaluates the user's relationship score with their friends based on factors such as message frequency, response speed, and the number of common groups. Based on the relationship score, the server calculates the appropriate reminder timing. For example, the server will remind the user seven days before an anniversary or birthday.

[0431] Once the reminder timing is determined, the server uses the generative model to suggest gifts. The server analyzes the friend's hobbies, preferences, and past interaction data and suggests gifts based on that.

[0432] Furthermore, the server generates the text of the congratulatory message. The server generates an appropriate message based on past message history, taking into account relationships and common anecdotes. This allows users to easily create touching messages to send to their friends.

[0433] The generated reminders, gift suggestions, and congratulatory messages are finally sent from the server to the user's device. The user receives these notifications and can prepare for the celebration of their friends' and acquaintances' anniversaries.

[0434] Specific examples

[0435] For example, consider a case where a user wants to remember to celebrate a friend's birthday. First, the user uses the communication application platform to obtain a list of friends and their birthday information. The user terminal then sends this information and message history to the server.

[0436] The server calculates a relationship score based on the frequency of messages, response time, and number of common groups with this friend, and then determines when to send a reminder seven days before the friend's birthday.

[0437] The server then uses the generative model to suggest suitable gifts for friends. It analyzes a friend's hobbies and preferences, suggesting the latest music albums to a music-loving friend, for example. The server also generates inspiring messages based on past messaging history. For example, it could generate a message along the lines of, "The concert we went to together last year was amazing. I hope this year will be another great one!"

[0438] Finally, this information is sent to the user's terminal, allowing the user to prepare a perfect birthday celebration for their friend. In this way, the present invention helps users remember important anniversaries and effectively strengthen their relationships.

[0439] The processing flow will be explained below.

[0440] Step 1:

[0441] The user terminal obtains the friend list, anniversary information, and message history through the communication application platform.

[0442] Step 2:

[0443] The user terminal encrypts the acquired friend list, anniversary information, and message history and transmits them to the server.

[0444] Step 3:

[0445] The server decrypts the received data and stores it in a secure database.

[0446] Step 4:

[0447] The server analyzes the stored data and calculates a relationship score between the user and each friend, based on metrics such as message frequency, response speed, and number of common groups.

[0448] Step 5:

[0449] The server uses the relationship score to determine when to remind you about each friend's birthday or anniversary, typically seven days before the anniversary or birthday.

[0450] Step 6:

[0451] The server schedules notifications based on reminder timing and saves the schedule information in a database.

[0452] Step 7:

[0453] The server uses the generative model to generate personalized gift suggestions for the user, based on the user's friends' hobbies, preferences, and past interactions.

[0454] Step 8:

[0455] The server generates a congratulatory message tailored to the user's friend based on their past message history, taking into account important past events and relationships.

[0456] Step 9:

[0457] The server compiles the generated reminders, gift suggestions, and congratulatory message texts and notifies them to the user terminal.

[0458] Step 10:

[0459] The user terminal displays the received notification to the user, allowing the user to remember and prepare for the celebration of a friend's birthday or anniversary.

[0460] Example 1

[0461] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0462] In today's society, people often forget the anniversaries and birthdays of friends and acquaintances due to their busy daily lives. This makes it difficult to maintain and deepen relationships, and can lead to weakened relationships. People often struggle to know the appropriate way to celebrate or the message they want to send. It is necessary to solve this problem and provide a way for users to easily celebrate anniversaries in a touching and effective way.

[0463] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0464] In this invention, the server includes a means for analyzing the received data and evaluating a relationship score with the user, a means for scheduling notifications based on reminder timing, a means for generating gift suggestions using a generative AI model, and a means for generating the text of a congratulatory message, thereby enabling users to remember anniversaries of their friends and acquaintances and to celebrate them in a timely and appropriate manner.

[0465] "User terminal" refers to an electronic device for obtaining and transmitting data to a server through a communication application platform.

[0466] A "communications application platform" is a software environment that allows users to send and receive messages and manage their friend lists.

[0467] A "friend list" is a list that includes information about acquaintances and friends with whom a user communicates.

[0468] "Anniversary information" is information about important dates such as birthdays and anniversaries of the user and their friends and acquaintances.

[0469] "Message history" is a record of messages sent and received in the past between a user and their friends and acquaintances.

[0470] A "server" is a central control device that analyzes and stores data received from user terminals and performs various processes based on that data.

[0471] The "relationship score" is a numerical value calculated based on the frequency of messages, response speed, number of common groups, etc., to evaluate the relationship between the user and a friend.

[0472] "Reminder timing" refers to the appropriate time to notify someone of an important date such as an anniversary or birthday.

[0473] "Scheduling a notification" means making and executing a plan to send a notification to a user at a specific time.

[0474] A "generative AI model" is an artificial intelligence model that generates new information or content based on given data.

[0475] "Gift Suggestions" are information generated using a generative AI model to suggest gifts for users to give to friends and acquaintances.

[0476] The "text of a congratulatory message" is a document containing congratulatory words that a user sends to friends and acquaintances.

[0477] MODE FOR CARRYING OUT THE INVENTION

[0478] This invention is an AI concierge system that helps users remember to celebrate the birthdays and anniversaries of their friends and acquaintances on a communication application platform.

[0479] First, the user device collects data through the communication application platform. This data includes friend lists, anniversary information, and message history. The user device then sends this data to the server. The data is transmitted over the Internet using the SSL / TLS protocol to ensure data security.

[0480] Next, the server stores the received data and begins analyzing it. The server saves the data in a database (e.g., MySQL or PostgreSQL) and uses data analysis tools such as Python or R to evaluate the relationship score between the user and their friends based on factors such as message frequency, response speed, and the number of common groups. Based on this relationship score, the server calculates the appropriate reminder timing. For example, it could set the reminder timing to be seven days before an anniversary or birthday.

[0481] Once the reminder timing is determined, the server uses a generative AI model (e.g., GPT-3) to suggest gifts. The server analyzes the friend's hobbies, preferences, and past interactions data and suggests gifts based on that. For example, a friend who likes music will be suggested the latest music album.

[0482] The server also uses the generative AI model to generate congratulatory messages, including appropriate messages that take into account relationships and shared anecdotes based on past messaging history. For example, it might generate a message along the lines of, "The concert we went to together last year was amazing! I hope this year will be even more amazing!"

[0483] The generated reminders, gift suggestions, and congratulatory messages are finally sent from the server to the user's device. The server uses a notification system (e.g., Firebase Cloud Messaging or Apple Push Notification Service) to send notifications to the user's device. The user receives the notifications and can prepare to celebrate their friend's anniversary without forgetting about it.

[0484] Specific examples

[0485] For example, consider a case where a user wants to celebrate the birthday of a friend who loves music. First, the user terminal uses the communication application platform to obtain a list of friends and their birthday information. Then, this information and message history are sent to the server.

[0486] The server then calculates a relationship score by analyzing the frequency of messages with this friend, response speed, and the number of common groups. It then determines when to send a reminder seven days before the friend's birthday. The server then uses the generative AI model to suggest gifts suitable for a music-loving friend. For example, it might suggest the latest music album.

[0487] Next, the server generates an inspiring message based on past message history, such as, "The concert we went to together last year was amazing. I hope this year will be a great one!"

[0488] The generated information is finally sent to the user's device, where the user can receive the notification and prepare a perfect birthday celebration for their friend. This system allows users to easily prepare for celebrations without forgetting important anniversaries.

[0489] Prompt Sentence Examples

[0490] For example, a prompt for the generative AI model might be, "A touching birthday message for a music-loving friend." The generated message might be, "The concert we went to together last year was amazing. I hope this year will be a great one!"

[0491] The above is the mode for carrying out the present invention.

[0492] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0493] Step 1:

[0494] The user terminal obtains the friend list, anniversary information, and message history through the communication application platform.

[0495] Specifically, the application automatically collects friend lists and anniversary information, extracts past message history, and stores the acquired data locally on the user's device.

[0496] Input: friend list, anniversary information, message history from a communication application platform

[0497] Output: Friends list, anniversary information, and message history stored on the user's device

[0498] Step 2:

[0499] The user terminal transmits the collected data to the server.

[0500] Specifically, the user terminal transmits data to the server via the Internet, using the SSL / TLS protocol to enhance data security.

[0501] Input: Friends list, anniversary information, and message history stored on the user's device

[0502] Output: Friends list, anniversary information, message history sent to the server

[0503] Step 3:

[0504] The server stores the received data in a database.

[0505] Specifically, the server securely stores data in a database such as MySQL or PostgreSQL.

[0506] Input: Friends list, anniversary information, message history sent to the server

[0507] Output: Friends list, anniversary information, message history stored in database

[0508] Step 4:

[0509] The server analyzes the stored data and evaluates the relationship score between the user and their friends.

[0510] Specifically, data analysis tools such as Python and R are used to analyze message frequency, response speed, and number of common groups, and calculate a relationship score.

[0511] Input: Friends list, anniversary information, message history stored in the database

[0512] Output: Calculated relationship score

[0513] Step 5:

[0514] The server calculates reminder timing for anniversaries and birthdays based on the relationship score.

[0515] Specifically, it sets priorities based on relationship scores and calculates timing, such as sending a reminder seven days before a birthday.

[0516] Input: Calculated relationship score, anniversary information

[0517] Output: Remind timing

[0518] Step 6:

[0519] The server uses the generative AI model to generate gift suggestions suited to the user.

[0520] Specifically, the system uses a generative AI model such as GPT-3 to generate gift suggestions based on prompts such as a friend's hobbies, preferences, and past interactions. For example, it might suggest the latest music albums to a friend who likes music.

[0521] Input: Friends' hobbies and preferences, past interactions

[0522] Output: Gift Suggestion

[0523] Step 7:

[0524] The server uses a generative AI model to generate the text of the congratulatory message.

[0525] Specifically, the AI ​​model is given a prompt to "generate a touching birthday message," and the generated message is customized based on past message history.

[0526] Input: Past message history, prompt text

[0527] Output: Congratulatory message text

[0528] Step 8:

[0529] The server notifies the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

[0530] Specifically, the generated information is sent to the user's device using a notification system (e.g., Firebase Cloud Messaging or Apple Push Notification Service).

[0531] Input: Reminder timing, gift suggestions, congratulatory message text

[0532] Output: Reminders, gift suggestions, and congratulatory messages sent to the user's device

[0533] By going through these processing steps, a system is constructed that allows users to celebrate the anniversaries of friends and acquaintances at an appropriate time.

[0534] (Application example 1)

[0535] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0536] Users need to be able to remember and appropriately celebrate the anniversaries and birthdays of their friends and family, and to be able to more personalized experiences in specific physical stores. However, with conventional systems, users must manually manage information and set reminders, and it takes a lot of time and effort to think of appropriate gifts and congratulatory messages. Another problem is that the in-store experience is not personalized, making it difficult to fully celebrate special anniversaries.

[0537] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0538] In this invention, the server includes: means for a user terminal to acquire a friend list, anniversary information, and message history through a communication application platform and transmit them to the server; means for the server to analyze the received data and evaluate a relationship score with the user; means for the server to calculate anniversary and birthday reminder timings based on the relationship score; means for the server to schedule notifications based on the reminder timings; means for the server to generate gift suggestions suitable for the user using a generative model; means for the server to generate congratulatory message texts based on past message history using the generative model; means for the user terminal to select a brick-and-mortar store to visit and set a reminder; means for the server to suggest gifts and celebratory services in the store; and means for the server to notify the user terminal of the generated reminders, gift suggestions, and congratulatory message texts. This allows users to automatically prepare to appropriately celebrate anniversaries and birthdays and personalize their in-store experiences.

[0539] A "user terminal" is a computer device that obtains data through a communication application platform and transmits it to a server.

[0540] A "communication application platform" is an online service that allows users to exchange information such as messages, images, and voice with other users.

[0541] A "friend list" is data that lists information about friends and acquaintances that a user has registered on the communication application platform.

[0542] "Anniversary information" is date information of birthdays and special anniversaries of friends and acquaintances.

[0543] "Message history" refers to a record of past messages exchanged by a user with friends and acquaintances through a communication application platform.

[0544] "Server" refers to a central system that receives, analyzes, stores, and provides various services from data sent from user terminals.

[0545] The "relationship score" is an index used by the server to evaluate the relationship between the user and a friend.

[0546] The "remind timing" is the optimum date and time to notify the user so that they do not forget anniversaries or birthdays.

[0547] A "generative model" is an algorithm that automatically generates appropriate gift suggestions and congratulatory message text from input data.

[0548] "Reminder" is a notification function that helps users not forget important appointments and events.

[0549] A "physical store" is a physical store space where users can purchase goods or receive services.

[0550] "Gift suggestions" are gift ideas that the server suggests to users using a generative model based on the hobbies and preferences of friends and acquaintances.

[0551] The "congratulatory message text" is a congratulatory text that the server generates using a generative model and referring to past message history.

[0552] "Notification" refers to information that the server sends to the user terminal, and includes reminders, gift suggestions, and congratulatory messages.

[0553] This invention provides a system that allows users to remember and appropriately celebrate specific anniversaries and birthdays, and to personalize their in-store experiences, by utilizing a user terminal, a server, a generative AI model, and a communication application platform.

[0554] First, the user device acquires the friend list, anniversary information, and message history through the communication application platform and sends this data to the server. The server analyzes the received data and evaluates the relationship score between the user and the friends.

[0555] Next, based on the relationship score, the server calculates the timing of reminders for anniversaries and birthdays. For example, it sets a reminder seven days before an anniversary or birthday. Furthermore, the user's device selects the physical store they plan to visit and sends that information to the server. This allows the server to suggest gift selection and celebration services at the store.

[0556] The server uses the generative model to generate gift suggestions suited to the user. This generative model makes appropriate suggestions based on the friend's hobbies, preferences, and past message history. The server also uses the generative model to create the text of the congratulatory message. This allows the user to send a touching and personalized message.

[0557] The generated reminders, gift suggestions, and congratulatory message texts are finally sent from the server to the user terminal, allowing the user to prepare to celebrate a special anniversary or birthday effectively.

[0558] Hardware and software used

[0559] User device: Smartphone

[0560] Server: Central server system

[0561] Communication Application Platform: Messaging App

[0562] Generative AI models: Natural language generation algorithms (e.g., GPT-3)

[0563] Specific examples

[0564] For example, consider a case where a user wants to celebrate a friend's birthday. The user obtains a friend list and their birthday information through a communication application platform. The user's device sends this information and message history to a server. The server analyzes the frequency of messages with this friend, response speed, and the number of common groups to calculate a relationship score. It then determines when to send a reminder seven days before the friend's birthday.

[0565] Examples of prompts include:

[0566] Friend's name: xxx

[0567] Date of Birth: 2023-12-25

[0568] Hobbies: Music, movies

[0569] Generate the following:

[0570] 1. Gift Suggestions (2 or more)

[0571] 2. Congratulatory Message

[0572] example:

[0573] 1. Suggestion 1: Latest Movie Trailer Tickets

[0574] Suggestion 2: A special music album

[0575] 2. Message: Happy birthday! Last year's music festival was amazing. I hope this year will be a great one too!

[0576] In this way, users can remember special anniversaries and efficiently prepare personalized responses.

[0577] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0578] Step 1:

[0579] The user terminal obtains the friend list, anniversary information, and message history through the communication application platform. Based on this, the data of the user's friends' birthdays and anniversaries is collected and sent to the server. The input is the friend list, anniversary information, and message history, and this is the data sent to the server.

[0580] Step 2:

[0581] The server analyzes the received friend list, anniversary information, and message history to evaluate the relationship score between the user and the friend. The server calculates the relationship score based on data such as message frequency, response speed, and number of common groups. The input is the acquired data, and the output is the relationship score. This quantifies the depth of the relationship with the friend.

[0582] Step 3:

[0583] The server calculates the timing of reminders for anniversaries and birthdays based on the relationship score. It sets appropriate reminder dates and times based on the relationship score. For example, a reminder for an important friend can be sent seven days before their birthday. The input is the relationship score, and the output is the reminder timing.

[0584] Step 4:

[0585] The user's device selects the physical store they plan to visit and sends that information to the server. By selecting the physical store information through the app, the user specifies which store they will use to prepare for the celebration. The input is the physical store information, and this is the data sent to the server.

[0586] Step 5:

[0587] The server proposes gifts and celebration services at the store based on the information about the physical store that the user plans to visit and the timing of the reminder.The server uses a generative AI model to generate gift suggestions based on the friend's hobbies and preferences.The input is the physical store information, the timing of the reminder, and the friend's hobbies and preferences, and the output is gift suggestions.

[0588] Step 6:

[0589] The server uses a generative AI model to generate a congratulatory message based on past message history. The server analyzes the message history and creates a message that takes into account relationships and common episodes. The input is the past message history, and the output is the congratulatory message text. This allows users to send moving messages.

[0590] Step 7:

[0591] The server notifies the user terminal of the generated reminder, gift suggestion, and congratulatory message text. The generated reminder information, suggestion, and message text are sent to the user terminal and notified to the user. The input is the generated reminder, gift suggestion, and congratulatory message text, and the output is the notification to the user terminal.

[0592] By following the steps above, the user can efficiently prepare for a celebration without forgetting an important anniversary.

[0593] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0594] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of friends and acquaintances on a communication application platform without forgetting them, and that recognizes the user's emotions and suggests the most appropriate gifts and messages.

[0595] First, the user device collects data through the communication application platform, including friend lists, anniversary information, message history, and emotion data for recognizing the user's emotions. The emotion engine recognizes emotions from the user's text messages, voice, and facial expressions, and sends the data to the server.

[0596] The server then stores all the received data in a secure database and begins analyzing it. The server evaluates the relationship score between the user and their friends based on message frequency, response speed, number of common groups, and the user's emotional data. This score is calculated by taking into account the depth of the emotional connection between the user and their friends.

[0597] Based on the analysis results, the server calculates the appropriate reminder timing, for example, setting a reminder time seven days before an anniversary or birthday.

[0598] Once the reminder timing is determined, the server uses the generative model to generate optimal gift suggestions for the user, taking into account the friend's hobbies and preferences and the user's recent emotional state.

[0599] Furthermore, the server generates the text of the congratulatory message. It generates an appropriate message based on the user's emotional data as well as past message history, taking into account relationships and common anecdotes. This allows users to easily create more emotional and relatable messages.

[0600] The generated reminders, gift suggestions, and congratulatory messages are finally sent from the server to the user's device. The user receives these notifications and can prepare for the celebration of their friends' and acquaintances' anniversaries.

[0601] Specific examples

[0602] For example, consider a case where a user wants to celebrate a friend's birthday. First, the user uses the communication application platform to obtain a list of friends and their birthday information. The emotion engine on the user's device recognizes the user's current emotional state from their messages and facial expressions, and transmits this information to the server.

[0603] The server calculates a relationship score based on message frequency, response speed, number of common groups, and emotional data, and then determines the timing of the reminder based on this relationship score and the friend's birthday information. The reminder is usually set seven days before the birthday.

[0604] The server then uses the generative model to suggest appropriate gifts, taking into account the emotional data and suggesting gifts that match recent conversations and emotions (e.g., a relaxing spa ticket if the user has been feeling stressed recently).

[0605] Furthermore, based on the emotional data and message history, a congratulatory message including an emotional episode is generated (e.g., "You've been busy lately, but please take your time and enjoy your birthday!").

[0606] Finally, this information is sent to the user's terminal, so that the user can receive the notification and prepare a perfect birthday celebration for their friend. In this way, the present invention helps users remember important anniversaries and celebrate them in a way that is in line with their feelings.

[0607] The processing flow will be explained below.

[0608] Step 1:

[0609] The user device obtains friend lists, anniversary information, and message history through the communication application platform, and the emotion engine on the user device recognizes and collects emotion data from the user's text messages, voice, and facial expressions.

[0610] Step 2:

[0611] The user terminal encrypts the acquired friend list, anniversary information, message history, and emotion data and transmits them securely to the server.

[0612] Step 3:

[0613] The server decrypts the received data and stores it in a secure database.

[0614] Step 4:

[0615] The server analyzes the stored data, including message frequency, response speed, number of common groups, and user sentiment data (e.g., fluctuations in positive / negative sentiment).

[0616] Step 5:

[0617] The server uses this data to calculate a relationship score between the user and their friends, taking into account their communication patterns and emotional depth.

[0618] Step 6:

[0619] The server determines the optimal reminder timing based on the calculated relationship score, usually seven days before a friend's birthday or anniversary.

[0620] Step 7:

[0621] The server schedules notifications based on reminder timing and saves the schedule information in a database.

[0622] Step 8:

[0623] The server uses the generative model to generate gift suggestions suited to the user, taking into account the user's emotional data and their friends' hobbies and preferences, and selecting the most suitable gift (e.g., relaxing items, hobby-related goods, etc.).

[0624] Step 9:

[0625] The server generates an emotional and relatable congratulatory message based on past message history and emotional data. The generated message includes content tailored to specific episodes and emotions.

[0626] Step 10:

[0627] The server notifies the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

[0628] Step 11:

[0629] The user terminal displays the received notification to the user, so that the user can remember to prepare for the celebration of the friend's birthday or anniversary. The user can purchase the suggested gift and send the generated message to the friend.

[0630] As such, an AI concierge system incorporating emotional data can help users prepare for more emotionally consistent celebrations.

[0631] Example 2

[0632] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0633] With conventional communication application platforms, users often forget the birthdays and anniversaries of their friends and acquaintances, and there is a lack of appropriate assistance when selecting congratulatory messages and gifts. This makes it easy for users to forget important dates, making it difficult to congratulate people emotionally. Furthermore, it is difficult to generate appropriate suggestions and messages that take the user's emotions into account, resulting in low user satisfaction.

[0634] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0635] In this invention, the server includes: means for a user terminal to acquire a friend list, anniversary information, message history, and emotion data through a communication application platform and transmit the acquired data to the server; means for the server to store the received data in a secure database and analyze the data based on message frequency, reaction speed, number of common groups, and emotion data; means for the server to evaluate a relationship score based on the data analysis results; means for the server to calculate reminder timing based on the relationship score and anniversary information; means for the server to schedule notifications based on the reminder timing; means for the server to generate gift suggestions suitable for the user using a generative AI model; means for the server to generate congratulatory message text based on past message history and emotion data using the generative AI model; and means for the server to notify the user terminal of the generated reminders, gift suggestions, and congratulatory message text. This allows users to remember anniversaries of their friends and acquaintances and select gifts and generate congratulatory messages that are in line with their emotions.

[0636] A "user terminal" is an electronic device that uses a communication application platform to collect friend lists, anniversary information, message history, and emotion data, and transmits them to a server.

[0637] A "communications application platform" is a collection of software and services that enables users to communicate with other users through text messages, voice, images, and video.

[0638] A "friends list" is a list of friends and acquaintances with whom a user is connected on his or her communication application platform.

[0639] "Anniversary information" is information about birthdays and other important anniversaries of the user's friends and acquaintances.

[0640] "Message history" is a record of past text messages sent and received between a user and their friends and acquaintances.

[0641] "Emotion data" is emotional data analyzed based on the user's text message, voice, facial expression, etc.

[0642] A "server" is a device or system that receives, analyzes, stores, and processes data sent from a user terminal.

[0643] A "secure database" is a database that protects data from unauthorized access from outside and stores data safely.

[0644] "Data analysis" is the process of analyzing numbers and trends based on collected data.

[0645] The "relationship score" is a number that indicates the depth of the relationship between a user and their friend, calculated based on their interactions, commonalities, and emotional data.

[0646] The "remind timing" is the optimum time and date for notifying the user of an anniversary or birthday.

[0647] A "generative AI model" is a model that uses artificial intelligence to generate and recommend text.

[0648] "Gift suggestions" are ideas and recommendations for the best gifts for the user's friends and acquaintances.

[0649] The "text of a congratulatory message" is the content of a message that a user sends to celebrate the anniversary or birthday of a friend or acquaintance.

[0650] "Notification" refers to information sent from the server to the user terminal, and may inform the user of reminders, gift suggestions, congratulatory messages, and the like.

[0651] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of their friends and acquaintances without forgetting them. It also aims to recognize the user's emotions and suggest the most suitable gifts and messages.

[0652] First, the user terminal collects the necessary data through the communication application platform, including:

[0653] Friends list (a list of friends and acquaintances the user is connected to)

[0654] Anniversary information (friends' birthdays and important anniversaries)

[0655] Message history (record of past text messages sent and received)

[0656] Emotional data (obtained from the user's text messages, voice, and facial expressions)

[0657] The user device collects this data and sends it to the server via a secure communication protocol (e.g., HTTPS). The emotion engine analyzes the user's messages and voice and generates emotion data.

[0658] The server then stores all the data it receives in a secure database and parses the data. The server parses the following elements:

[0659] Message frequency (frequency of communication between the user and their friends)

[0660] Response speed (how quickly messages are exchanged)

[0661] Number of common groups (number of common groups that the user and their friends are in)

[0662] Emotion data (data generated by the emotion engine)

[0663] Based on these analysis results, the server calculates a relationship score, which is a numerical representation of the depth of the feelings between the user and their friend. Based on this score, the server calculates the timing of reminders for anniversaries and birthdays. The reminder is usually set to occur seven days before the anniversary.

[0664] The server then uses the generative AI model to generate optimal gift suggestions for the user, which involves the following process:

[0665] Get the user's friends' hobbies and preferences from the database

[0666] Consider your recent emotional state

[0667] Enter a prompt into the generative AI model to generate gift suggestions

[0668] The server also generates congratulatory messages based on past message history and emotional data, allowing users to easily create emotional and relatable messages.

[0669] Finally, the generated reminders, gift suggestions, and congratulatory messages are sent from the server to the user's device, allowing the user to remember the anniversaries of their friends and acquaintances and prepare for their celebrations.

[0670] Specific examples

[0671] For example, if a user wants to remember to celebrate a friend's birthday, the user terminal first uses the communication application platform to obtain the friend list and the friend's birthday information, and the emotion engine recognizes the user's current emotional state from the user's message and facial expression, and then transmits this information to the server.

[0672] The server calculates a relationship score based on message frequency, response speed, number of common groups, and emotional data, and then determines the timing of the reminder based on this relationship score and the friend's birthday information. The reminder is usually set seven days before the birthday.

[0673] The server then uses the generative model to suggest appropriate gifts, such as "tickets to a relaxing spa if you've been feeling stressed lately."

[0674] Furthermore, the server generates a congratulatory message that includes an emotional episode based on the emotion data and message history, such as "You've been busy lately, but please take your time and enjoy your birthday!"

[0675] Finally, this information is sent to the user's terminal, allowing the user to prepare a perfect birthday celebration for their friend.

[0676] Prompt Sentence Examples

[0677] "Suggest the perfect gift and congratulatory message to celebrate a friend's birthday. Take recent conversations and sentiment data into account to make personalized suggestions."

[0678] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0679] Step 1: Data collection

[0680] The user device collects necessary data through the communication application platform, such as friend lists, anniversary information, message history, and emotional data. The emotional data is generated by analyzing the user's text messages, voice, and facial expressions using an emotion engine.

[0681] Input: The communication platform used by the user

[0682] Output: Friend list, anniversary information, message history, emotional data

[0683] Specific behavior:

[0684] The user opens the application

[0685] Data collection module syncs friends list

[0686] Get anniversary information

[0687] Retrieve message history from a local database

[0688] Emotion engine generates emotional data

[0689] Step 2: Send data

[0690] The user device sends the collected data to the server using a secure communication protocol (e.g., HTTPS).

[0691] Input: friend list, anniversary information, message history, emotional data

[0692] Output: Data received by the server

[0693] Specific behavior:

[0694] Convert collected data into JSON format

[0695] Send to server using HTTPS communication

[0696] Step 3: Data analysis

[0697] The server stores the received data in a secure database and performs data analysis, including message frequency, response speed, number of common groups, and sentiment data.

[0698] Input: Collected data (friend list, anniversary information, message history, emotional data)

[0699] Output: Analysis results (message frequency, reaction speed, number of common groups, evaluation of emotional data)

[0700] Specific behavior:

[0701] Save the received data to the database

[0702] Run data analysis algorithms to analyze each element

[0703] Step 4: Calculate the relationship score

[0704] The server calculates a relationship score based on the analysis results, which quantifies the depth of the feelings between the user and their friends.

[0705] Input: Analysis results (message frequency, reaction speed, number of common groups, evaluation of emotional data)

[0706] Output: Relationship score

[0707] Specific behavior:

[0708] Each element is weighted to calculate an overall relationship score

[0709] Step 5: Calculate the reminder timing

[0710] The server calculates the reminder timing based on the relationship score and anniversary information, usually set 7 days before the anniversary.

[0711] Input: Relationship score, anniversary information

[0712] Output: Remind timing

[0713] Specific behavior:

[0714] Get anniversary date

[0715] Calculate 7 days before the anniversary

[0716] Schedule reminders

[0717] Step 6: Generate gift suggestions

[0718] The server uses a generative AI model to generate optimal gift suggestions for the user, taking into account the user's friends' hobbies and preferences and the user's recent emotional state.

[0719] Input: Relationship score, emotional data, friends' hobbies and preferences

[0720] Output: Gift Suggestion

[0721] Specific behavior:

[0722] Enter a prompt into the generative AI model

[0723] Generate gift suggestions and match them with your preferences data

[0724] Step 7: Generate a congratulatory message

[0725] The server uses a generative AI model to generate the text of the congratulatory message, based on past message history and emotional data.

[0726] Input: Message history, emotion data

[0727] Output: Congratulatory message text

[0728] Specific behavior:

[0729] Analyze emotional data and message history

[0730] Enter a prompt into the generative AI model to generate a message

[0731] Step 8: Sending notifications

[0732] The server notifies the user terminal of the generated reminder, gift suggestion, and congratulatory message text.

[0733] Input: Reminder timing, gift suggestions, congratulatory message text

[0734] Output: Notification to user terminal

[0735] Specific behavior:

[0736] Build notification data

[0737] Send to user device using PUSH notification API

[0738] The notification appears on the user's device.

[0739] (Application example 2)

[0740] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0741] There is currently no technical means to help users remember to celebrate important anniversaries and birthdays in communication applications. Furthermore, current systems have difficulty properly analyzing a user's emotional state and suggesting personalized gifts and messages based on that analysis. Therefore, there is a need for a system that allows users to celebrate the anniversaries of friends and family in a way that is sensitive to their emotions.

[0742] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring a friend list, anniversary information, and message history including emotion data, means for analyzing the received data and evaluating a relationship score with the user, and means for calculating reminder timing for anniversaries and birthdays based on the relationship score and emotion data. This allows the user to remember important anniversaries and celebrate them with gifts and messages appropriate for the situation.

[0743] A "user terminal" is a device that obtains friend lists, anniversary information, message history, and emotion data through the communication application platform and transmits them to the server.

[0744] A "communications application platform" is a software environment that allows users to send and receive messages and manage their friend lists.

[0745] A "friends list" is a collection of data containing information about friends and acquaintances associated with a user.

[0746] "Anniversary information" is data indicating birthdays and other special date information relating to the user and their friends.

[0747] "Message history" is data that contains a record of messages that a user has sent and received in the past.

[0748] "Emotion data" refers to data that indicates the emotional state of a user as recognized from their text message, voice, facial expression, and the like.

[0749] A "server" is a central processing unit that receives and analyzes data sent from a user terminal, generates appropriate results, and returns them to the user terminal.

[0750] The "relationship score" is numerical data calculated by the server to evaluate the depth of the relationship between the user and his / her friends.

[0751] "Reminder timing" refers to the time and date settings that are calculated to appropriately remind you about a particular anniversary or birthday.

[0752] A "generative model" is a machine learning model used by the server to generate gift suggestions and message texts that are suitable for the user.

[0753] "Gift suggestions" are information that the server recommends to the user the best gift for a particular anniversary.

[0754] The "congratulatory message text" is the content of a message that the server creates using a generative model and that the user sends to friends and acquaintances.

[0755] "Notifications" are alerts or messages sent by the server to a user's device to remind them of a particular anniversary or birthday.

[0756] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of friends and acquaintances on a communication application platform without forgetting them, and that recognizes the user's emotions and suggests the most appropriate gifts and messages.

[0757] System Overview

[0758] The user terminal collects friend lists, anniversary information, message history, and emotion data through the communication application platform and transmits the collected data to the server, which analyzes the received data and evaluates the relationship score with the user.

[0759] User terminal hardware and software

[0760] Mobile devices such as smartphones and tablets

[0761] Emotion recognition API (e.g. Emotion AI API)

[0762] Communication Application Platform

[0763] Server hardware and software

[0764] A secure database (e.g., a SQL database)

[0765] Data Analysis Engine

[0766] Generative models using machine learning models

[0767] Data collection and analysis flow

[0768] 1. Data Collection:

[0769] The user's device collects friend lists, anniversary information, message history, and emotional data through the communication application platform and sends this data to the server. Emotional data is obtained from text messages, voice, facial expressions, etc. and analyzed using the Emotion AI API.

[0770] 2. Data Analysis:

[0771] The server stores the received data in a secure database and begins analysis. It calculates a relationship score with the user based on message frequency, response speed, number of common groups, and emotional data. The emotional engine analyzes the text messages and recognizes the user's current emotional state.

[0772] 3. Decide on the timing of the reminder:

[0773] The server calculates the timing of anniversary and birthday reminders based on the relationship score, typically set to seven days before a particular anniversary or birthday.

[0774] 4. Generate gift and message suggestions:

[0775] The server uses the generative model to generate optimal gift suggestions for the user. The gift suggestions are selected based on the user's emotional state and recent conversations. The server also generates congratulatory message text based on past message history and emotional data.

[0776] 5. Sending notifications:

[0777] The generated reminder, gift suggestion, and congratulatory message text are notified to the user terminal from the server.

[0778] Specific examples

[0779] For example, consider a case where a user wants to celebrate a friend's birthday. The user uses a communication application platform to obtain a friend list and their birthday information. The emotion engine recognizes the user's current emotional state from their messages and facial expressions and sends this information to the server. The server calculates a relationship score based on message frequency, reaction speed, number of common groups, and emotion data. The timing of the reminder is determined based on this relationship score and the friend's birthday information. A reminder is typically set seven days before the birthday. The server then uses a generative model to suggest an appropriate gift. Taking into account the emotion data, the server suggests a gift that matches the user's recent conversations and emotions (e.g., if the user has been feeling stressed recently, a relaxing spa ticket would be suggested). Furthermore, based on the emotion data and message history, a congratulatory message is generated that includes an emotional episode (e.g., "You've been busy lately, but please take some time to enjoy your birthday!"). This information is finally sent to the user's device.

[0780] Prompt Sentence Examples

[0781] User message: "I've been busy and tired lately, but I want to remember to celebrate your birthday."

[0782] The system will suggest reminders and gifts based on the following information:

[0783] User ID: 12345

[0784] Friend ID: friend1

[0785] Friend's Birthday: 2023-10-20

[0786] Relationship score: 85

[0787] Current Emotion: Stress

[0788] Reminder date: 2023-10-13

[0789] Suggested gift: Spa tickets

[0790] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0791] Step 1:

[0792] The user terminal collects friend lists, anniversary information, message history, and emotion data from the communication application platform and sends them to the server. This input data includes the user's friend list, anniversary information associated with each friend, a record of past messages, and the user's emotion analysis results. The server receives this data and stores it in a secure database.

[0793] Step 2:

[0794] The server analyzes the received data and evaluates the relationship score with the user. The server calculates the relationship score with the user based on message frequency, reaction speed, number of common groups, and emotional data. This relationship score quantifies the depth of the relationship between the user and their friends. The server uses multiple algorithms based on the input data to calculate and output the final score.

[0795] Step 3:

[0796] The server calculates the timing of reminders for anniversaries and birthdays based on the relationship score and emotion data. The server receives information about anniversaries and birthdays as input data and typically sets the reminder timing seven days before a specific date. The server outputs the reminder date based on this calculation.

[0797] Step 4:

[0798] The server uses the generative model to generate suitable gift suggestions for the user. The input data includes the user's emotional state and recent message history, which the generative model analyzes to select the most suitable gift. The output gift suggestion is an appropriate gift item (e.g., a spa ticket if the user is stressed).

[0799] Step 5:

[0800] The server uses the generative model to generate a congratulatory message based on past message history and emotion data. The server uses past messages and emotion data as input data, and generates a congratulatory message including an emotional episode based on this. The server outputs the generated message text.

[0801] Step 6:

[0802] The server notifies the user terminal of the generated reminder, gift suggestions, and congratulatory message. In this notification process, the server sends the reminder date, suggested gifts, and congratulatory message to the user terminal and notifies them. The user terminal receives them and displays them to the user.

[0803] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0804] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0805] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0806] [Third embodiment]

[0807] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0808] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0809] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0810] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0811] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0812] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0813] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0814] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0815] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0816] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0817] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0818] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0819] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of their friends and acquaintances on a communication application platform.

[0820] First, the user terminal collects data through the communication application platform, including friend lists, anniversary information, and message history, and then transmits this data to the server.

[0821] The server then stores the received data and begins analyzing it. The server evaluates the user's relationship score with their friends based on factors such as message frequency, response speed, and the number of common groups. Based on the relationship score, the server calculates the appropriate reminder timing. For example, the server will remind the user seven days before an anniversary or birthday.

[0822] Once the reminder timing is determined, the server uses the generative model to suggest gifts. The server analyzes the friend's hobbies, preferences, and past interaction data and suggests gifts based on that.

[0823] Furthermore, the server generates the text of the congratulatory message. The server generates an appropriate message based on past message history, taking into account relationships and common anecdotes. This allows users to easily create touching messages to send to their friends.

[0824] The generated reminders, gift suggestions, and congratulatory messages are finally sent from the server to the user's device. The user receives these notifications and can prepare for the celebration of their friends' and acquaintances' anniversaries.

[0825] Specific examples

[0826] For example, consider a case where a user wants to remember to celebrate a friend's birthday. First, the user uses the communication application platform to obtain a list of friends and their birthday information. The user terminal then sends this information and message history to the server.

[0827] The server calculates a relationship score based on the frequency of messages, response time, and number of common groups with this friend, and then determines when to send a reminder seven days before the friend's birthday.

[0828] The server then uses the generative model to suggest suitable gifts for friends. It analyzes a friend's hobbies and preferences, suggesting the latest music albums to a music-loving friend, for example. The server also generates inspiring messages based on past messaging history. For example, it could generate a message along the lines of, "The concert we went to together last year was amazing. I hope this year will be another great one!"

[0829] Finally, this information is sent to the user's terminal, allowing the user to prepare a perfect birthday celebration for their friend. In this way, the present invention helps users remember important anniversaries and effectively strengthen their relationships.

[0830] The processing flow will be explained below.

[0831] Step 1:

[0832] The user terminal obtains the friend list, anniversary information, and message history through the communication application platform.

[0833] Step 2:

[0834] The user terminal encrypts the acquired friend list, anniversary information, and message history and transmits them to the server.

[0835] Step 3:

[0836] The server decrypts the received data and stores it in a secure database.

[0837] Step 4:

[0838] The server analyzes the stored data and calculates a relationship score between the user and each friend, based on metrics such as message frequency, response speed, and number of common groups.

[0839] Step 5:

[0840] The server uses the relationship score to determine when to remind you about each friend's birthday or anniversary, typically seven days before the anniversary or birthday.

[0841] Step 6:

[0842] The server schedules notifications based on reminder timing and saves the schedule information in a database.

[0843] Step 7:

[0844] The server uses the generative model to generate personalized gift suggestions for the user, based on the user's friends' hobbies, preferences, and past interactions.

[0845] Step 8:

[0846] The server generates a congratulatory message tailored to the user's friend based on their past message history, taking into account important past events and relationships.

[0847] Step 9:

[0848] The server compiles the generated reminders, gift suggestions, and congratulatory message texts and notifies them to the user terminal.

[0849] Step 10:

[0850] The user terminal displays the received notification to the user, allowing the user to remember and prepare for the celebration of a friend's birthday or anniversary.

[0851] Example 1

[0852] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0853] In today's society, people often forget the anniversaries and birthdays of friends and acquaintances due to their busy daily lives. This makes it difficult to maintain and deepen relationships, and can lead to weakened relationships. People often struggle to know the appropriate way to celebrate or the message they want to send. It is necessary to solve this problem and provide a way for users to easily celebrate anniversaries in a touching and effective way.

[0854] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0855] In this invention, the server includes a means for analyzing the received data and evaluating a relationship score with the user, a means for scheduling notifications based on reminder timing, a means for generating gift suggestions using a generative AI model, and a means for generating the text of a congratulatory message, thereby enabling users to remember anniversaries of their friends and acquaintances and to celebrate them in a timely and appropriate manner.

[0856] "User terminal" refers to an electronic device for obtaining and transmitting data to a server through a communication application platform.

[0857] A "communications application platform" is a software environment that allows users to send and receive messages and manage their friend lists.

[0858] A "friend list" is a list that includes information about acquaintances and friends with whom a user communicates.

[0859] "Anniversary information" is information about important dates such as birthdays and anniversaries of the user and their friends and acquaintances.

[0860] "Message history" is a record of messages sent and received in the past between a user and their friends and acquaintances.

[0861] A "server" is a central control device that analyzes and stores data received from user terminals and performs various processes based on that data.

[0862] The "relationship score" is a numerical value calculated based on the frequency of messages, response speed, number of common groups, etc., to evaluate the relationship between the user and a friend.

[0863] "Reminder timing" refers to the appropriate time to notify someone of an important date such as an anniversary or birthday.

[0864] "Scheduling a notification" means making and executing a plan to send a notification to a user at a specific time.

[0865] A "generative AI model" is an artificial intelligence model that generates new information or content based on given data.

[0866] "Gift Suggestions" are information generated using a generative AI model to suggest gifts for users to give to friends and acquaintances.

[0867] The "text of a congratulatory message" is a document containing congratulatory words that a user sends to friends and acquaintances.

[0868] MODE FOR CARRYING OUT THE INVENTION

[0869] This invention is an AI concierge system that helps users remember to celebrate the birthdays and anniversaries of their friends and acquaintances on a communication application platform.

[0870] First, the user device collects data through the communication application platform. This data includes friend lists, anniversary information, and message history. The user device then sends this data to the server. The data is transmitted over the Internet using the SSL / TLS protocol to ensure data security.

[0871] Next, the server stores the received data and begins analyzing it. The server saves the data in a database (e.g., MySQL or PostgreSQL) and uses data analysis tools such as Python or R to evaluate the relationship score between the user and their friends based on factors such as message frequency, response speed, and the number of common groups. Based on this relationship score, the server calculates the appropriate reminder timing. For example, it could set the reminder timing to be seven days before an anniversary or birthday.

[0872] Once the reminder timing is determined, the server uses a generative AI model (e.g., GPT-3) to suggest gifts. The server analyzes the friend's hobbies, preferences, and past interactions data and suggests gifts based on that. For example, a friend who likes music will be suggested the latest music album.

[0873] The server also uses the generative AI model to generate congratulatory messages, including appropriate messages that take into account relationships and shared anecdotes based on past messaging history. For example, it might generate a message along the lines of, "The concert we went to together last year was amazing! I hope this year will be even more amazing!"

[0874] The generated reminders, gift suggestions, and congratulatory messages are finally sent from the server to the user's device. The server uses a notification system (e.g., Firebase Cloud Messaging or Apple Push Notification Service) to send notifications to the user's device. The user receives the notifications and can prepare to celebrate their friend's anniversary without forgetting about it.

[0875] Specific examples

[0876] For example, consider a case where a user wants to celebrate the birthday of a friend who loves music. First, the user terminal uses the communication application platform to obtain a list of friends and their birthday information. Then, this information and message history are sent to the server.

[0877] The server then calculates a relationship score by analyzing the frequency of messages with this friend, response speed, and the number of common groups. It then determines when to send a reminder seven days before the friend's birthday. The server then uses the generative AI model to suggest gifts suitable for a music-loving friend. For example, it might suggest the latest music album.

[0878] Next, the server generates an inspiring message based on past message history, such as, "The concert we went to together last year was amazing. I hope this year will be a great one!"

[0879] The generated information is finally sent to the user's device, where the user can receive the notification and prepare a perfect birthday celebration for their friend. This system allows users to easily prepare for celebrations without forgetting important anniversaries.

[0880] Prompt Sentence Examples

[0881] For example, a prompt for the generative AI model might be, "A touching birthday message for a music-loving friend." The generated message might be, "The concert we went to together last year was amazing. I hope this year will be a great one!"

[0882] The above is the mode for carrying out the present invention.

[0883] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0884] Step 1:

[0885] The user terminal obtains the friend list, anniversary information, and message history through the communication application platform.

[0886] Specifically, the application automatically collects friend lists and anniversary information, extracts past message history, and stores the acquired data locally on the user's device.

[0887] Input: friend list, anniversary information, message history from a communication application platform

[0888] Output: Friends list, anniversary information, and message history stored on the user's device

[0889] Step 2:

[0890] The user terminal transmits the collected data to the server.

[0891] Specifically, the user terminal transmits data to the server via the Internet, using the SSL / TLS protocol to enhance data security.

[0892] Input: Friends list, anniversary information, and message history stored on the user's device

[0893] Output: Friends list, anniversary information, message history sent to the server

[0894] Step 3:

[0895] The server stores the received data in a database.

[0896] Specifically, the server securely stores data in a database such as MySQL or PostgreSQL.

[0897] Input: Friends list, anniversary information, message history sent to the server

[0898] Output: Friends list, anniversary information, message history stored in database

[0899] Step 4:

[0900] The server analyzes the stored data and evaluates the relationship score between the user and their friends.

[0901] Specifically, data analysis tools such as Python and R are used to analyze message frequency, response speed, and number of common groups, and calculate a relationship score.

[0902] Input: Friends list, anniversary information, message history stored in the database

[0903] Output: Calculated relationship score

[0904] Step 5:

[0905] The server calculates reminder timing for anniversaries and birthdays based on the relationship score.

[0906] Specifically, it sets priorities based on relationship scores and calculates timing, such as sending a reminder seven days before a birthday.

[0907] Input: Calculated relationship score, anniversary information

[0908] Output: Remind timing

[0909] Step 6:

[0910] The server uses the generative AI model to generate gift suggestions suited to the user.

[0911] Specifically, the system uses a generative AI model such as GPT-3 to generate gift suggestions based on prompts such as a friend's hobbies, preferences, and past interactions. For example, it might suggest the latest music albums to a friend who likes music.

[0912] Input: Friends' hobbies and preferences, past interactions

[0913] Output: Gift Suggestion

[0914] Step 7:

[0915] The server uses a generative AI model to generate the text of the congratulatory message.

[0916] Specifically, the AI ​​model is given a prompt to "generate a touching birthday message," and the generated message is customized based on past message history.

[0917] Input: Past message history, prompt text

[0918] Output: Congratulatory message text

[0919] Step 8:

[0920] The server notifies the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

[0921] Specifically, the generated information is sent to the user's device using a notification system (e.g., Firebase Cloud Messaging or Apple Push Notification Service).

[0922] Input: Reminder timing, gift suggestions, congratulatory message text

[0923] Output: Reminders, gift suggestions, and congratulatory messages sent to the user's device

[0924] By going through these processing steps, a system is constructed that allows users to celebrate the anniversaries of friends and acquaintances at an appropriate time.

[0925] (Application example 1)

[0926] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0927] Users need to be able to remember and appropriately celebrate the anniversaries and birthdays of their friends and family, and to be able to more personalized experiences in specific physical stores. However, with conventional systems, users must manually manage information and set reminders, and it takes a lot of time and effort to think of appropriate gifts and congratulatory messages. Another problem is that the in-store experience is not personalized, making it difficult to fully celebrate special anniversaries.

[0928] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0929] In this invention, the server includes: means for a user terminal to acquire a friend list, anniversary information, and message history through a communication application platform and transmit them to the server; means for the server to analyze the received data and evaluate a relationship score with the user; means for the server to calculate anniversary and birthday reminder timings based on the relationship score; means for the server to schedule notifications based on the reminder timings; means for the server to generate gift suggestions suitable for the user using a generative model; means for the server to generate congratulatory message texts based on past message history using the generative model; means for the user terminal to select a brick-and-mortar store to visit and set a reminder; means for the server to suggest gifts and celebratory services in the store; and means for the server to notify the user terminal of the generated reminders, gift suggestions, and congratulatory message texts. This allows users to automatically prepare to appropriately celebrate anniversaries and birthdays and personalize their in-store experiences.

[0930] A "user terminal" is a computer device that obtains data through a communication application platform and transmits it to a server.

[0931] A "communication application platform" is an online service that allows users to exchange information such as messages, images, and voice with other users.

[0932] A "friend list" is data that lists information about friends and acquaintances that a user has registered on the communication application platform.

[0933] "Anniversary information" is date information of birthdays and special anniversaries of friends and acquaintances.

[0934] "Message history" refers to a record of past messages exchanged by a user with friends and acquaintances through a communication application platform.

[0935] "Server" refers to a central system that receives, analyzes, stores, and provides various services from data sent from user terminals.

[0936] The "relationship score" is an index used by the server to evaluate the relationship between the user and a friend.

[0937] The "remind timing" is the optimum date and time to notify the user so that they do not forget anniversaries or birthdays.

[0938] A "generative model" is an algorithm that automatically generates appropriate gift suggestions and congratulatory message text from input data.

[0939] "Reminder" is a notification function that helps users not forget important appointments and events.

[0940] A "physical store" is a physical store space where users can purchase goods or receive services.

[0941] "Gift suggestions" are gift ideas that the server suggests to users using a generative model based on the hobbies and preferences of friends and acquaintances.

[0942] The "congratulatory message text" is a congratulatory text that the server generates using a generative model and referring to past message history.

[0943] "Notification" refers to information that the server sends to the user terminal, and includes reminders, gift suggestions, and congratulatory messages.

[0944] This invention provides a system that allows users to remember and appropriately celebrate specific anniversaries and birthdays, and to personalize their in-store experiences, by utilizing a user terminal, a server, a generative AI model, and a communication application platform.

[0945] First, the user device acquires the friend list, anniversary information, and message history through the communication application platform and sends this data to the server. The server analyzes the received data and evaluates the relationship score between the user and the friends.

[0946] Next, based on the relationship score, the server calculates the timing of reminders for anniversaries and birthdays. For example, it sets a reminder seven days before an anniversary or birthday. Furthermore, the user's device selects the physical store they plan to visit and sends that information to the server. This allows the server to suggest gift selection and celebration services at the store.

[0947] The server uses the generative model to generate gift suggestions suited to the user. This generative model makes appropriate suggestions based on the friend's hobbies, preferences, and past message history. The server also uses the generative model to create the text of the congratulatory message. This allows the user to send a touching and personalized message.

[0948] The generated reminders, gift suggestions, and congratulatory message texts are finally sent from the server to the user terminal, allowing the user to prepare to celebrate a special anniversary or birthday effectively.

[0949] Hardware and software used

[0950] User device: Smartphone

[0951] Server: Central server system

[0952] Communication Application Platform: Messaging App

[0953] Generative AI models: Natural language generation algorithms (e.g., GPT-3)

[0954] Specific examples

[0955] For example, consider a case where a user wants to celebrate a friend's birthday. The user obtains a friend list and their birthday information through a communication application platform. The user's device sends this information and message history to a server. The server analyzes the frequency of messages with this friend, response speed, and the number of common groups to calculate a relationship score. It then determines when to send a reminder seven days before the friend's birthday.

[0956] Examples of prompts include:

[0957] Friend's name: xxx

[0958] Date of Birth: 2023-12-25

[0959] Hobbies: Music, movies

[0960] Generate the following:

[0961] 1. Gift Suggestions (2 or more)

[0962] 2. Congratulatory Message

[0963] example:

[0964] 1. Suggestion 1: Latest Movie Trailer Tickets

[0965] Suggestion 2: A special music album

[0966] 2. Message: Happy birthday! Last year's music festival was amazing. I hope this year will be a great one too!

[0967] In this way, users can remember special anniversaries and efficiently prepare personalized responses.

[0968] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0969] Step 1:

[0970] The user terminal obtains the friend list, anniversary information, and message history through the communication application platform. Based on this, the data of the user's friends' birthdays and anniversaries is collected and sent to the server. The input is the friend list, anniversary information, and message history, and this is the data sent to the server.

[0971] Step 2:

[0972] The server analyzes the received friend list, anniversary information, and message history to evaluate the relationship score between the user and the friend. The server calculates the relationship score based on data such as message frequency, response speed, and number of common groups. The input is the acquired data, and the output is the relationship score. This quantifies the depth of the relationship with the friend.

[0973] Step 3:

[0974] The server calculates the timing of reminders for anniversaries and birthdays based on the relationship score. It sets appropriate reminder dates and times based on the relationship score. For example, a reminder for an important friend can be sent seven days before their birthday. The input is the relationship score, and the output is the reminder timing.

[0975] Step 4:

[0976] The user's device selects the physical store they plan to visit and sends that information to the server. By selecting the physical store information through the app, the user specifies which store they will use to prepare for the celebration. The input is the physical store information, and this is the data sent to the server.

[0977] Step 5:

[0978] The server proposes gifts and celebration services at the store based on the information about the physical store that the user plans to visit and the timing of the reminder.The server uses a generative AI model to generate gift suggestions based on the friend's hobbies and preferences.The input is the physical store information, the timing of the reminder, and the friend's hobbies and preferences, and the output is gift suggestions.

[0979] Step 6:

[0980] The server uses a generative AI model to generate a congratulatory message based on past message history. The server analyzes the message history and creates a message that takes into account relationships and common episodes. The input is the past message history, and the output is the congratulatory message text. This allows users to send moving messages.

[0981] Step 7:

[0982] The server notifies the user terminal of the generated reminder, gift suggestion, and congratulatory message text. The generated reminder information, suggestion, and message text are sent to the user terminal and notified to the user. The input is the generated reminder, gift suggestion, and congratulatory message text, and the output is the notification to the user terminal.

[0983] By following the steps above, the user can efficiently prepare for a celebration without forgetting an important anniversary.

[0984] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0985] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of friends and acquaintances on a communication application platform without forgetting them, and that recognizes the user's emotions and suggests the most appropriate gifts and messages.

[0986] First, the user device collects data through the communication application platform, including friend lists, anniversary information, message history, and emotion data for recognizing the user's emotions. The emotion engine recognizes emotions from the user's text messages, voice, and facial expressions, and sends the data to the server.

[0987] The server then stores all the received data in a secure database and begins analyzing it. The server evaluates the relationship score between the user and their friends based on message frequency, response speed, number of common groups, and the user's emotional data. This score is calculated by taking into account the depth of the emotional connection between the user and their friends.

[0988] Based on the analysis results, the server calculates the appropriate reminder timing, for example, setting a reminder time seven days before an anniversary or birthday.

[0989] Once the reminder timing is determined, the server uses the generative model to generate optimal gift suggestions for the user, taking into account the friend's hobbies and preferences and the user's recent emotional state.

[0990] Furthermore, the server generates the text of the congratulatory message. It generates an appropriate message based on the user's emotional data as well as past message history, taking into account relationships and common anecdotes. This allows users to easily create more emotional and relatable messages.

[0991] The generated reminders, gift suggestions, and congratulatory messages are finally sent from the server to the user's device. The user receives these notifications and can prepare for the celebration of their friends' and acquaintances' anniversaries.

[0992] Specific examples

[0993] For example, consider a case where a user wants to celebrate a friend's birthday. First, the user uses the communication application platform to obtain a list of friends and their birthday information. The emotion engine on the user's device recognizes the user's current emotional state from their messages and facial expressions, and transmits this information to the server.

[0994] The server calculates a relationship score based on message frequency, response speed, number of common groups, and emotional data, and then determines the timing of the reminder based on this relationship score and the friend's birthday information. The reminder is usually set seven days before the birthday.

[0995] The server then uses the generative model to suggest appropriate gifts, taking into account the emotional data and suggesting gifts that match recent conversations and emotions (e.g., a relaxing spa ticket if the user has been feeling stressed recently).

[0996] Furthermore, based on the emotional data and message history, a congratulatory message including an emotional episode is generated (e.g., "You've been busy lately, but please take your time and enjoy your birthday!").

[0997] Finally, this information is sent to the user's terminal, so that the user can receive the notification and prepare a perfect birthday celebration for their friend. In this way, the present invention helps users remember important anniversaries and celebrate them in a way that is in line with their feelings.

[0998] The processing flow will be explained below.

[0999] Step 1:

[1000] The user device obtains friend lists, anniversary information, and message history through the communication application platform, and the emotion engine on the user device recognizes and collects emotion data from the user's text messages, voice, and facial expressions.

[1001] Step 2:

[1002] The user terminal encrypts the acquired friend list, anniversary information, message history, and emotion data and transmits them securely to the server.

[1003] Step 3:

[1004] The server decrypts the received data and stores it in a secure database.

[1005] Step 4:

[1006] The server analyzes the stored data, including message frequency, response speed, number of common groups, and user sentiment data (e.g., fluctuations in positive / negative sentiment).

[1007] Step 5:

[1008] The server uses this data to calculate a relationship score between the user and their friends, taking into account their communication patterns and emotional depth.

[1009] Step 6:

[1010] The server determines the optimal reminder timing based on the calculated relationship score, usually seven days before a friend's birthday or anniversary.

[1011] Step 7:

[1012] The server schedules notifications based on reminder timing and saves the schedule information in a database.

[1013] Step 8:

[1014] The server uses the generative model to generate gift suggestions suited to the user, taking into account the user's emotional data and their friends' hobbies and preferences, and selecting the most suitable gift (e.g., relaxing items, hobby-related goods, etc.).

[1015] Step 9:

[1016] The server generates an emotional and relatable congratulatory message based on past message history and emotional data. The generated message includes content tailored to specific episodes and emotions.

[1017] Step 10:

[1018] The server notifies the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

[1019] Step 11:

[1020] The user terminal displays the received notification to the user, so that the user can remember to prepare for the celebration of the friend's birthday or anniversary. The user can purchase the suggested gift and send the generated message to the friend.

[1021] As such, an AI concierge system incorporating emotional data can help users prepare for more emotionally consistent celebrations.

[1022] Example 2

[1023] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1024] With conventional communication application platforms, users often forget the birthdays and anniversaries of their friends and acquaintances, and there is a lack of appropriate assistance when selecting congratulatory messages and gifts. This makes it easy for users to forget important dates, making it difficult to congratulate people emotionally. Furthermore, it is difficult to generate appropriate suggestions and messages that take the user's emotions into account, resulting in low user satisfaction.

[1025] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1026] In this invention, the server includes: means for a user terminal to acquire a friend list, anniversary information, message history, and emotion data through a communication application platform and transmit the acquired data to the server; means for the server to store the received data in a secure database and analyze the data based on message frequency, reaction speed, number of common groups, and emotion data; means for the server to evaluate a relationship score based on the data analysis results; means for the server to calculate reminder timing based on the relationship score and anniversary information; means for the server to schedule notifications based on the reminder timing; means for the server to generate gift suggestions suitable for the user using a generative AI model; means for the server to generate congratulatory message text based on past message history and emotion data using the generative AI model; and means for the server to notify the user terminal of the generated reminders, gift suggestions, and congratulatory message text. This allows users to remember anniversaries of their friends and acquaintances and select gifts and generate congratulatory messages that are in line with their emotions.

[1027] A "user terminal" is an electronic device that uses a communication application platform to collect friend lists, anniversary information, message history, and emotion data, and transmits them to a server.

[1028] A "communications application platform" is a collection of software and services that enables users to communicate with other users through text messages, voice, images, and video.

[1029] A "friends list" is a list of friends and acquaintances with whom a user is connected on his or her communication application platform.

[1030] "Anniversary information" is information about birthdays and other important anniversaries of the user's friends and acquaintances.

[1031] "Message history" is a record of past text messages sent and received between a user and their friends and acquaintances.

[1032] "Emotion data" is emotional data analyzed based on the user's text message, voice, facial expression, etc.

[1033] A "server" is a device or system that receives, analyzes, stores, and processes data sent from a user terminal.

[1034] A "secure database" is a database that protects data from unauthorized access from outside and stores data safely.

[1035] "Data analysis" is the process of analyzing numbers and trends based on collected data.

[1036] The "relationship score" is a number that indicates the depth of the relationship between a user and their friend, calculated based on their interactions, commonalities, and emotional data.

[1037] The "remind timing" is the optimum time and date for notifying the user of an anniversary or birthday.

[1038] A "generative AI model" is a model that uses artificial intelligence to generate and recommend text.

[1039] "Gift suggestions" are ideas and recommendations for the best gifts for the user's friends and acquaintances.

[1040] The "text of a congratulatory message" is the content of a message that a user sends to celebrate the anniversary or birthday of a friend or acquaintance.

[1041] "Notification" refers to information sent from the server to the user terminal, and may inform the user of reminders, gift suggestions, congratulatory messages, and the like.

[1042] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of their friends and acquaintances without forgetting them. It also aims to recognize the user's emotions and suggest the most suitable gifts and messages.

[1043] First, the user terminal collects the necessary data through the communication application platform, including:

[1044] Friends list (a list of friends and acquaintances the user is connected to)

[1045] Anniversary information (friends' birthdays and important anniversaries)

[1046] Message history (record of past text messages sent and received)

[1047] Emotional data (obtained from the user's text messages, voice, and facial expressions)

[1048] The user device collects this data and sends it to the server via a secure communication protocol (e.g., HTTPS). The emotion engine analyzes the user's messages and voice and generates emotion data.

[1049] The server then stores all the data it receives in a secure database and parses the data. The server parses the following elements:

[1050] Message frequency (frequency of communication between the user and their friends)

[1051] Response speed (how quickly messages are exchanged)

[1052] Number of common groups (number of common groups that the user and their friends are in)

[1053] Emotion data (data generated by the emotion engine)

[1054] Based on these analysis results, the server calculates a relationship score, which is a numerical representation of the depth of the feelings between the user and their friend. Based on this score, the server calculates the timing of reminders for anniversaries and birthdays. The reminder is usually set to occur seven days before the anniversary.

[1055] The server then uses the generative AI model to generate optimal gift suggestions for the user, which involves the following process:

[1056] Get the user's friends' hobbies and preferences from the database

[1057] Consider your recent emotional state

[1058] Enter a prompt into the generative AI model to generate gift suggestions

[1059] The server also generates congratulatory messages based on past message history and emotional data, allowing users to easily create emotional and relatable messages.

[1060] Finally, the generated reminders, gift suggestions, and congratulatory messages are sent from the server to the user's device, allowing the user to remember the anniversaries of their friends and acquaintances and prepare for their celebrations.

[1061] Specific examples

[1062] For example, if a user wants to remember to celebrate a friend's birthday, the user terminal first uses the communication application platform to obtain the friend list and the friend's birthday information, and the emotion engine recognizes the user's current emotional state from the user's message and facial expression, and then transmits this information to the server.

[1063] The server calculates a relationship score based on message frequency, response speed, number of common groups, and emotional data, and then determines the timing of the reminder based on this relationship score and the friend's birthday information. The reminder is usually set seven days before the birthday.

[1064] The server then uses the generative model to suggest appropriate gifts, such as "tickets to a relaxing spa if you've been feeling stressed lately."

[1065] Furthermore, the server generates a congratulatory message that includes an emotional episode based on the emotion data and message history, such as "You've been busy lately, but please take your time and enjoy your birthday!"

[1066] Finally, this information is sent to the user's terminal, allowing the user to prepare a perfect birthday celebration for their friend.

[1067] Prompt Sentence Examples

[1068] "Suggest the perfect gift and congratulatory message to celebrate a friend's birthday. Take recent conversations and sentiment data into account to make personalized suggestions."

[1069] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1070] Step 1: Data collection

[1071] The user device collects necessary data through the communication application platform, such as friend lists, anniversary information, message history, and emotional data. The emotional data is generated by analyzing the user's text messages, voice, and facial expressions using an emotion engine.

[1072] Input: The communication platform used by the user

[1073] Output: Friend list, anniversary information, message history, emotional data

[1074] Specific behavior:

[1075] The user opens the application

[1076] Data collection module syncs friends list

[1077] Get anniversary information

[1078] Retrieve message history from a local database

[1079] Emotion engine generates emotional data

[1080] Step 2: Send data

[1081] The user device sends the collected data to the server using a secure communication protocol (e.g., HTTPS).

[1082] Input: friend list, anniversary information, message history, emotional data

[1083] Output: Data received by the server

[1084] Specific behavior:

[1085] Convert collected data into JSON format

[1086] Send to server using HTTPS communication

[1087] Step 3: Data analysis

[1088] The server stores the received data in a secure database and performs data analysis, including message frequency, response speed, number of common groups, and sentiment data.

[1089] Input: Collected data (friend list, anniversary information, message history, emotional data)

[1090] Output: Analysis results (message frequency, reaction speed, number of common groups, evaluation of emotional data)

[1091] Specific behavior:

[1092] Save the received data to the database

[1093] Run data analysis algorithms to analyze each element

[1094] Step 4: Calculate the relationship score

[1095] The server calculates a relationship score based on the analysis results, which quantifies the depth of the feelings between the user and their friends.

[1096] Input: Analysis results (message frequency, reaction speed, number of common groups, evaluation of emotional data)

[1097] Output: Relationship score

[1098] Specific behavior:

[1099] Each element is weighted to calculate an overall relationship score

[1100] Step 5: Calculate the reminder timing

[1101] The server calculates the reminder timing based on the relationship score and anniversary information, usually set 7 days before the anniversary.

[1102] Input: Relationship score, anniversary information

[1103] Output: Remind timing

[1104] Specific behavior:

[1105] Get anniversary date

[1106] Calculate 7 days before the anniversary

[1107] Schedule reminders

[1108] Step 6: Generate gift suggestions

[1109] The server uses a generative AI model to generate optimal gift suggestions for the user, taking into account the user's friends' hobbies and preferences and the user's recent emotional state.

[1110] Input: Relationship score, emotional data, friends' hobbies and preferences

[1111] Output: Gift Suggestion

[1112] Specific behavior:

[1113] Enter a prompt into the generative AI model

[1114] Generate gift suggestions and match them with your preferences data

[1115] Step 7: Generate a congratulatory message

[1116] The server uses a generative AI model to generate the text of the congratulatory message, based on past message history and emotional data.

[1117] Input: Message history, emotion data

[1118] Output: Congratulatory message text

[1119] Specific behavior:

[1120] Analyze emotional data and message history

[1121] Enter a prompt into the generative AI model to generate a message

[1122] Step 8: Sending notifications

[1123] The server notifies the user terminal of the generated reminder, gift suggestion, and congratulatory message text.

[1124] Input: Reminder timing, gift suggestions, congratulatory message text

[1125] Output: Notification to user terminal

[1126] Specific behavior:

[1127] Build notification data

[1128] Send to user device using PUSH notification API

[1129] The notification appears on the user's device.

[1130] (Application example 2)

[1131] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1132] There is currently no technical means to help users remember to celebrate important anniversaries and birthdays in communication applications. Furthermore, current systems have difficulty properly analyzing a user's emotional state and suggesting personalized gifts and messages based on that analysis. Therefore, there is a need for a system that allows users to celebrate the anniversaries of friends and family in a way that is sensitive to their emotions.

[1133] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring a friend list, anniversary information, and message history including emotion data, means for analyzing the received data and evaluating a relationship score with the user, and means for calculating reminder timing for anniversaries and birthdays based on the relationship score and emotion data. This allows the user to remember important anniversaries and celebrate them with gifts and messages appropriate for the situation.

[1134] A "user terminal" is a device that obtains friend lists, anniversary information, message history, and emotion data through the communication application platform and transmits them to the server.

[1135] A "communications application platform" is a software environment that allows users to send and receive messages and manage their friend lists.

[1136] A "friends list" is a collection of data containing information about friends and acquaintances associated with a user.

[1137] "Anniversary information" is data indicating birthdays and other special date information relating to the user and their friends.

[1138] "Message history" is data that contains a record of messages that a user has sent and received in the past.

[1139] "Emotion data" refers to data that indicates the emotional state of a user as recognized from their text message, voice, facial expression, and the like.

[1140] A "server" is a central processing unit that receives and analyzes data sent from a user terminal, generates appropriate results, and returns them to the user terminal.

[1141] The "relationship score" is numerical data calculated by the server to evaluate the depth of the relationship between the user and his / her friends.

[1142] "Reminder timing" refers to the time and date settings that are calculated to appropriately remind you about a particular anniversary or birthday.

[1143] A "generative model" is a machine learning model used by the server to generate gift suggestions and message texts that are suitable for the user.

[1144] "Gift suggestions" are information that the server recommends to the user the best gift for a particular anniversary.

[1145] The "congratulatory message text" is the content of a message that the server creates using a generative model and that the user sends to friends and acquaintances.

[1146] "Notifications" are alerts or messages sent by the server to a user's device to remind them of a particular anniversary or birthday.

[1147] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of friends and acquaintances on a communication application platform without forgetting them, and that recognizes the user's emotions and suggests the most appropriate gifts and messages.

[1148] System Overview

[1149] The user terminal collects friend lists, anniversary information, message history, and emotion data through the communication application platform and transmits the collected data to the server, which analyzes the received data and evaluates the relationship score with the user.

[1150] User terminal hardware and software

[1151] Mobile devices such as smartphones and tablets

[1152] Emotion recognition API (e.g. Emotion AI API)

[1153] Communication Application Platform

[1154] Server hardware and software

[1155] A secure database (e.g., a SQL database)

[1156] Data Analysis Engine

[1157] Generative models using machine learning models

[1158] Data collection and analysis flow

[1159] 1. Data Collection:

[1160] The user's device collects friend lists, anniversary information, message history, and emotional data through the communication application platform and sends this data to the server. Emotional data is obtained from text messages, voice, facial expressions, etc. and analyzed using the Emotion AI API.

[1161] 2. Data Analysis:

[1162] The server stores the received data in a secure database and begins analysis. It calculates a relationship score with the user based on message frequency, response speed, number of common groups, and emotional data. The emotional engine analyzes the text messages and recognizes the user's current emotional state.

[1163] 3. Decide on the timing of the reminder:

[1164] The server calculates the timing of anniversary and birthday reminders based on the relationship score, typically set to seven days before a particular anniversary or birthday.

[1165] 4. Generate gift and message suggestions:

[1166] The server uses the generative model to generate optimal gift suggestions for the user. The gift suggestions are selected based on the user's emotional state and recent conversations. The server also generates congratulatory message text based on past message history and emotional data.

[1167] 5. Sending notifications:

[1168] The generated reminder, gift suggestion, and congratulatory message text are notified to the user terminal from the server.

[1169] Specific examples

[1170] For example, consider a case where a user wants to celebrate a friend's birthday. The user uses a communication application platform to obtain a friend list and their birthday information. The emotion engine recognizes the user's current emotional state from their messages and facial expressions and sends this information to the server. The server calculates a relationship score based on message frequency, reaction speed, number of common groups, and emotion data. The timing of the reminder is determined based on this relationship score and the friend's birthday information. A reminder is typically set seven days before the birthday. The server then uses a generative model to suggest an appropriate gift. Taking into account the emotion data, the server suggests a gift that matches the user's recent conversations and emotions (e.g., if the user has been feeling stressed recently, a relaxing spa ticket would be suggested). Furthermore, based on the emotion data and message history, a congratulatory message is generated that includes an emotional episode (e.g., "You've been busy lately, but please take some time to enjoy your birthday!"). This information is finally sent to the user's device.

[1171] Prompt Sentence Examples

[1172] User message: "I've been busy and tired lately, but I want to remember to celebrate your birthday."

[1173] The system will suggest reminders and gifts based on the following information:

[1174] User ID: 12345

[1175] Friend ID: friend1

[1176] Friend's Birthday: 2023-10-20

[1177] Relationship score: 85

[1178] Current Emotion: Stress

[1179] Reminder date: 2023-10-13

[1180] Suggested gift: Spa tickets

[1181] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1182] Step 1:

[1183] The user terminal collects friend lists, anniversary information, message history, and emotion data from the communication application platform and sends them to the server. This input data includes the user's friend list, anniversary information associated with each friend, a record of past messages, and the user's emotion analysis results. The server receives this data and stores it in a secure database.

[1184] Step 2:

[1185] The server analyzes the received data and evaluates the relationship score with the user. The server calculates the relationship score with the user based on message frequency, reaction speed, number of common groups, and emotional data. This relationship score quantifies the depth of the relationship between the user and their friends. The server uses multiple algorithms based on the input data to calculate and output the final score.

[1186] Step 3:

[1187] The server calculates the timing of reminders for anniversaries and birthdays based on the relationship score and emotion data. The server receives information about anniversaries and birthdays as input data and typically sets the reminder timing seven days before a specific date. The server outputs the reminder date based on this calculation.

[1188] Step 4:

[1189] The server uses the generative model to generate suitable gift suggestions for the user. The input data includes the user's emotional state and recent message history, which the generative model analyzes to select the most suitable gift. The output gift suggestion is an appropriate gift item (e.g., a spa ticket if the user is stressed).

[1190] Step 5:

[1191] The server uses the generative model to generate a congratulatory message based on past message history and emotion data. The server uses past messages and emotion data as input data, and generates a congratulatory message including an emotional episode based on this. The server outputs the generated message text.

[1192] Step 6:

[1193] The server notifies the user terminal of the generated reminder, gift suggestions, and congratulatory message. In this notification process, the server sends the reminder date, suggested gifts, and congratulatory message to the user terminal and notifies them. The user terminal receives them and displays them to the user.

[1194] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1195] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1196] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1197] [Fourth embodiment]

[1198] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1199] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1200] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1201] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1202] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1203] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1204] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1205] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1206] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1207] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1208] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1209] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1210] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1211] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of their friends and acquaintances on a communication application platform.

[1212] First, the user terminal collects data through the communication application platform, including friend lists, anniversary information, and message history, and then transmits this data to the server.

[1213] The server then stores the received data and begins analyzing it. The server evaluates the user's relationship score with their friends based on factors such as message frequency, response speed, and the number of common groups. Based on the relationship score, the server calculates the appropriate reminder timing. For example, the server will remind the user seven days before an anniversary or birthday.

[1214] Once the reminder timing is determined, the server uses the generative model to suggest gifts. The server analyzes the friend's hobbies, preferences, and past interaction data and suggests gifts based on that.

[1215] Furthermore, the server generates the text of the congratulatory message. The server generates an appropriate message based on past message history, taking into account relationships and common anecdotes. This allows users to easily create touching messages to send to their friends.

[1216] The generated reminders, gift suggestions, and congratulatory messages are finally sent from the server to the user's device. The user receives these notifications and can prepare for the celebration of their friends' and acquaintances' anniversaries.

[1217] Specific examples

[1218] For example, consider a case where a user wants to remember to celebrate a friend's birthday. First, the user uses the communication application platform to obtain a list of friends and their birthday information. The user terminal then sends this information and message history to the server.

[1219] The server calculates a relationship score based on the frequency of messages, response time, and number of common groups with this friend, and then determines when to send a reminder seven days before the friend's birthday.

[1220] The server then uses the generative model to suggest suitable gifts for friends. It analyzes a friend's hobbies and preferences, suggesting the latest music albums to a music-loving friend, for example. The server also generates inspiring messages based on past messaging history. For example, it could generate a message along the lines of, "The concert we went to together last year was amazing. I hope this year will be another great one!"

[1221] Finally, this information is sent to the user's terminal, allowing the user to prepare a perfect birthday celebration for their friend. In this way, the present invention helps users remember important anniversaries and effectively strengthen their relationships.

[1222] The processing flow will be explained below.

[1223] Step 1:

[1224] The user terminal obtains the friend list, anniversary information, and message history through the communication application platform.

[1225] Step 2:

[1226] The user terminal encrypts the acquired friend list, anniversary information, and message history and transmits them to the server.

[1227] Step 3:

[1228] The server decrypts the received data and stores it in a secure database.

[1229] Step 4:

[1230] The server analyzes the stored data and calculates a relationship score between the user and each friend, based on metrics such as message frequency, response speed, and number of common groups.

[1231] Step 5:

[1232] The server uses the relationship score to determine when to remind you about each friend's birthday or anniversary, typically seven days before the anniversary or birthday.

[1233] Step 6:

[1234] The server schedules notifications based on reminder timing and saves the schedule information in a database.

[1235] Step 7:

[1236] The server uses the generative model to generate personalized gift suggestions for the user, based on the user's friends' hobbies, preferences, and past interactions.

[1237] Step 8:

[1238] The server generates a congratulatory message tailored to the user's friend based on their past message history, taking into account important past events and relationships.

[1239] Step 9:

[1240] The server compiles the generated reminders, gift suggestions, and congratulatory message texts and notifies them to the user terminal.

[1241] Step 10:

[1242] The user terminal displays the received notification to the user, allowing the user to remember and prepare for the celebration of a friend's birthday or anniversary.

[1243] Example 1

[1244] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1245] In today's society, people often forget the anniversaries and birthdays of friends and acquaintances due to their busy daily lives. This makes it difficult to maintain and deepen relationships, and can lead to weakened relationships. People often struggle to know the appropriate way to celebrate or the message they want to send. It is necessary to solve this problem and provide a way for users to easily celebrate anniversaries in a touching and effective way.

[1246] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1247] In this invention, the server includes a means for analyzing the received data and evaluating a relationship score with the user, a means for scheduling notifications based on reminder timing, a means for generating gift suggestions using a generative AI model, and a means for generating the text of a congratulatory message, thereby enabling users to remember anniversaries of their friends and acquaintances and to celebrate them in a timely and appropriate manner.

[1248] "User terminal" refers to an electronic device for obtaining and transmitting data to a server through a communication application platform.

[1249] A "communications application platform" is a software environment that allows users to send and receive messages and manage their friend lists.

[1250] A "friend list" is a list that includes information about acquaintances and friends with whom a user communicates.

[1251] "Anniversary information" is information about important dates such as birthdays and anniversaries of the user and their friends and acquaintances.

[1252] "Message history" is a record of messages sent and received in the past between a user and their friends and acquaintances.

[1253] A "server" is a central control device that analyzes and stores data received from user terminals and performs various processes based on that data.

[1254] The "relationship score" is a numerical value calculated based on the frequency of messages, response speed, number of common groups, etc., to evaluate the relationship between the user and a friend.

[1255] "Reminder timing" refers to the appropriate time to notify someone of an important date such as an anniversary or birthday.

[1256] "Scheduling a notification" means making and executing a plan to send a notification to a user at a specific time.

[1257] A "generative AI model" is an artificial intelligence model that generates new information or content based on given data.

[1258] "Gift Suggestions" are information generated using a generative AI model to suggest gifts for users to give to friends and acquaintances.

[1259] The "text of a congratulatory message" is a document containing congratulatory words that a user sends to friends and acquaintances.

[1260] MODE FOR CARRYING OUT THE INVENTION

[1261] This invention is an AI concierge system that helps users remember to celebrate the birthdays and anniversaries of their friends and acquaintances on a communication application platform.

[1262] First, the user device collects data through the communication application platform. This data includes friend lists, anniversary information, and message history. The user device then sends this data to the server. The data is transmitted over the Internet using the SSL / TLS protocol to ensure data security.

[1263] Next, the server stores the received data and begins analyzing it. The server saves the data in a database (e.g., MySQL or PostgreSQL) and uses data analysis tools such as Python or R to evaluate the relationship score between the user and their friends based on factors such as message frequency, response speed, and the number of common groups. Based on this relationship score, the server calculates the appropriate reminder timing. For example, it could set the reminder timing to be seven days before an anniversary or birthday.

[1264] Once the reminder timing is determined, the server uses a generative AI model (e.g., GPT-3) to suggest gifts. The server analyzes the friend's hobbies, preferences, and past interactions data and suggests gifts based on that. For example, a friend who likes music will be suggested the latest music album.

[1265] The server also uses the generative AI model to generate congratulatory messages, including appropriate messages that take into account relationships and shared anecdotes based on past messaging history. For example, it might generate a message along the lines of, "The concert we went to together last year was amazing! I hope this year will be even more amazing!"

[1266] The generated reminders, gift suggestions, and congratulatory messages are finally sent from the server to the user's device. The server uses a notification system (e.g., Firebase Cloud Messaging or Apple Push Notification Service) to send notifications to the user's device. The user receives the notifications and can prepare to celebrate their friend's anniversary without forgetting about it.

[1267] Specific examples

[1268] For example, consider a case where a user wants to celebrate the birthday of a friend who loves music. First, the user terminal uses the communication application platform to obtain a list of friends and their birthday information. Then, this information and message history are sent to the server.

[1269] The server then calculates a relationship score by analyzing the frequency of messages with this friend, response speed, and the number of common groups. It then determines when to send a reminder seven days before the friend's birthday. The server then uses the generative AI model to suggest gifts suitable for a music-loving friend. For example, it might suggest the latest music album.

[1270] Next, the server generates an inspiring message based on past message history, such as, "The concert we went to together last year was amazing. I hope this year will be a great one!"

[1271] The generated information is finally sent to the user's device, where the user can receive the notification and prepare a perfect birthday celebration for their friend. This system allows users to easily prepare for celebrations without forgetting important anniversaries.

[1272] Prompt Sentence Examples

[1273] For example, a prompt for the generative AI model might be, "A touching birthday message for a music-loving friend." The generated message might be, "The concert we went to together last year was amazing. I hope this year will be a great one!"

[1274] The above is the mode for carrying out the present invention.

[1275] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1276] Step 1:

[1277] The user terminal obtains the friend list, anniversary information, and message history through the communication application platform.

[1278] Specifically, the application automatically collects friend lists and anniversary information, extracts past message history, and stores the acquired data locally on the user's device.

[1279] Input: friend list, anniversary information, message history from a communication application platform

[1280] Output: Friends list, anniversary information, and message history stored on the user's device

[1281] Step 2:

[1282] The user terminal transmits the collected data to the server.

[1283] Specifically, the user terminal transmits data to the server via the Internet, using the SSL / TLS protocol to enhance data security.

[1284] Input: Friends list, anniversary information, and message history stored on the user's device

[1285] Output: Friends list, anniversary information, message history sent to the server

[1286] Step 3:

[1287] The server stores the received data in a database.

[1288] Specifically, the server securely stores data in a database such as MySQL or PostgreSQL.

[1289] Input: Friends list, anniversary information, message history sent to the server

[1290] Output: Friends list, anniversary information, message history stored in database

[1291] Step 4:

[1292] The server analyzes the stored data and evaluates the relationship score between the user and their friends.

[1293] Specifically, data analysis tools such as Python and R are used to analyze message frequency, response speed, and number of common groups, and calculate a relationship score.

[1294] Input: Friends list, anniversary information, message history stored in the database

[1295] Output: Calculated relationship score

[1296] Step 5:

[1297] The server calculates reminder timing for anniversaries and birthdays based on the relationship score.

[1298] Specifically, it sets priorities based on relationship scores and calculates timing, such as sending a reminder seven days before a birthday.

[1299] Input: Calculated relationship score, anniversary information

[1300] Output: Remind timing

[1301] Step 6:

[1302] The server uses the generative AI model to generate gift suggestions suited to the user.

[1303] Specifically, the system uses a generative AI model such as GPT-3 to generate gift suggestions based on prompts such as a friend's hobbies, preferences, and past interactions. For example, it might suggest the latest music albums to a friend who likes music.

[1304] Input: Friends' hobbies and preferences, past interactions

[1305] Output: Gift Suggestion

[1306] Step 7:

[1307] The server uses a generative AI model to generate the text of the congratulatory message.

[1308] Specifically, the AI ​​model is given a prompt to "generate a touching birthday message," and the generated message is customized based on past message history.

[1309] Input: Past message history, prompt text

[1310] Output: Congratulatory message text

[1311] Step 8:

[1312] The server notifies the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

[1313] Specifically, the generated information is sent to the user's device using a notification system (e.g., Firebase Cloud Messaging or Apple Push Notification Service).

[1314] Input: Reminder timing, gift suggestions, congratulatory message text

[1315] Output: Reminders, gift suggestions, and congratulatory messages sent to the user's device

[1316] By going through these processing steps, a system is constructed that allows users to celebrate the anniversaries of friends and acquaintances at an appropriate time.

[1317] (Application example 1)

[1318] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1319] Users need to be able to remember and appropriately celebrate the anniversaries and birthdays of their friends and family, and to be able to more personalized experiences in specific physical stores. However, with conventional systems, users must manually manage information and set reminders, and it takes a lot of time and effort to think of appropriate gifts and congratulatory messages. Another problem is that the in-store experience is not personalized, making it difficult to fully celebrate special anniversaries.

[1320] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1321] In this invention, the server includes: means for a user terminal to acquire a friend list, anniversary information, and message history through a communication application platform and transmit them to the server; means for the server to analyze the received data and evaluate a relationship score with the user; means for the server to calculate anniversary and birthday reminder timings based on the relationship score; means for the server to schedule notifications based on the reminder timings; means for the server to generate gift suggestions suitable for the user using a generative model; means for the server to generate congratulatory message texts based on past message history using the generative model; means for the user terminal to select a brick-and-mortar store to visit and set a reminder; means for the server to suggest gifts and celebratory services in the store; and means for the server to notify the user terminal of the generated reminders, gift suggestions, and congratulatory message texts. This allows users to automatically prepare to appropriately celebrate anniversaries and birthdays and personalize their in-store experiences.

[1322] A "user terminal" is a computer device that obtains data through a communication application platform and transmits it to a server.

[1323] A "communication application platform" is an online service that allows users to exchange information such as messages, images, and voice with other users.

[1324] A "friend list" is data that lists information about friends and acquaintances that a user has registered on the communication application platform.

[1325] "Anniversary information" is date information of birthdays and special anniversaries of friends and acquaintances.

[1326] "Message history" refers to a record of past messages exchanged by a user with friends and acquaintances through a communication application platform.

[1327] "Server" refers to a central system that receives, analyzes, stores, and provides various services from data sent from user terminals.

[1328] The "relationship score" is an index used by the server to evaluate the relationship between the user and a friend.

[1329] The "remind timing" is the optimum date and time to notify the user so that they do not forget anniversaries or birthdays.

[1330] A "generative model" is an algorithm that automatically generates appropriate gift suggestions and congratulatory message text from input data.

[1331] "Reminder" is a notification function that helps users not forget important appointments and events.

[1332] A "physical store" is a physical store space where users can purchase goods or receive services.

[1333] "Gift suggestions" are gift ideas that the server suggests to users using a generative model based on the hobbies and preferences of friends and acquaintances.

[1334] The "congratulatory message text" is a congratulatory text that the server generates using a generative model and referring to past message history.

[1335] "Notification" refers to information that the server sends to the user terminal, and includes reminders, gift suggestions, and congratulatory messages.

[1336] This invention provides a system that allows users to remember and appropriately celebrate specific anniversaries and birthdays, and to personalize their in-store experiences, by utilizing a user terminal, a server, a generative AI model, and a communication application platform.

[1337] First, the user device acquires the friend list, anniversary information, and message history through the communication application platform and sends this data to the server. The server analyzes the received data and evaluates the relationship score between the user and the friends.

[1338] Next, based on the relationship score, the server calculates the timing of reminders for anniversaries and birthdays. For example, it sets a reminder seven days before an anniversary or birthday. Furthermore, the user's device selects the physical store they plan to visit and sends that information to the server. This allows the server to suggest gift selection and celebration services at the store.

[1339] The server uses the generative model to generate gift suggestions suited to the user. This generative model makes appropriate suggestions based on the friend's hobbies, preferences, and past message history. The server also uses the generative model to create the text of the congratulatory message. This allows the user to send a touching and personalized message.

[1340] The generated reminders, gift suggestions, and congratulatory message texts are finally sent from the server to the user terminal, allowing the user to prepare to celebrate a special anniversary or birthday effectively.

[1341] Hardware and software used

[1342] User device: Smartphone

[1343] Server: Central server system

[1344] Communication Application Platform: Messaging App

[1345] Generative AI models: Natural language generation algorithms (e.g., GPT-3)

[1346] Specific examples

[1347] For example, consider a case where a user wants to celebrate a friend's birthday. The user obtains a friend list and their birthday information through a communication application platform. The user's device sends this information and message history to a server. The server analyzes the frequency of messages with this friend, response speed, and the number of common groups to calculate a relationship score. It then determines when to send a reminder seven days before the friend's birthday.

[1348] Examples of prompts include:

[1349] Friend's name: xxx

[1350] Date of Birth: 2023-12-25

[1351] Hobbies: Music, movies

[1352] Generate the following:

[1353] 1. Gift Suggestions (2 or more)

[1354] 2. Congratulatory Message

[1355] example:

[1356] 1. Suggestion 1: Latest Movie Trailer Tickets

[1357] Suggestion 2: A special music album

[1358] 2. Message: Happy birthday! Last year's music festival was amazing. I hope this year will be a great one too!

[1359] In this way, users can remember special anniversaries and efficiently prepare personalized responses.

[1360] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1361] Step 1:

[1362] The user terminal obtains the friend list, anniversary information, and message history through the communication application platform. Based on this, the data of the user's friends' birthdays and anniversaries is collected and sent to the server. The input is the friend list, anniversary information, and message history, and this is the data sent to the server.

[1363] Step 2:

[1364] The server analyzes the received friend list, anniversary information, and message history to evaluate the relationship score between the user and the friend. The server calculates the relationship score based on data such as message frequency, response speed, and number of common groups. The input is the acquired data, and the output is the relationship score. This quantifies the depth of the relationship with the friend.

[1365] Step 3:

[1366] The server calculates the timing of reminders for anniversaries and birthdays based on the relationship score. It sets appropriate reminder dates and times based on the relationship score. For example, a reminder for an important friend can be sent seven days before their birthday. The input is the relationship score, and the output is the reminder timing.

[1367] Step 4:

[1368] The user's device selects the physical store they plan to visit and sends that information to the server. By selecting the physical store information through the app, the user specifies which store they will use to prepare for the celebration. The input is the physical store information, and this is the data sent to the server.

[1369] Step 5:

[1370] The server proposes gifts and celebration services at the store based on the information about the physical store that the user plans to visit and the timing of the reminder.The server uses a generative AI model to generate gift suggestions based on the friend's hobbies and preferences.The input is the physical store information, the timing of the reminder, and the friend's hobbies and preferences, and the output is gift suggestions.

[1371] Step 6:

[1372] The server uses a generative AI model to generate a congratulatory message based on past message history. The server analyzes the message history and creates a message that takes into account relationships and common episodes. The input is the past message history, and the output is the congratulatory message text. This allows users to send moving messages.

[1373] Step 7:

[1374] The server notifies the user terminal of the generated reminder, gift suggestion, and congratulatory message text. The generated reminder information, suggestion, and message text are sent to the user terminal and notified to the user. The input is the generated reminder, gift suggestion, and congratulatory message text, and the output is the notification to the user terminal.

[1375] By following the steps above, the user can efficiently prepare for a celebration without forgetting an important anniversary.

[1376] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1377] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of friends and acquaintances on a communication application platform without forgetting them, and that recognizes the user's emotions and suggests the most appropriate gifts and messages.

[1378] First, the user device collects data through the communication application platform, including friend lists, anniversary information, message history, and emotion data for recognizing the user's emotions. The emotion engine recognizes emotions from the user's text messages, voice, and facial expressions, and sends the data to the server.

[1379] The server then stores all the received data in a secure database and begins analyzing it. The server evaluates the relationship score between the user and their friends based on message frequency, response speed, number of common groups, and the user's emotional data. This score is calculated by taking into account the depth of the emotional connection between the user and their friends.

[1380] Based on the analysis results, the server calculates the appropriate reminder timing, for example, setting a reminder time seven days before an anniversary or birthday.

[1381] Once the reminder timing is determined, the server uses the generative model to generate optimal gift suggestions for the user, taking into account the friend's hobbies and preferences and the user's recent emotional state.

[1382] Furthermore, the server generates the text of the congratulatory message. It generates an appropriate message based on the user's emotional data as well as past message history, taking into account relationships and common anecdotes. This allows users to easily create more emotional and relatable messages.

[1383] The generated reminders, gift suggestions, and congratulatory messages are finally sent from the server to the user's device. The user receives these notifications and can prepare for the celebration of their friends' and acquaintances' anniversaries.

[1384] Specific examples

[1385] For example, consider a case where a user wants to celebrate a friend's birthday. First, the user uses the communication application platform to obtain a list of friends and their birthday information. The emotion engine on the user's device recognizes the user's current emotional state from their messages and facial expressions, and transmits this information to the server.

[1386] The server calculates a relationship score based on message frequency, response speed, number of common groups, and emotional data, and then determines the timing of the reminder based on this relationship score and the friend's birthday information. The reminder is usually set seven days before the birthday.

[1387] The server then uses the generative model to suggest appropriate gifts, taking into account the emotional data and suggesting gifts that match recent conversations and emotions (e.g., a relaxing spa ticket if the user has been feeling stressed recently).

[1388] Furthermore, based on the emotional data and message history, a congratulatory message including an emotional episode is generated (e.g., "You've been busy lately, but please take your time and enjoy your birthday!").

[1389] Finally, this information is sent to the user's terminal, so that the user can receive the notification and prepare a perfect birthday celebration for their friend. In this way, the present invention helps users remember important anniversaries and celebrate them in a way that is in line with their feelings.

[1390] The processing flow will be explained below.

[1391] Step 1:

[1392] The user device obtains friend lists, anniversary information, and message history through the communication application platform, and the emotion engine on the user device recognizes and collects emotion data from the user's text messages, voice, and facial expressions.

[1393] Step 2:

[1394] The user terminal encrypts the acquired friend list, anniversary information, message history, and emotion data and transmits them securely to the server.

[1395] Step 3:

[1396] The server decrypts the received data and stores it in a secure database.

[1397] Step 4:

[1398] The server analyzes the stored data, including message frequency, response speed, number of common groups, and user sentiment data (e.g., fluctuations in positive / negative sentiment).

[1399] Step 5:

[1400] The server uses this data to calculate a relationship score between the user and their friends, taking into account their communication patterns and emotional depth.

[1401] Step 6:

[1402] The server determines the optimal reminder timing based on the calculated relationship score, usually seven days before a friend's birthday or anniversary.

[1403] Step 7:

[1404] The server schedules notifications based on reminder timing and saves the schedule information in a database.

[1405] Step 8:

[1406] The server uses the generative model to generate gift suggestions suited to the user, taking into account the user's emotional data and their friends' hobbies and preferences, and selecting the most suitable gift (e.g., relaxing items, hobby-related goods, etc.).

[1407] Step 9:

[1408] The server generates an emotional and relatable congratulatory message based on past message history and emotional data. The generated message includes content tailored to specific episodes and emotions.

[1409] Step 10:

[1410] The server notifies the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

[1411] Step 11:

[1412] The user terminal displays the received notification to the user, so that the user can remember to prepare for the celebration of the friend's birthday or anniversary. The user can purchase the suggested gift and send the generated message to the friend.

[1413] As such, an AI concierge system incorporating emotional data can help users prepare for more emotionally consistent celebrations.

[1414] Example 2

[1415] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1416] With conventional communication application platforms, users often forget the birthdays and anniversaries of their friends and acquaintances, and there is a lack of appropriate assistance when selecting congratulatory messages and gifts. This makes it easy for users to forget important dates, making it difficult to congratulate people emotionally. Furthermore, it is difficult to generate appropriate suggestions and messages that take the user's emotions into account, resulting in low user satisfaction.

[1417] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1418] In this invention, the server includes: means for a user terminal to acquire a friend list, anniversary information, message history, and emotion data through a communication application platform and transmit the acquired data to the server; means for the server to store the received data in a secure database and analyze the data based on message frequency, reaction speed, number of common groups, and emotion data; means for the server to evaluate a relationship score based on the data analysis results; means for the server to calculate reminder timing based on the relationship score and anniversary information; means for the server to schedule notifications based on the reminder timing; means for the server to generate gift suggestions suitable for the user using a generative AI model; means for the server to generate congratulatory message text based on past message history and emotion data using the generative AI model; and means for the server to notify the user terminal of the generated reminders, gift suggestions, and congratulatory message text. This allows users to remember anniversaries of their friends and acquaintances and select gifts and generate congratulatory messages that are in line with their emotions.

[1419] A "user terminal" is an electronic device that uses a communication application platform to collect friend lists, anniversary information, message history, and emotion data, and transmits them to a server.

[1420] A "communications application platform" is a collection of software and services that enables users to communicate with other users through text messages, voice, images, and video.

[1421] A "friends list" is a list of friends and acquaintances with whom a user is connected on his or her communication application platform.

[1422] "Anniversary information" is information about birthdays and other important anniversaries of the user's friends and acquaintances.

[1423] "Message history" is a record of past text messages sent and received between a user and their friends and acquaintances.

[1424] "Emotion data" is emotional data analyzed based on the user's text message, voice, facial expression, etc.

[1425] A "server" is a device or system that receives, analyzes, stores, and processes data sent from a user terminal.

[1426] A "secure database" is a database that protects data from unauthorized access from outside and stores data safely.

[1427] "Data analysis" is the process of analyzing numbers and trends based on collected data.

[1428] The "relationship score" is a number that indicates the depth of the relationship between a user and their friend, calculated based on their interactions, commonalities, and emotional data.

[1429] The "remind timing" is the optimum time and date for notifying the user of an anniversary or birthday.

[1430] A "generative AI model" is a model that uses artificial intelligence to generate and recommend text.

[1431] "Gift suggestions" are ideas and recommendations for the best gifts for the user's friends and acquaintances.

[1432] The "text of a congratulatory message" is the content of a message that a user sends to celebrate the anniversary or birthday of a friend or acquaintance.

[1433] "Notification" refers to information sent from the server to the user terminal, and may inform the user of reminders, gift suggestions, congratulatory messages, and the like.

[1434] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of their friends and acquaintances without forgetting them. It also aims to recognize the user's emotions and suggest the most suitable gifts and messages.

[1435] First, the user terminal collects the necessary data through the communication application platform, including:

[1436] Friends list (a list of friends and acquaintances the user is connected to)

[1437] Anniversary information (friends' birthdays and important anniversaries)

[1438] Message history (record of past text messages sent and received)

[1439] Emotional data (obtained from the user's text messages, voice, and facial expressions)

[1440] The user device collects this data and sends it to the server via a secure communication protocol (e.g., HTTPS). The emotion engine analyzes the user's messages and voice and generates emotion data.

[1441] The server then stores all the data it receives in a secure database and parses the data. The server parses the following elements:

[1442] Message frequency (frequency of communication between the user and their friends)

[1443] Response speed (how quickly messages are exchanged)

[1444] Number of common groups (number of common groups that the user and their friends are in)

[1445] Emotion data (data generated by the emotion engine)

[1446] Based on these analysis results, the server calculates a relationship score, which is a numerical representation of the depth of the feelings between the user and their friend. Based on this score, the server calculates the timing of reminders for anniversaries and birthdays. The reminder is usually set to occur seven days before the anniversary.

[1447] The server then uses the generative AI model to generate optimal gift suggestions for the user, which involves the following process:

[1448] Get the user's friends' hobbies and preferences from the database

[1449] Consider your recent emotional state

[1450] Enter a prompt into the generative AI model to generate gift suggestions

[1451] The server also generates congratulatory messages based on past message history and emotional data, allowing users to easily create emotional and relatable messages.

[1452] Finally, the generated reminders, gift suggestions, and congratulatory messages are sent from the server to the user's device, allowing the user to remember the anniversaries of their friends and acquaintances and prepare for their celebrations.

[1453] Specific examples

[1454] For example, if a user wants to remember to celebrate a friend's birthday, the user terminal first uses the communication application platform to obtain the friend list and the friend's birthday information, and the emotion engine recognizes the user's current emotional state from the user's message and facial expression, and then transmits this information to the server.

[1455] The server calculates a relationship score based on message frequency, response speed, number of common groups, and emotional data, and then determines the timing of the reminder based on this relationship score and the friend's birthday information. The reminder is usually set seven days before the birthday.

[1456] The server then uses the generative model to suggest appropriate gifts, such as "tickets to a relaxing spa if you've been feeling stressed lately."

[1457] Furthermore, the server generates a congratulatory message that includes an emotional episode based on the emotion data and message history, such as "You've been busy lately, but please take your time and enjoy your birthday!"

[1458] Finally, this information is sent to the user's terminal, allowing the user to prepare a perfect birthday celebration for their friend.

[1459] Prompt Sentence Examples

[1460] "Suggest the perfect gift and congratulatory message to celebrate a friend's birthday. Take recent conversations and sentiment data into account to make personalized suggestions."

[1461] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1462] Step 1: Data collection

[1463] The user device collects necessary data through the communication application platform, such as friend lists, anniversary information, message history, and emotional data. The emotional data is generated by analyzing the user's text messages, voice, and facial expressions using an emotion engine.

[1464] Input: The communication platform used by the user

[1465] Output: Friend list, anniversary information, message history, emotional data

[1466] Specific behavior:

[1467] The user opens the application

[1468] Data collection module syncs friends list

[1469] Get anniversary information

[1470] Retrieve message history from a local database

[1471] Emotion engine generates emotional data

[1472] Step 2: Send data

[1473] The user device sends the collected data to the server using a secure communication protocol (e.g., HTTPS).

[1474] Input: friend list, anniversary information, message history, emotional data

[1475] Output: Data received by the server

[1476] Specific behavior:

[1477] Convert collected data into JSON format

[1478] Send to server using HTTPS communication

[1479] Step 3: Data analysis

[1480] The server stores the received data in a secure database and performs data analysis, including message frequency, response speed, number of common groups, and sentiment data.

[1481] Input: Collected data (friend list, anniversary information, message history, emotional data)

[1482] Output: Analysis results (message frequency, reaction speed, number of common groups, evaluation of emotional data)

[1483] Specific behavior:

[1484] Save the received data to the database

[1485] Run data analysis algorithms to analyze each element

[1486] Step 4: Calculate the relationship score

[1487] The server calculates a relationship score based on the analysis results, which quantifies the depth of the feelings between the user and their friends.

[1488] Input: Analysis results (message frequency, reaction speed, number of common groups, evaluation of emotional data)

[1489] Output: Relationship score

[1490] Specific behavior:

[1491] Each element is weighted to calculate an overall relationship score

[1492] Step 5: Calculate the reminder timing

[1493] The server calculates the reminder timing based on the relationship score and anniversary information, usually set 7 days before the anniversary.

[1494] Input: Relationship score, anniversary information

[1495] Output: Remind timing

[1496] Specific behavior:

[1497] Get anniversary date

[1498] Calculate 7 days before the anniversary

[1499] Schedule reminders

[1500] Step 6: Generate gift suggestions

[1501] The server uses a generative AI model to generate optimal gift suggestions for the user, taking into account the user's friends' hobbies and preferences and the user's recent emotional state.

[1502] Input: Relationship score, emotional data, friends' hobbies and preferences

[1503] Output: Gift Suggestion

[1504] Specific behavior:

[1505] Enter a prompt into the generative AI model

[1506] Generate gift suggestions and match them with your preferences data

[1507] Step 7: Generate a congratulatory message

[1508] The server uses a generative AI model to generate the text of the congratulatory message, based on past message history and emotional data.

[1509] Input: Message history, emotion data

[1510] Output: Congratulatory message text

[1511] Specific behavior:

[1512] Analyze emotional data and message history

[1513] Enter a prompt into the generative AI model to generate a message

[1514] Step 8: Sending notifications

[1515] The server notifies the user terminal of the generated reminder, gift suggestion, and congratulatory message text.

[1516] Input: Reminder timing, gift suggestions, congratulatory message text

[1517] Output: Notification to user terminal

[1518] Specific behavior:

[1519] Build notification data

[1520] Send to user device using PUSH notification API

[1521] The notification appears on the user's device.

[1522] (Application example 2)

[1523] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1524] There is currently no technical means to help users remember to celebrate important anniversaries and birthdays in communication applications. Furthermore, current systems have difficulty properly analyzing a user's emotional state and suggesting personalized gifts and messages based on that analysis. Therefore, there is a need for a system that allows users to celebrate the anniversaries of friends and family in a way that is sensitive to their emotions.

[1525] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring a friend list, anniversary information, and message history including emotion data, means for analyzing the received data and evaluating a relationship score with the user, and means for calculating reminder timing for anniversaries and birthdays based on the relationship score and emotion data. This allows the user to remember important anniversaries and celebrate them with gifts and messages appropriate for the situation.

[1526] A "user terminal" is a device that obtains friend lists, anniversary information, message history, and emotion data through the communication application platform and transmits them to the server.

[1527] A "communications application platform" is a software environment that allows users to send and receive messages and manage their friend lists.

[1528] A "friends list" is a collection of data containing information about friends and acquaintances associated with a user.

[1529] "Anniversary information" is data indicating birthdays and other special date information relating to the user and their friends.

[1530] "Message history" is data that contains a record of messages that a user has sent and received in the past.

[1531] "Emotion data" refers to data that indicates the emotional state of a user as recognized from their text message, voice, facial expression, and the like.

[1532] A "server" is a central processing unit that receives and analyzes data sent from a user terminal, generates appropriate results, and returns them to the user terminal.

[1533] The "relationship score" is numerical data calculated by the server to evaluate the depth of the relationship between the user and his / her friends.

[1534] "Reminder timing" refers to the time and date settings that are calculated to appropriately remind you about a particular anniversary or birthday.

[1535] A "generative model" is a machine learning model used by the server to generate gift suggestions and message texts that are suitable for the user.

[1536] "Gift suggestions" are information that the server recommends to the user the best gift for a particular anniversary.

[1537] The "congratulatory message text" is the content of a message that the server creates using a generative model and that the user sends to friends and acquaintances.

[1538] "Notifications" are alerts or messages sent by the server to a user's device to remind them of a particular anniversary or birthday.

[1539] This invention relates to an AI concierge system that helps users celebrate the birthdays and anniversaries of friends and acquaintances on a communication application platform without forgetting them, and that recognizes the user's emotions and suggests the most appropriate gifts and messages.

[1540] System Overview

[1541] The user terminal collects friend lists, anniversary information, message history, and emotion data through the communication application platform and transmits the collected data to the server, which analyzes the received data and evaluates the relationship score with the user.

[1542] User terminal hardware and software

[1543] Mobile devices such as smartphones and tablets

[1544] Emotion recognition API (e.g. Emotion AI API)

[1545] Communication Application Platform

[1546] Server hardware and software

[1547] A secure database (e.g., a SQL database)

[1548] Data Analysis Engine

[1549] Generative models using machine learning models

[1550] Data collection and analysis flow

[1551] 1. Data Collection:

[1552] The user's device collects friend lists, anniversary information, message history, and emotional data through the communication application platform and sends this data to the server. Emotional data is obtained from text messages, voice, facial expressions, etc. and analyzed using the Emotion AI API.

[1553] 2. Data Analysis:

[1554] The server stores the received data in a secure database and begins analysis. It calculates a relationship score with the user based on message frequency, response speed, number of common groups, and emotional data. The emotional engine analyzes the text messages and recognizes the user's current emotional state.

[1555] 3. Decide on the timing of the reminder:

[1556] The server calculates the timing of anniversary and birthday reminders based on the relationship score, typically set to seven days before a particular anniversary or birthday.

[1557] 4. Generate gift and message suggestions:

[1558] The server uses the generative model to generate optimal gift suggestions for the user. The gift suggestions are selected based on the user's emotional state and recent conversations. The server also generates congratulatory message text based on past message history and emotional data.

[1559] 5. Sending notifications:

[1560] The generated reminder, gift suggestion, and congratulatory message text are notified to the user terminal from the server.

[1561] Specific examples

[1562] For example, consider a case where a user wants to celebrate a friend's birthday. The user uses a communication application platform to obtain a friend list and their birthday information. The emotion engine recognizes the user's current emotional state from their messages and facial expressions and sends this information to the server. The server calculates a relationship score based on message frequency, reaction speed, number of common groups, and emotion data. The timing of the reminder is determined based on this relationship score and the friend's birthday information. A reminder is typically set seven days before the birthday. The server then uses a generative model to suggest an appropriate gift. Taking into account the emotion data, the server suggests a gift that matches the user's recent conversations and emotions (e.g., if the user has been feeling stressed recently, a relaxing spa ticket would be suggested). Furthermore, based on the emotion data and message history, a congratulatory message is generated that includes an emotional episode (e.g., "You've been busy lately, but please take some time to enjoy your birthday!"). This information is finally sent to the user's device.

[1563] Prompt Sentence Examples

[1564] User message: "I've been busy and tired lately, but I want to remember to celebrate your birthday."

[1565] The system will suggest reminders and gifts based on the following information:

[1566] User ID: 12345

[1567] Friend ID: friend1

[1568] Friend's Birthday: 2023-10-20

[1569] Relationship score: 85

[1570] Current Emotion: Stress

[1571] Reminder date: 2023-10-13

[1572] Suggested gift: Spa tickets

[1573] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1574] Step 1:

[1575] The user terminal collects friend lists, anniversary information, message history, and emotion data from the communication application platform and sends them to the server. This input data includes the user's friend list, anniversary information associated with each friend, a record of past messages, and the user's emotion analysis results. The server receives this data and stores it in a secure database.

[1576] Step 2:

[1577] The server analyzes the received data and evaluates the relationship score with the user. The server calculates the relationship score with the user based on message frequency, reaction speed, number of common groups, and emotional data. This relationship score quantifies the depth of the relationship between the user and their friends. The server uses multiple algorithms based on the input data to calculate and output the final score.

[1578] Step 3:

[1579] The server calculates the timing of reminders for anniversaries and birthdays based on the relationship score and emotion data. The server receives information about anniversaries and birthdays as input data and typically sets the reminder timing seven days before a specific date. The server outputs the reminder date based on this calculation.

[1580] Step 4:

[1581] The server uses the generative model to generate suitable gift suggestions for the user. The input data includes the user's emotional state and recent message history, which the generative model analyzes to select the most suitable gift. The output gift suggestion is an appropriate gift item (e.g., a spa ticket if the user is stressed).

[1582] Step 5:

[1583] The server uses the generative model to generate a congratulatory message based on past message history and emotion data. The server uses past messages and emotion data as input data, and generates a congratulatory message including an emotional episode based on this. The server outputs the generated message text.

[1584] Step 6:

[1585] The server notifies the user terminal of the generated reminder, gift suggestions, and congratulatory message. In this notification process, the server sends the reminder date, suggested gifts, and congratulatory message to the user terminal and notifies them. The user terminal receives them and displays them to the user.

[1586] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1587] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1588] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1589] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1590] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1591] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1592] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1593] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1594] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1595] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1596] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1597] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1598] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1599] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1600] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1601] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1602] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1603] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1604] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1605] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1606] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1607] The following is further disclosed regarding the above embodiment.

[1608] (Claim 1)

[1609] A means for a user terminal to acquire a friend list, anniversary information, and message history through a communication application platform and transmit them to a server;

[1610] A means for the server to analyze the received data and evaluate a relationship score with the user;

[1611] A means for the server to calculate the timing of reminders for anniversaries and birthdays based on the relationship score;

[1612] a means for the server to schedule notifications based on reminder timing;

[1613] A means for the server to generate a gift suggestion suitable for the user using the generative model;

[1614] A means for the server to generate a congratulatory message based on a past message history using a generative model;

[1615] The system includes a means for the server to notify the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

[1616] (Claim 2)

[1617] 10. The system of claim 1, wherein the server analyzes past interactions with the user and calculates a relationship score.

[1618] (Claim 3)

[1619] 2. The system of claim 1, wherein the server uses a generative model to generate a congratulatory message suitable for the user.

[1620] "Example 1"

[1621] (Claim 1)

[1622] A means for a user terminal to acquire a friend list, anniversary information, and message history through a communication application platform and transmit them to a server;

[1623] A means for the server to analyze the received data and evaluate a relationship score with the user;

[1624] A means for the server to calculate the timing of reminders for anniversaries and birthdays based on the relationship score;

[1625] a means for the server to schedule notifications based on reminder timing;

[1626] A means for the server to generate a gift proposal suitable for the user using a generative AI model;

[1627] A means for the server to generate a congratulatory message based on a past message history using a generation AI model;

[1628] The system includes a means for the server to notify the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

[1629] (Claim 2)

[1630] 10. The system of claim 1, wherein the server analyzes past interactions with the user and calculates a relationship score.

[1631] (Claim 3)

[1632] The system of claim 1, wherein the server uses a generative AI model to generate a congratulatory message suitable for the user.

[1633] "Application Example 1"

[1634] (Claim 1)

[1635] A means for a user terminal to acquire a friend list, anniversary information, and message history through a communication application platform and transmit them to a server;

[1636] A means for the server to analyze the received data and evaluate a relationship score with the user;

[1637] A means for the server to calculate the timing of reminders for anniversaries and birthdays based on the relationship score;

[1638] a means for the server to schedule notifications based on reminder timing;

[1639] A means for the server to generate a gift suggestion suitable for the user using the generative model;

[1640] A means for the server to generate a congratulatory message based on a past message history using a generative model;

[1641] A means for the user terminal to select a physical store to visit and set a reminder;

[1642] A means for the server to propose gifts and celebration services in the store;

[1643] The system includes a means for the server to notify the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

[1644] (Claim 2)

[1645] 10. The system of claim 1, wherein the server analyzes past interactions with the user and calculates a relationship score.

[1646] (Claim 3)

[1647] 2. The system of claim 1, wherein the server uses a generative model to generate a congratulatory message suitable for the user.

[1648] "Example 2: Combining Emotion Engines"

[1649] (Claim 1)

[1650] A means for a user terminal to acquire a friend list, anniversary information, message history, and emotion data through a communication application platform and transmit the acquired data to a server;

[1651] The server stores the received data in a secure database and performs data analysis based on message frequency, response speed, number of common groups, and emotion data;

[1652] A means for the server to evaluate a relationship score based on the data analysis result;

[1653] A means for a server to calculate a reminder timing based on the relationship score and anniversary information;

[1654] a means for the server to schedule notifications based on reminder timing;

[1655] A means for the server to generate a gift proposal suitable for the user using a generative AI model;

[1656] A means for the server to generate a congratulatory message based on past message history and emotion data using a generative AI model;

[1657] The system includes a means for the server to notify the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

[1658] (Claim 2)

[1659] The system of claim 1, wherein the server analyzes past interactions with the user and emotional data to calculate a relationship score.

[1660] (Claim 3)

[1661] The system of claim 1, wherein the server uses a generative AI model to generate a congratulatory message appropriate for the user based on past message history and emotional data.

[1662] "Application example 2 when combining emotion engines"

[1663] New Claims:

[1664] (Claim 1)

[1665] A means for a user terminal to acquire a friend list, anniversary information, message history, and emotion data through a communication application platform and transmit the acquired friend list, anniversary information, message history, and emotion data to a server;

[1666] A means for the server to analyze the received data and evaluate a relationship score with the user;

[1667] A means for the server to calculate the timing of reminders for anniversaries and birthdays based on the relationship score;

[1668] a means for the server to schedule notifications based on reminder timing;

[1669] A means for the server to generate a gift suggestion suitable for the user using the generative model;

[1670] A means for the server to generate a congratulatory message based on past message history and emotion data using a generative model;

[1671] A means for the server to notify the generated reminder, gift suggestion, and congratulatory message text to the user terminal;

[1672] A means for the server to dynamically update the relationship score based on the user's emotion data;

[1673] The system includes a means for the server to update the type of gift based on the user's emotion data.

[1674] (Claim 2)

[1675] 2. The system of claim 1, wherein the server analyzes past interactions and emotional data with the user to calculate a relationship score.

[1676] (Claim 3)

[1677] 2. The system of claim 1, wherein the server uses a generative model to generate a congratulatory message suitable for the user. [Explanation of symbols]

[1678] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for a user terminal to acquire a friend list, anniversary information, and message history through a communication application platform and transmit them to a server; A means for the server to analyze the received data and evaluate a relationship score with the user; A means for the server to calculate the timing of reminders for anniversaries and birthdays based on the relationship score; a means for the server to schedule notifications based on reminder timing; A means for the server to generate a gift suggestion suitable for the user using the generative model; A means for the server to generate a congratulatory message based on a past message history using a generative model; The system includes a means for the server to notify the generated reminder, gift suggestion, and congratulatory message text to the user terminal.

2. The system of claim 1 , wherein the server analyzes past interactions with the user and calculates a relationship score.

3. The system of claim 1 , wherein the server uses the generative model to generate a congratulatory message suitable for the user.

Images