System

Abstract

A system is provided.SOLUTION: A system comprising: means for registering basic information of a user; means for collecting daily message content and stamp use information of the user; means for analyzing collected data and estimating a relationship between the user and each partner; means for generating a reminder notification based on a time schedule and transmitting the reminder notification; means for generating a gift proposal based on a past gift history or a partner's preference; means for presenting a proposal list to the user; means for receiving a consultation about a gift content from the user and generating a response; means for receiving a reservation request from the user and reserving a service; and means for collecting feedback after using the gift or the service.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] People often forget the birthdays and anniversaries of their friends and family, and often struggle to decide what to give them as gifts. This is one of the reasons why connections between people are weakened. The purpose of this invention is to solve these problems and help users of messaging apps to remember to celebrate important dates and choose gifts that will please their recipients. [Means for solving the problem]

[0005] The system includes a means for registering basic user information, collecting daily message content and stamp usage information, and analyzing the collected data to estimate the relationship between the user and each recipient. It also includes a means for generating and sending reminder notifications based on a time schedule, a means for generating gift suggestions based on past gift-giving history and the recipient's preferences, a means for presenting a list of suggestions to the user, a means for accepting inquiries from the user about gift ideas and generating responses, a means for accepting user reservation requests and booking services, and a means for collecting feedback after gifts and service use, allowing users to easily and effectively prepare for celebrations. It also includes a means for accumulating user data and using it to improve the accuracy of next suggestions, and a means for providing physical gifts, travel plans, and restaurant reservations in collaboration with group company services, enabling suggestions to meet a variety of needs.

[0006] "User" refers to an individual or corporation that uses a messaging app.

[0007] "Basic information" refers to information such as a user's name, birthday, and contact list.

[0008] "Message Content" refers to information such as text, images, audio, and video that a User sends and receives through the App.

[0009] "Stamp usage information" refers to information about the types and frequency of stamps used by users within messaging apps.

[0010] "Means of collection" refers to systems and programs for acquiring and storing message and stamp usage information as data.

[0011] "Means for analysis" refers to algorithms and processing programs that analyze collected data and model user relationships and preferences.

[0012] "Means for estimation" refers to a method for calculating the relationship between a user and another party based on the analysis results.

[0013] "Reminder" refers to a notification message that informs a user about the date of a particular appointment or event.

[0014] "Means for generating" refers to a program for automatically generating reminder notifications and gift ideas.

[0015] "Means for sending" refers to a communication system for sending the generated notifications and suggestions to the user's terminal.

[0016] "Gift history" refers to a record of gifts sent by a user in the past.

[0017] "Gift suggestion" refers to a specific gift suggestion that the user can choose from.

[0018] "Suggestion list" refers to an interface for presenting gift suggestions to the user in a list format.

[0019] "Means for accepting consultations" refers to a system for receiving inquiries and consultation contents from users and generating answers accordingly.

[0020] "Means for generating a response" refers to an algorithm or program that automatically creates an appropriate response to the user's inquiry.

[0021] "Means for making reservations" refers to a system for completing the reservation procedure for a service or product based on the user's wishes.

[0022] "Feedback" refers to evaluation information and opinions provided by users after receiving a gift or using a service.

[0023] "Group Companies" refers to a group of companies that jointly provide services.

[0024] A "material gift" refers to a present that can be sent as a tangible item.

[0025] "Travel Plan" refers to a service that proposes travel plans and arrangements.

[0026] "Restaurant Reservation" refers to a service that processes reservations for restaurants. [Brief explanation of the drawings]

[0027] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0028] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0029] First, the terms used in the following description will be explained.

[0030] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0031] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0032] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0033] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0034] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0035] [First embodiment]

[0036] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0037] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0038] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0039] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0040] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0041] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0042] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0043] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0044] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0045] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0046] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0047] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0048] This invention relates to an AI concierge system that runs on a messaging app, reminding users of important dates and suggesting appropriate gifts and services. An embodiment of this system will be described.

[0049] User registration and initial settings

[0050] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[0051] Data collection and analysis

[0052] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to a server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses an AI model to analyze this data and estimate the preferences of the user's friends and family.

[0053] Reminder execution

[0054] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[0055] Gift suggestions

[0056] Based on the user's past gift-giving history and the recipient's estimated preferences, the server generates gift suggestions for the user. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the terminal, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[0057] Consultation about gift contents

[0058] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry, generates an appropriate response, and sends it to the device. The device then displays the response to the user, allowing them to obtain the information they need.

[0059] Reservation procedure

[0060] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service collaboration with group companies. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[0061] Feedback and Improvements

[0062] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback can be used to improve the accuracy of future suggestions.

[0063] This system allows users to smoothly prepare for celebrations without forgetting important dates, and also supports users in choosing a gift that will please them by providing a variety of gift ideas and service suggestions tailored to their needs.

[0064] The processing flow will be explained below.

[0065] Step 1:

[0066] The user presses a button within the messaging app to launch the AI ​​concierge service.

[0067] Step 2:

[0068] The device displays an interface for entering basic user information (such as name, birthday, contact list, etc.).

[0069] Step 3:

[0070] The user enters the required information and presses the send button.

[0071] Step 4:

[0072] The terminal transmits the input information to the server.

[0073] Step 5:

[0074] The server stores the received user basic information in a database.

[0075] Step 6:

[0076] The device will notify the user that the initial setup is complete and the AI ​​concierge is available.

[0077] Step 7:

[0078] The terminal records the user's daily message contents and stamp usage information.

[0079] Step 8:

[0080] The device periodically uploads the recorded data to the server.

[0081] Step 9:

[0082] The server analyzes the collected message and stamp data and scores the user's relationship with each contact.

[0083] Step 10:

[0084] The server uses an AI model to estimate the preferences of the user's friends and family based on relationship scores.

[0085] Step 11:

[0086] The server checks the birthdays and anniversaries of the user's friends and family based on a time schedule.

[0087] Step 12:

[0088] The server generates a reminder notification before the event.

[0089] Step 13:

[0090] The terminal receives the reminder notification from the server and displays it to the user.

[0091] Step 14:

[0092] The user checks the reminder notification and considers the necessary action.

[0093] Step 15:

[0094] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[0095] Step 16:

[0096] The server creates a list of the generated gift ideas and transmits it to the terminal.

[0097] Step 17:

[0098] The terminal displays the suggestion list to the user.

[0099] Step 18:

[0100] The user reviews the list of suggestions and selects the gift ideas that interest them.

[0101] Step 19:

[0102] The user consults with an AI concierge through a chat interface about the gift contents.

[0103] Step 20:

[0104] The device sends the user's questions or requests to the server.

[0105] Step 21:

[0106] The server analyzes the user's inquiry and generates an appropriate response.

[0107] Step 22:

[0108] The terminal displays the response from the server to the user.

[0109] Step 23:

[0110] The user wishes to reserve a suggested gift or service.

[0111] Step 24:

[0112] The terminal transmits the user's reservation request to the server.

[0113] Step 25:

[0114] The server executes the reservation procedure through service collaboration between group companies.

[0115] Step 26:

[0116] The server sends a reservation confirmation to the terminal.

[0117] Step 27:

[0118] The terminal displays a reservation completion notice from the server to the user.

[0119] Step 28:

[0120] Users provide feedback after receiving gifts or using services.

[0121] Step 29:

[0122] The terminal sends the user's feedback to the server.

[0123] Step 30:

[0124] The server stores the feedback in a database to help improve the accuracy of future suggestions.

[0125] Example 1

[0126] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0127] It is difficult for users to select appropriate gifts and services and provide them in a timely manner without worrying about forgetting important dates. It is also difficult for users to accurately understand the preferences of their friends and family and choose gifts that will please them. In addition, there are problems such as the time and effort required for reservation procedures and feedback management.

[0128] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0129] In this invention, the server includes means for registering the user's personal information, means for collecting the user's daily communication content and stamp usage information, means for analyzing the collected data and evaluating the relationship between the user and each recipient, means for generating and sending reminder notifications based on a schedule, means for generating gift ideas based on past gift-giving history and the recipient's preferences, means for presenting a list of suggestions to the user, means for accepting inquiries about gift ideas from the user and generating responses, means for accepting user reservation requests and reserving services, and means for collecting feedback after gifts and service use. This allows users to remember important dates and provide gifts and services that will please their recipients. Furthermore, reservations and feedback can be managed efficiently.

[0130] The "means for registering user's personal information" is a function for inputting and saving personal information such as the user's name, birthday, contact list, etc.

[0131] The "means for collecting information on the user's daily communication content and stamp usage" is a function for automatically capturing and recording the messages sent by the user and the stamp usage history.

[0132] The "means for analyzing collected data and evaluating the relationship between the user and each party" refers to an algorithm for quantifying and evaluating the relationship between the user and other people based on collected communication and stamp information.

[0133] The "means for generating and sending reminder notifications based on a schedule" is a function for generating and sending reminders for important dates to the user.

[0134] The "means for generating gift suggestions based on past gift history and the recipient's preferences" is an algorithm for creating optimal gift suggestions based on past gift data and the recipient's preferences.

[0135] The "means for presenting a proposal list to a user" is a function for displaying the generated gift proposal list on the user's screen.

[0136] The "means for accepting inquiries from users regarding gift contents and generating a response" is a function for generating and replying to an inquiry from a user regarding a specific gift.

[0137] The "means for accepting a user's reservation request and reserving a service" is a function for executing the reservation procedure for a gift or service selected by the user.

[0138] The "means for collecting feedback after using a gift or service" is a function for users to input and collect their impressions and evaluations after using a gift or service.

[0139] This invention relates to an AI concierge system that runs on a messaging app, reminding users of important dates and suggesting appropriate gifts and services. Specific embodiments of this system are described below.

[0140] User registration and initial settings

[0141] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[0142] Data collection and analysis

[0143] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to a server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses an AI model to analyze this data and estimate the preferences of the user's friends and family.

[0144] Reminder execution

[0145] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[0146] Gift suggestions

[0147] Based on the user's past gift-giving history and the recipient's estimated preferences, the server generates gift suggestions for the user. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the terminal, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[0148] Consultation about gift contents

[0149] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry, generates an appropriate response, and sends it to the device. The device then displays the response to the user, allowing them to obtain the information they need.

[0150] Reservation procedure

[0151] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service integration with an external company. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[0152] Feedback and Improvements

[0153] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback can be used to improve the accuracy of future suggestions.

[0154] Specific examples of hardware and software to be used

[0155] The server uses Python scripts to store data in database systems such as MySQL, and TensorFlow and PyTorch are used to build AI models. The terminal communicates via the HTTPS protocol, and the user interface is constructed using JavaScript and HTML.

[0156] Examples of specific examples and prompts

[0157] The user starts the AI ​​concierge service.

[0158] Example: A user opens a messaging app, enters basic information to use an AI concierge service, and submits.

[0159] Example prompt: "The user wants to choose a gift for a friend's birthday. Generate a list of gift suggestions and display them to the user."

[0160] With the above configuration, this invention is a system that enables users to efficiently select a gift that will please the recipient, make a reservation, and even provide feedback afterwards, without forgetting important dates.

[0161] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0162] Step 1:

[0163] The user starts the service

[0164] A user launches an existing messaging app and clicks the AI ​​concierge service button, which prompts the device to display the basic information entry screen.

[0165] Input: Click on AI Concierge Service button

[0166] Output: Display of basic information input screen

[0167] Step 2:

[0168] The device displays a screen for entering basic information.

[0169] The device displays a form prompting the user for their name, birthdate, and contact list, including text boxes and drop-down menus.

[0170] Input: A template for the basic information input screen provided by the server

[0171] Output: The basic information input screen is displayed in the user interface.

[0172] Step 3:

[0173] The user enters information and submits it.

[0174] The user enters the necessary information and presses the send button, which gives the terminal an input to "send the entered information."

[0175] Input: Basic information entered by the user (name, date of birth, contact list)

[0176] Output: The entered information is sent to the terminal

[0177] Step 4:

[0178] The device sends the information to the server

[0179] The device sends the information entered by the user to the server, where the data is transmitted securely using the HTTPS protocol.

[0180] Input: Basic information submitted by the user

[0181] Output: Information sent to the server

[0182] Step 5:

[0183] The server stores the information in a database

[0184] The server saves the received user information in a database, such as MySQL.

[0185] Input: Basic user information sent from the device

[0186] Output: Information is saved in a database

[0187] Step 6:

[0188] The server notifies you that the initial setup is complete.

[0189] The server notifies the terminal that the initial settings are complete, and generates a response message and sends it to the terminal.

[0190] Input: User information stored in the database

[0191] Output: Initialization completion notification is sent to the terminal

[0192] Step 7:

[0193] The device notifies you that the service is available

[0194] The device will inform the user that the service is available and will display a pop-up message saying "Initial setup completed."

[0195] Input: Initial setup completion notification from the server

[0196] Output: Service availability notification displayed in the user interface

[0197] Step 8:

[0198] The device records message and stamp usage information.

[0199] The device automatically records the user's daily message and stamp usage information, which is periodically sent to the server.

[0200] Input: User communication content and stamp usage information

[0201] Output: Usage information recorded on the device

[0202] Step 9:

[0203] The device uploads data to the server

[0204] The device sends the recorded data to the server at regular intervals. The data is transmitted securely using the HTTPS protocol.

[0205] Input: Usage information recorded on the device

[0206] Output: Data uploaded to the server

[0207] Step 10:

[0208] The server scores the data

[0209] The server scores messages based on message counts, stamp usage frequency, and shared event information. It uses Python scripts for data analysis and scoring.

[0210] Input: Uploaded message and stamp data

[0211] Output: Relationship score between the user and each contact

[0212] Step 11:

[0213] The server analyzes the data using an AI model

[0214] The server uses AI models to estimate the preferences of the user's friends and family, using frameworks such as TensorFlow and PyTorch.

[0215] Input: Relationship data between the user and each contact

[0216] Output: Estimated preferences of the user's friends and family

[0217] Step 12:

[0218] The server generates a reminder notification

[0219] The server generates reminder notifications based on a pre-defined time schedule, and creates reminders using notification message templates.

[0220] Input: Time schedule and important dates retrieved from database

[0221] Output: The generated reminder notification

[0222] Step 13:

[0223] The server sends a reminder notification to the device.

[0224] The server sends the generated reminder notification to the device via the HTTPS protocol.

[0225] Input: The generated reminder notification

[0226] Output: Reminder notification sent to device

[0227] Step 14:

[0228] The device displays a reminder notification

[0229] The device will display reminder notifications to the user, either via the notification center or as a pop-up message.

[0230] Input: Reminder notification sent from the server

[0231] Output: Reminder notification displayed in the user interface

[0232] Step 15:

[0233] The server generates gift ideas

[0234] The server generates gift suggestions based on the user's past gift history and the preferences of their friends and family. It uses a generative AI model to select and generate gift candidates.

[0235] Input: Gift history and preference data from a database

[0236] Output: Generated gift ideas

[0237] Step 16:

[0238] The server sends gift ideas to the device

[0239] The server sends the generated gift ideas to the device in JSON format.

[0240] Input: Generated gift idea

[0241] Output: Gift idea sent to device

[0242] Step 17:

[0243] The device displays gift ideas

[0244] The terminal displays the gift suggestions to the user. A list of gift suggestions is displayed on the user interface.

[0245] Input: Gift offer sent from server

[0246] Output: Gift ideas displayed in a user interface

[0247] Step 18:

[0248] The user checks and selects gift ideas

[0249] The user checks the displayed gift ideas and selects one that they are interested in. The next step is then performed based on the selected idea.

[0250] Input: List of suggested gift ideas

[0251] Output: Selected gift ideas

[0252] Step 19:

[0253] The user asks for a gift consultation

[0254] Users can discuss gifts through a chat interface, where they can type and submit questions about a particular gift.

[0255] Enter: Giveaway Question

[0256] Output: The consultation details are displayed on the terminal.

[0257] Step 20:

[0258] The device sends the consultation details to the server

[0259] The terminal sends the user's consultation details to the server as text data.

[0260] Input: User's inquiry

[0261] Output: Consultation details sent to the server

[0262] Step 21:

[0263] The server analyzes the consultation content

[0264] The server analyzes the received consultation content using natural language processing (NLP) technology.

[0265] Input: Consultation details sent by the user

[0266] Output: Parsed consultation content

[0267] Step 22:

[0268] The server generates an appropriate response

[0269] Based on the analysis results, the server generates an appropriate response to the user's inquiry.

[0270] Input: Parsed consultation content

[0271] Output: The generated response

[0272] Step 23:

[0273] The server sends the response to the device

[0274] The server generates a response and sends it to the terminal. The response is sent in text format.

[0275] Input: The generated response

[0276] Output: Response sent to the terminal

[0277] Step 24:

[0278] The terminal displays the response

[0279] The terminal displays the response to the user. The response message is displayed in the chat box.

[0280] Input: The response sent by the server

[0281] Output: The response displayed in the user interface

[0282] Step 25:

[0283] The user wishes to make a reservation

[0284] A user wishes to reserve a gift or service. The user selects the option they wish to reserve and presses the reservation button.

[0285] Input: User's reservation request

[0286] Output: Reservation request data is sent to the terminal

[0287] Step 26:

[0288] The device sends a reservation request to the server

[0289] The terminal sends the reservation request data to the server, which is then used by the reservation management system.

[0290] Input: User's reservation request data

[0291] Output: Reservation request data sent to the server

[0292] Step 27:

[0293] The server executes the reservation procedure.

[0294] The server executes the relevant reservation procedures and manages reservations using the service API of an external company.

[0295] Input: Reservation request data sent from the terminal

[0296] Output: Reservation procedure performed

[0297] Step 28:

[0298] The server sends the reservation confirmation information

[0299] After the reservation is completed, the server sends confirmation information to the terminal. The confirmation information is sent in JSON format.

[0300] Input: Booking procedure completion data

[0301] Output: Booking confirmation sent to the device

[0302] Step 29:

[0303] The device displays confirmation information

[0304] The terminal displays the reservation confirmation information to the user. The user interface displays a reservation completion message.

[0305] Input: Reservation confirmation information sent from the server

[0306] Output: Booking confirmation information displayed in the user interface

[0307] Step 30:

[0308] Users provide feedback

[0309] After using the gift or service, the user provides feedback by filling out the evaluation form and pressing the submit button.

[0310] Input: User feedback

[0311] Output: Feedback is sent to the device

[0312] Step 31:

[0313] The device sends feedback to the server

[0314] The terminal transmits the feedback information to the server, and the transmitted data is used in the feedback management system.

[0315] Input: User feedback

[0316] Output: Feedback data sent to the server

[0317] Step 32:

[0318] The server stores the feedback in a database

[0319] The server stores the feedback information in a database, which is used to improve the accuracy of the next proposal.

[0320] Input: Feedback data sent from the device

[0321] Output: Feedback stored in a database

[0322] Step 33:

[0323] The server improves based on feedback

[0324] The server will use the collected feedback to improve its next suggestion, feeding the feedback data into the AI ​​model to improve prediction accuracy.

[0325] Input: Feedback stored in the database

[0326] Output: An improved AI model reflected in the next proposal

[0327] These steps allow the entire system to remember important dates, provide appropriate gifts and services, and efficiently manage booking procedures and feedback.

[0328] (Application example 1)

[0329] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0330] Conventional AI concierge systems that run on messaging apps suggest gifts and services for friends and family based on the user's basic information, but the suggestions are limited, making it difficult to meet the diverse needs of users.In addition, when users make purchases in physical stores, they are unable to make timely suggestions about the most suitable products and services, which results in an inefficient purchasing experience.

[0331] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0332] In this invention, the server includes means for registering basic information about the user, means for collecting the user's daily message content and stamp usage information, means for analyzing the collected data and estimating the relationship between the user and each recipient, means for generating and sending reminder notifications based on a time schedule, means for generating gift ideas based on past gift-giving history and the recipient's preferences, means for presenting a list of ideas to the user, means for accepting inquiries about gift ideas from the user and generating responses, means for accepting user reservation requests and reserving services, means for collecting feedback after gifts and service usage, and means for collecting user behavior data in physical stores and making product suggestions in real time. This enables suggestions to be made according to the user's diverse needs, and also enables timely suggestions of optimal products and services in physical stores, thereby improving the purchasing experience.

[0333] 1. "Means for registering basic user information" refers to the means for sending personal information entered by the user into the application, such as name, birthday, and product categories of interest, to a cloud server and storing it in a database.

[0334] 2. "Means for collecting daily message content and stamp usage information of users" refers to the means for recording messages sent and received by users through messaging apps and stamp usage and sending this information to a server.

[0335] 3. "Means of analyzing collected data and estimating the relationship between the user and each person" refers to a means of using an AI model to score the degree of intimacy between the user and each person based on the collected message content and stamp usage information.

[0336] 4. "Means for generating and sending reminder notifications based on a time schedule" refers to a means for setting important dates (such as birthdays and anniversaries) for a user in advance and sending notifications to the user when those dates approach.

[0337] 5. "Means for generating gift suggestions based on past gift history and the recipient's preferences" refers to means for generating appropriate gift suggestions based on gifts the user has previously given and the recipient's estimated preferences.

[0338] 6. "Means for presenting a proposal list to a user" refers to means for displaying the generated gift proposals in list form on the user's device.

[0339] 7. "Means for accepting inquiries from users regarding gift contents and generating a response" refers to the means by which a user inputs the inquiry content about a specific gift within the app, and the AI ​​generates an appropriate response to that inquiry.

[0340] 8. "Means for accepting a user's reservation request and reserving a service" refers to the means for carrying out the reservation procedure through the server when a user wishes to reserve a suggested gift or service.

[0341] 9. "Means for collecting feedback after using a gift or service" refers to a means for having users input their satisfaction and opinions after using a gift or service, and then sending and storing that information on a server.

[0342] 10. "Means for collecting user behavioral data in physical stores and making product suggestions in real time" refers to a means for recording behavioral data such as the sales areas visited by users in physical stores and the products tried on by users, and then proposing optimal products and services in real time based on that data.

[0343] This invention applies an AI concierge system that runs on existing messaging apps to brick-and-mortar stores to meet the diverse needs of users. This system registers basic user information and estimates the relationship between the user and each contact by collecting and analyzing daily message content and stamp usage information. It then generates and sends reminder notifications based on a time schedule, and generates and presents gift suggestions based on past gift history and the recipient's preferences. It also accepts inquiries from users about gift ideas, generates appropriate responses, and accepts reservation requests to reserve services. Feedback is collected after gifts and service usage, and that information is used to improve the accuracy of future suggestions.

[0344] In the present invention, a means is added for collecting user behavior data even in physical stores and making product suggestions in real time. The specific configuration and operation process of this system are described below.

[0345] User registration and initial settings

[0346] The device (smartphone or tablet) displays an interface for the user to enter basic information (such as name, birthday, and product categories of interest). After the user enters and submits the information, the device sends it to the cloud server. The server stores the received information in a database and notifies the device that the initial settings are complete. The device then notifies the user that the service is now available for use.

[0347] Data collection and analysis

[0348] The device automatically records the user's daily message content and stamp usage information and periodically uploads it to a cloud server. The server uses an AI model (e.g., logistic regression) to analyze this data and score the user's relationship with each contact. Additionally, in physical stores, behavioral data such as the departments the user visited and the products they tried on is recorded and sent to the server.

[0349] Reminder execution

[0350] The server checks the user's important dates (such as birthdays and anniversaries) based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The device displays the reminder notification to the user, and the user considers what action to take.

[0351] Gift suggestions

[0352] The server generates gift suggestions for the user based on the user's past gift history and the recipient's estimated preferences. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the terminal, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[0353] Consultation about gift contents

[0354] When a user asks the AI ​​concierge for advice about a particular gift through the chat interface, the device sends the request to the server. The server analyzes the user's request, generates an appropriate response, and sends it to the device. The device then displays the response to the user, allowing them to obtain the information they need.

[0355] Reservation procedure

[0356] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service collaboration with group companies. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[0357] Feedback and Improvements

[0358] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback can be used to improve the accuracy of future suggestions.

[0359] Examples of specific examples and prompts

[0360] For example, assume that user A's friend B's birthday is December 25th, and the initial data is registered. While A is shopping in a physical store, the AI ​​concierge detects that A is thinking about what gift to buy for B. In this case, the AI ​​will suggest the best gift idea by using the following prompt:

[0361] User ID: 12345

[0362] Important Date: 2023-12-25

[0363] Recent Date: 2023-10-01

[0364] Relationship score: 85

[0365] Interesting product categories: Fashion, Home appliances

[0366] In this way, the present invention allows users to smoothly prepare for celebrations without forgetting important dates, and also significantly improves convenience in physical stores by suggesting optimal products and services in real time.

[0367] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0368] Step 1: User registration and initial setup

[0369] The user launches the application on the device and enters basic information (such as name, birthday, and product categories of interest). The device then sends the entered information to the cloud server. The server stores the received information in a database and notifies the device that initial setup is complete. Input data: basic user information. Output data: notification that initial setup is complete.

[0370] Step 2: Collect message content and stamp usage information

[0371] In the messaging apps that users use daily, the device automatically records message content and stamp usage information. This information is periodically uploaded to a cloud server. The server stores the received data in a database. Input data: message content and stamp usage information. Output data: recorded data stored in the database.

[0372] Step 3: Data analysis and inferring relationships

[0373] The server analyzes the collected message content and stamp usage information using a generative AI model (such as Logistic Regression). During this process, it derives a relationship score between the user and each person. Input data: collected message content and stamp usage information. Output data: relationship score.

[0374] Step 4: Generate and send reminder notifications

[0375] The server checks the user's important dates based on the time schedule. If a relevant event is approaching, it generates a reminder notification and sends it to the device. The device displays the reminder notification to the user. Input data: time schedule and important dates. Output data: reminder notification.

[0376] Step 5: Generate gift ideas

[0377] The server generates gift suggestions for the user based on the user's past gift history and the recipient's estimated preferences. The suggestions include physical gifts, travel plans, restaurant reservations, and other services. The generated suggestion list is sent to the device, which displays it to the user. Input data: past gift history, recipient's preferences. Output data: suggestion list.

[0378] Step 6: Accepting gift content inquiries and generating a response

[0379] When a user uses the chat interface to ask for advice about a particular gift, the device sends the advice to the server. The server analyzes the advice, generates an appropriate response, and sends it to the device. The device displays the generated response to the user. Input data: advice. Output data: response.

[0380] Step 7: Booking process

[0381] When a user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server executes the reservation procedure through service collaboration between group companies, and sends confirmation information to the device after the reservation is completed. The device displays the confirmation information to the user. Input data: reservation request. Output data: reservation confirmation information.

[0382] Step 8: Gather feedback

[0383] After the user uses a gift or service, the device sends the user's feedback to the server. The server stores the feedback in a database and uses it to improve the accuracy of the next suggestion. Input data: Feedback content. Output data: Improved suggestion content.

[0384] Step 9: Collecting behavioral data in physical stores and making product recommendations

[0385] When a user visits a physical store, the device records the user's behavioral data (which departments they visited, which products they tried on, etc.). This data is sent to a cloud server in real time, and the server uses an AI model to suggest optimal products and services, which are then sent to the device. The device then displays the suggestions to the user. Input data: behavioral data from the physical store. Output data: real-time product suggestions.

[0386] This allows users to not only receive highly accurate suggestions derived from past data, but also enjoy real-time suggestions for optimal products and services when making purchases in physical stores.

[0387] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0388] This invention relates to an AI concierge system that runs on a messaging app, reminding users of important dates and suggesting appropriate gifts and services. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to provide more personalized suggestions. An embodiment of this system will be described.

[0389] User registration and initial settings

[0390] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[0391] Data collection and analysis

[0392] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to a server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses an AI model to analyze this data and estimate the preferences of the user's friends and family.

[0393] emotion recognition

[0394] The emotion engine recognizes emotions from users' daily message content and stamp usage information. This process utilizes natural language processing technology and emotion analysis algorithms. Based on the user's emotions, gift suggestions and reminder notifications are more individually optimized.

[0395] Reminder execution

[0396] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The emotion engine adjusts the content and timing of the reminder notification. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[0397] Gift suggestions

[0398] The server generates gift suggestions for the user based on the user's past gift-giving history and the recipient's estimated preferences. The emotion engine recognizes the user's emotions and provides more appropriate gift suggestions. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the device, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[0399] Consultation about gift contents

[0400] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry and generates an appropriate response using the emotion engine. The device then displays the generated response to the user, allowing them to obtain the information they need.

[0401] Reservation procedure

[0402] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service collaboration with group companies. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[0403] Feedback and Improvements

[0404] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback is used to improve the accuracy of future suggestions. The emotion engine is also used to analyze the feedback and make improvements to provide a better user experience.

[0405] Such a system will help users to plan celebrations smoothly without forgetting important dates, and will also help them choose gifts that will please their recipients by providing personalized suggestions that take into account the user's emotions.

[0406] The processing flow will be explained below.

[0407] Step 1:

[0408] The user presses a button within the messaging app to launch the AI ​​concierge service.

[0409] Step 2:

[0410] The device displays an interface for entering basic user information (such as name, birthday, contact list, etc.).

[0411] Step 3:

[0412] The user enters the required information and presses the send button.

[0413] Step 4:

[0414] The terminal transmits the input information to the server.

[0415] Step 5:

[0416] The server stores the received user basic information in a database.

[0417] Step 6:

[0418] The device will notify the user that the initial setup is complete and the AI ​​concierge is available.

[0419] Step 7:

[0420] The terminal records the user's daily message contents and stamp usage information.

[0421] Step 8:

[0422] The device periodically uploads the recorded data to the server.

[0423] Step 9:

[0424] The server analyzes the collected message and stamp data and scores the user's relationship with each contact.

[0425] Step 10:

[0426] The server uses an AI model to estimate the preferences of the user's friends and family based on relationship scores.

[0427] Step 11:

[0428] The emotion engine recognizes the user's emotion from the message content and stamp usage information.

[0429] Step 12:

[0430] The emotion engine transmits the user's emotion data recognized to the server.

[0431] Step 13:

[0432] The server checks the birthdays and anniversaries of the user's friends and family based on a time schedule.

[0433] Step 14:

[0434] The server generates a reminder notification before the event.

[0435] Step 15:

[0436] The emotion engine adjusts the content and timing of reminder notifications.

[0437] Step 16:

[0438] The terminal receives the reminder notification from the server and displays it to the user.

[0439] Step 17:

[0440] The user checks the reminder notification and considers the necessary action.

[0441] Step 18:

[0442] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[0443] Step 19:

[0444] To provide more appropriate gift suggestions based on the user's emotions recognized by an emotion engine.

[0445] Step 20:

[0446] The server creates a list of the generated gift ideas and transmits it to the terminal.

[0447] Step 21:

[0448] The terminal displays the suggestion list to the user.

[0449] Step 22:

[0450] The user reviews the list of suggestions and selects the gift ideas that interest them.

[0451] Step 23:

[0452] The user consults with an AI concierge through a chat interface about the gift contents.

[0453] Step 24:

[0454] The device sends the user's questions or requests to the server.

[0455] Step 25:

[0456] The server analyzes the user's inquiry and generates an appropriate response using an emotion engine.

[0457] Step 26:

[0458] The terminal displays the response from the server to the user.

[0459] Step 27:

[0460] The user wishes to reserve a suggested gift or service.

[0461] Step 28:

[0462] The terminal transmits the user's reservation request to the server.

[0463] Step 29:

[0464] The server executes the reservation procedure through service collaboration between group companies.

[0465] Step 30:

[0466] The server sends a reservation confirmation to the terminal.

[0467] Step 31:

[0468] The terminal displays a reservation completion notice from the server to the user.

[0469] Step 32:

[0470] Users provide feedback after receiving gifts or using services.

[0471] Step 33:

[0472] The terminal sends the user's feedback to the server.

[0473] Step 34:

[0474] The server stores the feedback in a database and uses the emotion engine to improve the accuracy of future suggestions.

[0475] Example 2

[0476] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0477] Conventional reminder systems and gift suggestion systems make uniform suggestions without considering the user's emotional state or relationships, which means they cannot respond to individual situations. Another issue is that user feedback is not easily reflected in the next suggestion, which prevents the quality of the user experience from improving. Furthermore, there are many cases where the system does not provide appropriate responses when users ask for advice on gift selection or service reservations, which raises concerns about a decline in user satisfaction.

[0478] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0479] In this invention, the server includes means for registering basic user information, means for collecting the user's daily message content and stamp usage information, means for analyzing the collected data and estimating the user's relationship with each recipient, means for generating and sending reminder notifications based on a time schedule, means for generating gift suggestions based on the user's past gift history and the recipient's preferences, means for presenting a list of suggestions to the user, means for recognizing the user's emotional state using an emotion engine and optimizing the suggestions, means for accepting inquiries from the user regarding gift suggestions and generating responses, means for accepting the user's reservation requests and reserving services, and means for collecting feedback after purchasing gifts and using services. This enables personalized suggestions that take the user's emotions and relationships into consideration. Furthermore, by reflecting the feedback in the next suggestions, the user experience can be continuously improved. Furthermore, by generating appropriate responses to the user's inquiries, user satisfaction can be increased.

[0480] "Basic user information" refers to information that identifies an individual, such as name, birthday, and contact list.

[0481] "Message content" refers to sentences or text data that a user exchanges with others on a daily basis.

[0482] "Stamp usage information" is information about digital items such as emojis and illustrations that users use within messaging apps.

[0483] A "server" is a centralized computer system that collects, stores, analyzes, and processes user data.

[0484] An "emotion engine" is a system that uses natural language processing technology and emotion analysis algorithms to recognize a user's emotional state.

[0485] A "remind notification" is a notification message that notifies the user that an important date or event is approaching.

[0486] "Gift history" is information about gifts that a user has given to others in the past.

[0487] The "relationship score" is a numerical representation of the strength of the relationship between the user and each person, and is calculated based on the number of messages, frequency of stamp use, shared event information, and the like.

[0488] A "gift idea" is a gift suggestion that a user can give to another person, including a physical gift or a service (such as a travel plan or restaurant reservation).

[0489] The "proposal list" is a list of generated gift proposals that is presented to the user.

[0490] The "means for generating a response" is a system for analyzing the content of the user's inquiry and providing an appropriate response.

[0491] The "means for accepting reservation requests" is a system for accepting and processing reservation requests for gifts or services desired by users.

[0492] "Feedback" refers to the user providing their impressions and evaluations of the gifts and services they have used.

[0493] "Partner Companies" are external companies that work with this system to provide services and gifts.

[0494] A "generative AI model" is an artificial intelligence algorithm or model that generates optimal suggestions for users from collected data.

[0495] MODE FOR CARRYING OUT THE INVENTION

[0496] This invention is an AI concierge system that runs on a messaging app. It reminds users of important dates and suggests appropriate gifts and services. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to provide more personalized suggestions. The following describes an embodiment of the invention.

[0497] User registration and initial settings

[0498] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[0499] Data collection and analysis

[0500] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to the server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses a generative AI model to analyze this data and estimate the preferences of the user's friends and family.

[0501] emotion recognition

[0502] The emotion engine recognizes emotions from users' daily message content and stamp usage information. This process utilizes natural language processing technology and emotion analysis algorithms. Based on the user's emotions, gift suggestions and reminder notifications are more individually optimized.

[0503] Reminder execution

[0504] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The emotion engine adjusts the content and timing of the reminder notification. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[0505] Gift suggestions

[0506] The server generates gift suggestions for the user based on the user's past gift-giving history and the recipient's estimated preferences. The emotion engine recognizes the user's emotions and provides more appropriate gift suggestions. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the device, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[0507] Consultation about gift contents

[0508] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry and generates an appropriate response using the emotion engine. The device then displays the generated response to the user, allowing them to obtain the information they need.

[0509] Reservation procedure

[0510] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server, which then executes the reservation procedure through the services of a partner company. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[0511] Feedback and Improvements

[0512] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback is used to improve the accuracy of future suggestions. The emotion engine is also used to analyze the feedback and make improvements to provide a better user experience.

[0513] As a concrete example, here is an example of a prompt for a generative AI model:

[0514] "What interface should be provided for users to enter the information needed to complete the initial setup?"

[0515] "How can we calculate a relationship score based on a user's daily message data and stamp information?"

[0516] "What natural language processing techniques and sentiment analysis algorithms are best suited to recognizing emotions from user message content?"

[0517] "What's the best way to determine the best timing and content for reminding users about important dates?"

[0518] "When providing gift suggestions to users, how can we present them with the most appropriate choices based on their past history and current emotional state?"

[0519] "When a user asks for a gift, how can AI generate the most appropriate response?"

[0520] "What is the best process to streamline the process for users to book gifts and services?"

[0521] "How can we use user-provided feedback to improve the accuracy of our next suggestions?"

[0522] This allows users to plan their celebrations smoothly without forgetting important dates. In addition, personalized suggestions that take into account the user's emotions can help users choose a gift that will please the recipient.

[0523] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0524] Step 1:

[0525] Enter and submit basic user information

[0526] In order for a user to start the AI ​​concierge service, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). When the user enters information into this interface and presses the "Send" button, the entered data is sent from the device to the server. The server saves the received information in a database and sends a notification to the device that initial setup is complete. The input data includes name, birthday, contact list, etc., and the output is saving the information to the database and a notification that initial setup is complete. As a specific example, consider the case where a user enters their name as "Taro Tanaka," their birthday as "January 1, 1990," and their contact list as "Hanako Yamada, Ichiro Suzuki."

[0527] Step 2:

[0528] Recording message content and stamp usage information

[0529] During daily use, the device automatically records the content of messages sent by the user and information on stamps used. This data is uploaded to the server periodically (for example, late at night every day). The input is the content of daily messages and stamp usage information, and the output is the uploading of the recorded data to the server. As a concrete example, consider the case where a user sends a message saying "Good morning" to a friend "Yamada Hanako" and uses a stamp.

[0530] Step 3:

[0531] Relationship Scoring

[0532] The server scores the relationship between the user and each person based on the uploaded message content and stamp usage information. The input is the recorded message content and stamp usage information, and the output is the relationship score between the user and each person. Data processing involves aggregating the number of messages, frequency of stamp usage, shared event information, etc., and calculating an overall relationship score. As a specific example, let's take a case where the server calculates a relationship score of "85 points" based on the number of messages between "Taro Tanaka and Hanako Yamada" (10 times), frequency of stamp usage (5 times), and shared events (3).

[0533] Step 4:

[0534] emotion recognition

[0535] The emotion engine recognizes the user's emotions based on the message content and stamp usage information uploaded to the server. This process uses natural language processing technology and emotion analysis algorithms. The input is the uploaded text data and stamp usage information, and the output is the recognition result of the emotional state (e.g., positive, negative, etc.). As a concrete example, if a user sends a message saying "I had fun today," the emotion engine will recognize this as "positive."

[0536] Step 5:

[0537] Generate and send reminder notifications

[0538] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule, and if a relevant event is approaching, it generates a reminder notification and sends it to the device. The input is the user's time schedule and event information, and the output is the generated reminder notification. As a specific example, let's consider a case where the server confirms that "Yamada Hanako's birthday is in one week," and generates and sends a reminder notification saying "Yamada Hanako's birthday is in one week" to the device.

[0539] Step 6:

[0540] Generate and present gift offers

[0541] The server generates gift suggestions based on the user's past gift history and estimated preferences. During this process, an emotion engine optimizes the suggestions based on the user's emotional state. The generated suggestion list is sent to the device, which displays it to the user. The input is the user's past gift history and emotional state, and the output is the generated gift suggestion list. As a concrete example, consider a case where the server previously selected "cosmetic set" and this time selected "aroma diffuser" as the suggestion, and displays the suggestion list "aroma diffuser, spa ticket, cake set" to the user.

[0542] Step 7:

[0543] Gift content consultation and response generation

[0544] When a user consults an AI concierge about a specific gift through a chat interface, the device sends this to the server. The server analyzes the content of the consultation and, using an emotion engine, generates an appropriate response, which it then sends to the device. The input is the user's consultation, and the output is the generated response. As a concrete example, let's consider a case where a user asks, "What kind of aroma diffuser would be good for Yamada Hanako?" and the server replies, "I recommend a relaxing scent. A lavender aroma diffuser would be good."

[0545] Step 8:

[0546] Submit your reservation request and complete the procedure

[0547] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through the services of an affiliated company, and once completed, sends confirmation information to the device. The input is the user's reservation request, and the output is the completed reservation information. As a specific example, consider the case where the user selects "I would like to reserve a spa ticket," and the server accesses the spa's reservation system to complete the reservation, and notifies the device that "Your spa ticket reservation has been completed."

[0548] Step 9:

[0549] Feedback collection and analysis

[0550] After receiving a gift or using a service, the user sends feedback from their device to the server. The server stores the feedback in a database and uses it to improve the accuracy of the next suggestion. The emotion engine also uses it to analyze the feedback. The input is the user's feedback, and the output is the analysis results and improvements for the next suggestion. As a concrete example, let's say a user sends feedback saying "The spa ticket was great," and the server saves it as "95% satisfaction" and reflects it in the next suggestion.

[0551] (Application example 2)

[0552] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0553] In conventional messaging applications, users tend to forget important anniversaries, making it difficult to suggest personalized gifts and services based on emotions.In addition, the lack of functionality to make optimal suggestions taking users' emotions into account made improving user satisfaction a challenge.

[0554] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0555] In this invention, the server includes means for registering basic information about the user, means for collecting the user's daily message content and emoji usage information, means for analyzing the collected data and estimating the relationship between the user and each recipient, means for generating and sending reminder notifications based on a time schedule, means for generating gift suggestions based on past gift-giving history and the recipient's preferences, means for presenting a suggestion list to the user, means for generating emotion-based gift suggestions using an emotion engine that recognizes the user's emotions, means for accepting inquiries about gift content from the user and generating responses, means for accepting user reservation requests and reserving services, and means for collecting feedback after using gifts and services. This allows users to receive personalized gift and service suggestions based on their emotions without forgetting important anniversaries.

[0556] The "means for registering basic user information" is a means for collecting and registering basic information such as a user's name, birthday, and contact list.

[0557] The "means for collecting daily message content and emoticon usage information" is a means for automatically recording information on the content of a user's daily messages and the emoticons used.

[0558] "Means for analyzing collected data and inferring the relationship between the user and each contact" refers to means for analyzing collected data such as message content and emoji usage information, and for evaluating and inferring the relationship between the user and each contact based on that data.

[0559] The "means for generating and transmitting a reminder notification based on a time schedule" is a means for generating a reminder notification based on a preset schedule and transmitting it to the user's device.

[0560] "Means for generating gift suggestions based on past gift history and the recipient's preferences" refers to means for generating appropriate gift suggestions based on the user's past gift history and the recipient's preferences estimated from collected data.

[0561] The "means for presenting a proposal list to a user" is a means for displaying the generated gift proposals as a list on the user's device.

[0562] The "means for generating gift suggestions based on emotions using an emotion engine that recognizes the user's emotions" refers to a means for analyzing the content of a user's daily messages and emoji usage information to recognize emotions, and using an emotion engine to generate gift suggestions based on those emotions.

[0563] "Means for accepting inquiries from users regarding gift ideas and generating a response" refers to a means for analyzing the content of an inquiry made to an AI concierge by a user regarding a specific gift idea and generating an appropriate response.

[0564] The "means for accepting a user's reservation request and reserving a service" refers to a means for accepting a user's request and carrying out the reservation procedure when the user wishes to reserve a suggested gift or service.

[0565] The "means for collecting feedback after using a gift or service" refers to a means for collecting feedback such as the user's impression of use and satisfaction after using the gift or service provided.

[0566] "Means for providing physical gifts, travel plans, and restaurant reservations in collaboration with third-party companies' services" refers to means for providing services such as physical gifts, travel plans, and restaurant reservations to users through collaboration with other companies or service providers.

[0567] This invention relates to an AI concierge system that reminds users of important dates and suggests appropriate gifts and services. This system collects and analyzes basic information about users and makes suggestions that take their emotions into account.

[0568] System Overview

[0569] The system includes the following main components:

[0570] 1. User registration and initial settings

[0571] Displays an interface for registering basic user information (name, birthday, contact list, etc.).

[0572] The registered information is sent to a server and stored in a database.

[0573] 2. Data Collection and Analysis

[0574] Users' daily message content and emoji usage information is collected and periodically uploaded to the server.

[0575] The server analyzes the collected data using an AI model to estimate the relationship between the user and each contact.

[0576] 3. Emotion recognition

[0577] The emotion engine uses natural language processing technology to recognize the user's emotions from message content and emojis.

[0578] Personalize gift suggestions and reminders based on user sentiment.

[0579] 4. Reminder function

[0580] The server generates and sends reminder notifications when an event is approaching based on a time schedule.

[0581] The emotion engine adjusts the content and timing of reminder notifications.

[0582] 5. Gift Suggestions

[0583] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[0584] Provide more personalized gift suggestions based on emotion recognition.

[0585] 6. Discuss the gift contents

[0586] Users consult with an AI concierge through a chat interface.

[0587] The server analyzes the consultation and generates an appropriate response.

[0588] 7. Reservation Procedure

[0589] If the user wishes to reserve a suggested gift or service, the server executes the reservation procedure.

[0590] After the reservation is completed, the server sends confirmation information to the terminal and displays it.

[0591] 8. Feedback

[0592] Collect feedback from users after using the gift or service.

[0593] The server stores the feedback in a database and uses it to improve the accuracy of future suggestions.

[0594] Detailed technical explanation

[0595] Program processing:

[0596] The system is implemented using a Python program and uses the following hardware and software:

[0597] SQLite3: Database Management System

[0598] Transformers (Hugging Face): Natural Language Processing Library (Sentiment Analysis)

[0599] Requests: A library for making HTTP requests

[0600] Specific data processing and calculation:

[0601] User registration: Registered user information is stored in an SQLite3 database.

[0602] Message Analysis: Analyzes sentiment from daily message content using Transformers sentiment analysis pipeline.

[0603] Reminders: Use the Python datetime library to set reminders based on important dates.

[0604] Gift suggestions: Generate appropriate gift suggestions based on the user's relationship score and sentiment analysis results.

[0605] Reservation procedure: Reservation procedures for various services are carried out using HTTP requests.

[0606] Examples:

[0607] 1. User registration: User A enters their name, birthday, and contact information into the app and sends it to the server.

[0608] 2. Message analysis: When User B sends a message saying "I'm a little tired today," the sentiment analysis engine determines it as "negative."

[0609] 3. Reminder setting: User C's birthday is coming up in a week, so a reminder notification is generated.

[0610] 4. Gift Suggestion: Based on the results of sentiment analysis, we suggest a refreshing travel plan.

[0611] 5. Booking procedure: When user D books a sightseeing plan, the booking procedure is executed through an HTTP request.

[0612] Example prompt sentence:

[0613] As the user uses a messaging app, interpret the user's emotions from the following messages and suggest gifts and services based on those emotions.

[0614] Message: I'm a little tired today.

[0615] In this way, users can remember important dates and receive personalized gift and service suggestions based on their emotions.

[0616] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0617] Step 1:

[0618] The terminal displays an interface for inputting the user's basic information (name, birthday, contact list, etc.).

[0619] What happens: A user enters their name, birthdate, contact information, etc. and presses the submit button.

[0620] Input: User's name, birthdate, and contact list data.

[0621] Output: User information sent to the server.

[0622] Step 2:

[0623] The server stores the received basic information in a database.

[0624] Specific operation: Executes an INSERT query into the SQLite3 database to register the user's basic information.

[0625] Input: User information submitted in step 1.

[0626] Output: User information stored in the database.

[0627] Step 3:

[0628] The terminal collects the user's daily message content and emoji usage information and periodically uploads it to the server.

[0629] Specific operation: Collects message content and emoji information from the messaging app and sends it to the server in batch processing.

[0630] Input: User's daily message content and emoji information.

[0631] Output: Collected data uploaded to the server.

[0632] Step 4:

[0633] The server analyzes the uploaded data and estimates the relationship between the user and each of the contacts.

[0634] What it does: It uses AI models to analyze message frequency and emoji usage to derive a relationship score.

[0635] Input: The message content and emoji information uploaded in Step 3.

[0636] Output: Relationship score between the user and each contact.

[0637] Step 5:

[0638] The server uses natural language processing technology to recognize the user's emotions from the message content and emoticons.

[0639] What it does: Analyzes message data using Transformer's sentiment-analysis pipeline.

[0640] Input: Message content and emoji information.

[0641] Output: Emotion recognition result (e.g. positive, negative).

[0642] Step 6:

[0643] The server generates and sends reminder notifications based on a time schedule.

[0644] Specific behavior: Checks the user's important dates, generates notifications and sends them to the user's device.

[0645] Input: Important dates for registered users.

[0646] Output: The reminder notification sent to the user.

[0647] Step 7:

[0648] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[0649] What it does: Generates and lists appropriate gift ideas based on past purchase history and relationship scores.

[0650] Input: User's gift-giving history and recipient preferences.

[0651] Output: A list of gift ideas.

[0652] Step 8:

[0653] The terminal presents the suggestion list to the user.

[0654] Specific behavior: A list of suggested gift ideas is displayed on the user's screen.

[0655] Input: Gift Ideas List.

[0656] Output: The suggestion list that is displayed to the user.

[0657] Step 9:

[0658] The server uses the user's emotions to further personalize emotion-based gift suggestions.

[0659] Specific operation: Further narrow down the best gift suggestions based on the emotion recognition results.

[0660] Input: Emotion recognition results and gift suggestion list.

[0661] Output: Best gift ideas based on emotions.

[0662] Step 10:

[0663] The terminal accepts inquiries from the user regarding the contents of the present and transmits them to the server.

[0664] Specific operation: Accepts user inquiries through a chat interface.

[0665] Input: The user's inquiry.

[0666] Output: The consultation content sent to the server.

[0667] Step 11:

[0668] The server analyzes the user's inquiry and generates a response.

[0669] What it does: It uses AI models to analyze the consultation and generate an appropriate response.

[0670] Input: The user's inquiry.

[0671] Output: The generated response.

[0672] Step 12:

[0673] If the user wishes to reserve a suggested gift or service, the terminal transmits this request to the server.

[0674] Specific operation: The user enters the reservation request and presses the submit button.

[0675] Input: The user's reservation preference.

[0676] Output: The reservation request sent to the server.

[0677] Step 13:

[0678] The server executes the reservation procedure and sends a confirmation to the terminal.

[0679] Specific operation: Executes the reservation procedure via an HTTP request and sends the results to the terminal.

[0680] Input: The user's reservation preference.

[0681] Output: Booking confirmation information.

[0682] Step 14:

[0683] The terminal collects feedback on gifts and after using the service and transmits it to the server.

[0684] Specific behavior: Display the feedback input interface and send the feedback entered by the user to the server.

[0685] Input: User feedback.

[0686] Output: Feedback sent to the server.

[0687] Step 15:

[0688] The server stores the received feedback in a database and uses it to improve the accuracy of future suggestions.

[0689] What it does: Analyzes the feedback, stores it in a database, and uses it to improve the accuracy of the AI ​​model.

[0690] Input: User feedback.

[0691] Output: Stored feedback and improved accuracy of the AI ​​model.

[0692] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0693] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0694] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0695] [Second embodiment]

[0696] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0697] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0698] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0699] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0700] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0701] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0702] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0703] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0704] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0705] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0706] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0707] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0708] This invention relates to an AI concierge system that runs on a messaging app, reminding users of important dates and suggesting appropriate gifts and services. An embodiment of this system will be described.

[0709] User registration and initial settings

[0710] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[0711] Data collection and analysis

[0712] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to a server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses an AI model to analyze this data and estimate the preferences of the user's friends and family.

[0713] Reminder execution

[0714] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[0715] Gift suggestions

[0716] Based on the user's past gift-giving history and the recipient's estimated preferences, the server generates gift suggestions for the user. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the terminal, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[0717] Consultation about gift contents

[0718] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry, generates an appropriate response, and sends it to the device. The device then displays the response to the user, allowing them to obtain the information they need.

[0719] Reservation procedure

[0720] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service collaboration with group companies. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[0721] Feedback and Improvements

[0722] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback can be used to improve the accuracy of future suggestions.

[0723] This system allows users to smoothly prepare for celebrations without forgetting important dates, and also supports users in choosing a gift that will please them by providing a variety of gift ideas and service suggestions tailored to their needs.

[0724] The processing flow will be explained below.

[0725] Step 1:

[0726] The user presses a button within the messaging app to launch the AI ​​concierge service.

[0727] Step 2:

[0728] The device displays an interface for entering basic user information (such as name, birthday, contact list, etc.).

[0729] Step 3:

[0730] The user enters the required information and presses the send button.

[0731] Step 4:

[0732] The terminal transmits the input information to the server.

[0733] Step 5:

[0734] The server stores the received user basic information in a database.

[0735] Step 6:

[0736] The device will notify the user that the initial setup is complete and the AI ​​concierge is available.

[0737] Step 7:

[0738] The terminal records the user's daily message contents and stamp usage information.

[0739] Step 8:

[0740] The device periodically uploads the recorded data to the server.

[0741] Step 9:

[0742] The server analyzes the collected message and stamp data and scores the user's relationship with each contact.

[0743] Step 10:

[0744] The server uses an AI model to estimate the preferences of the user's friends and family based on relationship scores.

[0745] Step 11:

[0746] The server checks the birthdays and anniversaries of the user's friends and family based on a time schedule.

[0747] Step 12:

[0748] The server generates a reminder notification before the event.

[0749] Step 13:

[0750] The terminal receives the reminder notification from the server and displays it to the user.

[0751] Step 14:

[0752] The user checks the reminder notification and considers the necessary action.

[0753] Step 15:

[0754] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[0755] Step 16:

[0756] The server creates a list of the generated gift ideas and transmits it to the terminal.

[0757] Step 17:

[0758] The terminal displays the suggestion list to the user.

[0759] Step 18:

[0760] The user reviews the list of suggestions and selects the gift ideas that interest them.

[0761] Step 19:

[0762] The user consults with an AI concierge through a chat interface about the gift contents.

[0763] Step 20:

[0764] The device sends the user's questions or requests to the server.

[0765] Step 21:

[0766] The server analyzes the user's inquiry and generates an appropriate response.

[0767] Step 22:

[0768] The terminal displays the response from the server to the user.

[0769] Step 23:

[0770] The user wishes to reserve a suggested gift or service.

[0771] Step 24:

[0772] The terminal transmits the user's reservation request to the server.

[0773] Step 25:

[0774] The server executes the reservation procedure through service collaboration between group companies.

[0775] Step 26:

[0776] The server sends a reservation confirmation to the terminal.

[0777] Step 27:

[0778] The terminal displays a reservation completion notice from the server to the user.

[0779] Step 28:

[0780] Users provide feedback after receiving gifts or using services.

[0781] Step 29:

[0782] The terminal sends the user's feedback to the server.

[0783] Step 30:

[0784] The server stores the feedback in a database to help improve the accuracy of future suggestions.

[0785] Example 1

[0786] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0787] It is difficult for users to select appropriate gifts and services and provide them in a timely manner without worrying about forgetting important dates. It is also difficult for users to accurately understand the preferences of their friends and family and choose gifts that will please them. In addition, there are problems such as the time and effort required for reservation procedures and feedback management.

[0788] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0789] In this invention, the server includes means for registering the user's personal information, means for collecting the user's daily communication content and stamp usage information, means for analyzing the collected data and evaluating the relationship between the user and each recipient, means for generating and sending reminder notifications based on a schedule, means for generating gift ideas based on past gift-giving history and the recipient's preferences, means for presenting a list of suggestions to the user, means for accepting inquiries about gift ideas from the user and generating responses, means for accepting user reservation requests and reserving services, and means for collecting feedback after gifts and service use. This allows users to remember important dates and provide gifts and services that will please their recipients. Furthermore, reservations and feedback can be managed efficiently.

[0790] The "means for registering user's personal information" is a function for inputting and saving personal information such as the user's name, birthday, contact list, etc.

[0791] The "means for collecting information on the user's daily communication content and stamp usage" is a function for automatically capturing and recording the messages sent by the user and the stamp usage history.

[0792] The "means for analyzing collected data and evaluating the relationship between the user and each party" refers to an algorithm for quantifying and evaluating the relationship between the user and other people based on collected communication and stamp information.

[0793] The "means for generating and sending reminder notifications based on a schedule" is a function for generating and sending reminders for important dates to the user.

[0794] The "means for generating gift suggestions based on past gift history and the recipient's preferences" is an algorithm for creating optimal gift suggestions based on past gift data and the recipient's preferences.

[0795] The "means for presenting a proposal list to a user" is a function for displaying the generated gift proposal list on the user's screen.

[0796] The "means for accepting inquiries from users regarding gift contents and generating a response" is a function for generating and replying to an inquiry from a user regarding a specific gift.

[0797] The "means for accepting a user's reservation request and reserving a service" is a function for executing the reservation procedure for a gift or service selected by the user.

[0798] The "means for collecting feedback after using a gift or service" is a function for users to input and collect their impressions and evaluations after using a gift or service.

[0799] This invention relates to an AI concierge system that runs on a messaging app, reminding users of important dates and suggesting appropriate gifts and services. Specific embodiments of this system are described below.

[0800] User registration and initial settings

[0801] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[0802] Data collection and analysis

[0803] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to a server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses an AI model to analyze this data and estimate the preferences of the user's friends and family.

[0804] Reminder execution

[0805] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[0806] Gift suggestions

[0807] Based on the user's past gift-giving history and the recipient's estimated preferences, the server generates gift suggestions for the user. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the terminal, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[0808] Consultation about gift contents

[0809] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry, generates an appropriate response, and sends it to the device. The device then displays the response to the user, allowing them to obtain the information they need.

[0810] Reservation procedure

[0811] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service integration with an external company. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[0812] Feedback and Improvements

[0813] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback can be used to improve the accuracy of future suggestions.

[0814] Specific examples of hardware and software to be used

[0815] The server uses Python scripts to store data in database systems such as MySQL, and TensorFlow and PyTorch are used to build AI models. The terminal communicates via the HTTPS protocol, and the user interface is constructed using JavaScript and HTML.

[0816] Examples of specific examples and prompts

[0817] The user starts the AI ​​concierge service.

[0818] Example: A user opens a messaging app, enters basic information to use an AI concierge service, and submits.

[0819] Example prompt: "The user wants to choose a gift for a friend's birthday. Generate a list of gift suggestions and display them to the user."

[0820] With the above configuration, this invention is a system that enables users to efficiently select a gift that will please the recipient, make a reservation, and even provide feedback afterwards, without forgetting important dates.

[0821] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0822] Step 1:

[0823] The user starts the service

[0824] A user launches an existing messaging app and clicks the AI ​​concierge service button, which prompts the device to display the basic information entry screen.

[0825] Input: Click on AI Concierge Service button

[0826] Output: Display of basic information input screen

[0827] Step 2:

[0828] The device displays a screen for entering basic information.

[0829] The device displays a form prompting the user for their name, birthdate, and contact list, including text boxes and drop-down menus.

[0830] Input: A template for the basic information input screen provided by the server

[0831] Output: The basic information input screen is displayed in the user interface.

[0832] Step 3:

[0833] The user enters information and submits it.

[0834] The user enters the necessary information and presses the send button, which gives the terminal an input to "send the entered information."

[0835] Input: Basic information entered by the user (name, date of birth, contact list)

[0836] Output: The entered information is sent to the terminal

[0837] Step 4:

[0838] The device sends the information to the server

[0839] The device sends the information entered by the user to the server, where the data is transmitted securely using the HTTPS protocol.

[0840] Input: Basic information submitted by the user

[0841] Output: Information sent to the server

[0842] Step 5:

[0843] The server stores the information in a database

[0844] The server saves the received user information in a database, such as MySQL.

[0845] Input: Basic user information sent from the device

[0846] Output: Information is saved in a database

[0847] Step 6:

[0848] The server notifies you that the initial setup is complete.

[0849] The server notifies the terminal that the initial settings are complete, and generates a response message and sends it to the terminal.

[0850] Input: User information stored in the database

[0851] Output: Initialization completion notification is sent to the terminal

[0852] Step 7:

[0853] The device notifies you that the service is available

[0854] The device will inform the user that the service is available and will display a pop-up message saying "Initial setup completed."

[0855] Input: Initial setup completion notification from the server

[0856] Output: Service availability notification displayed in the user interface

[0857] Step 8:

[0858] The device records message and stamp usage information.

[0859] The device automatically records the user's daily message and stamp usage information, which is periodically sent to the server.

[0860] Input: User communication content and stamp usage information

[0861] Output: Usage information recorded on the device

[0862] Step 9:

[0863] The device uploads data to the server

[0864] The device sends the recorded data to the server at regular intervals. The data is transmitted securely using the HTTPS protocol.

[0865] Input: Usage information recorded on the device

[0866] Output: Data uploaded to the server

[0867] Step 10:

[0868] The server scores the data

[0869] The server scores messages based on message counts, stamp usage frequency, and shared event information. It uses Python scripts for data analysis and scoring.

[0870] Input: Uploaded message and stamp data

[0871] Output: Relationship score between the user and each contact

[0872] Step 11:

[0873] The server analyzes the data using an AI model

[0874] The server uses AI models to estimate the preferences of the user's friends and family, using frameworks such as TensorFlow and PyTorch.

[0875] Input: Relationship data between the user and each contact

[0876] Output: Estimated preferences of the user's friends and family

[0877] Step 12:

[0878] The server generates a reminder notification

[0879] The server generates reminder notifications based on a pre-defined time schedule, and creates reminders using notification message templates.

[0880] Input: Time schedule and important dates retrieved from database

[0881] Output: The generated reminder notification

[0882] Step 13:

[0883] The server sends a reminder notification to the device.

[0884] The server sends the generated reminder notification to the device via the HTTPS protocol.

[0885] Input: The generated reminder notification

[0886] Output: Reminder notification sent to device

[0887] Step 14:

[0888] The device displays a reminder notification

[0889] The device will display reminder notifications to the user, either via the notification center or as a pop-up message.

[0890] Input: Reminder notification sent from the server

[0891] Output: Reminder notification displayed in the user interface

[0892] Step 15:

[0893] The server generates gift ideas

[0894] The server generates gift suggestions based on the user's past gift history and the preferences of their friends and family. It uses a generative AI model to select and generate gift candidates.

[0895] Input: Gift history and preference data from a database

[0896] Output: Generated gift ideas

[0897] Step 16:

[0898] The server sends gift ideas to the device

[0899] The server sends the generated gift ideas to the device in JSON format.

[0900] Input: Generated gift idea

[0901] Output: Gift idea sent to device

[0902] Step 17:

[0903] The device displays gift ideas

[0904] The terminal displays the gift suggestions to the user. A list of gift suggestions is displayed on the user interface.

[0905] Input: Gift offer sent from server

[0906] Output: Gift ideas displayed in a user interface

[0907] Step 18:

[0908] The user checks and selects gift ideas

[0909] The user checks the displayed gift ideas and selects one that they are interested in. The next step is then performed based on the selected idea.

[0910] Input: List of suggested gift ideas

[0911] Output: Selected gift ideas

[0912] Step 19:

[0913] The user asks for a gift consultation

[0914] Users can discuss gifts through a chat interface, where they can type and submit questions about a particular gift.

[0915] Enter: Giveaway Question

[0916] Output: The consultation details are displayed on the terminal.

[0917] Step 20:

[0918] The device sends the consultation details to the server

[0919] The terminal sends the user's consultation details to the server as text data.

[0920] Input: User's inquiry

[0921] Output: Consultation details sent to the server

[0922] Step 21:

[0923] The server analyzes the consultation content

[0924] The server analyzes the received consultation content using natural language processing (NLP) technology.

[0925] Input: Consultation details sent by the user

[0926] Output: Parsed consultation content

[0927] Step 22:

[0928] The server generates an appropriate response

[0929] Based on the analysis results, the server generates an appropriate response to the user's inquiry.

[0930] Input: Parsed consultation content

[0931] Output: The generated response

[0932] Step 23:

[0933] The server sends the response to the device

[0934] The server generates a response and sends it to the terminal. The response is sent in text format.

[0935] Input: The generated response

[0936] Output: Response sent to the terminal

[0937] Step 24:

[0938] The terminal displays the response

[0939] The terminal displays the response to the user. The response message is displayed in the chat box.

[0940] Input: The response sent by the server

[0941] Output: The response displayed in the user interface

[0942] Step 25:

[0943] The user wishes to make a reservation

[0944] A user wishes to reserve a gift or service. The user selects the option they wish to reserve and presses the reservation button.

[0945] Input: User's reservation request

[0946] Output: Reservation request data is sent to the terminal

[0947] Step 26:

[0948] The device sends a reservation request to the server

[0949] The terminal sends the reservation request data to the server, which is then used by the reservation management system.

[0950] Input: User's reservation request data

[0951] Output: Reservation request data sent to the server

[0952] Step 27:

[0953] The server executes the reservation procedure.

[0954] The server executes the relevant reservation procedures and manages reservations using the service API of an external company.

[0955] Input: Reservation request data sent from the terminal

[0956] Output: Reservation procedure performed

[0957] Step 28:

[0958] The server sends the reservation confirmation information

[0959] After the reservation is completed, the server sends confirmation information to the terminal. The confirmation information is sent in JSON format.

[0960] Input: Booking procedure completion data

[0961] Output: Booking confirmation sent to the device

[0962] Step 29:

[0963] The device displays confirmation information

[0964] The terminal displays the reservation confirmation information to the user. The user interface displays a reservation completion message.

[0965] Input: Reservation confirmation information sent from the server

[0966] Output: Booking confirmation information displayed in the user interface

[0967] Step 30:

[0968] Users provide feedback

[0969] After using the gift or service, the user provides feedback by filling out the evaluation form and pressing the submit button.

[0970] Input: User feedback

[0971] Output: Feedback is sent to the device

[0972] Step 31:

[0973] The device sends feedback to the server

[0974] The terminal transmits the feedback information to the server, and the transmitted data is used in the feedback management system.

[0975] Input: User feedback

[0976] Output: Feedback data sent to the server

[0977] Step 32:

[0978] The server stores the feedback in a database

[0979] The server stores the feedback information in a database, which is used to improve the accuracy of the next proposal.

[0980] Input: Feedback data sent from the device

[0981] Output: Feedback stored in a database

[0982] Step 33:

[0983] The server improves based on feedback

[0984] The server will use the collected feedback to improve its next suggestion, feeding the feedback data into the AI ​​model to improve prediction accuracy.

[0985] Input: Feedback stored in the database

[0986] Output: An improved AI model reflected in the next proposal

[0987] These steps allow the entire system to remember important dates, provide appropriate gifts and services, and efficiently manage booking procedures and feedback.

[0988] (Application example 1)

[0989] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0990] Conventional AI concierge systems that run on messaging apps suggest gifts and services for friends and family based on the user's basic information, but the suggestions are limited, making it difficult to meet the diverse needs of users.In addition, when users make purchases in physical stores, they are unable to make timely suggestions about the most suitable products and services, which results in an inefficient purchasing experience.

[0991] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0992] In this invention, the server includes means for registering basic information about the user, means for collecting the user's daily message content and stamp usage information, means for analyzing the collected data and estimating the relationship between the user and each recipient, means for generating and sending reminder notifications based on a time schedule, means for generating gift ideas based on past gift-giving history and the recipient's preferences, means for presenting a list of ideas to the user, means for accepting inquiries about gift ideas from the user and generating responses, means for accepting user reservation requests and reserving services, means for collecting feedback after gifts and service usage, and means for collecting user behavior data in physical stores and making product suggestions in real time. This enables suggestions to be made according to the user's diverse needs, and also enables timely suggestions of optimal products and services in physical stores, thereby improving the purchasing experience.

[0993] 1. "Means for registering basic user information" refers to the means for sending personal information entered by the user into the application, such as name, birthday, and product categories of interest, to a cloud server and storing it in a database.

[0994] 2. "Means for collecting daily message content and stamp usage information of users" refers to the means for recording messages sent and received by users through messaging apps and stamp usage and sending this information to a server.

[0995] 3. "Means of analyzing collected data and estimating the relationship between the user and each person" refers to a means of using an AI model to score the degree of intimacy between the user and each person based on the collected message content and stamp usage information.

[0996] 4. "Means for generating and sending reminder notifications based on a time schedule" refers to a means for setting important dates (such as birthdays and anniversaries) for a user in advance and sending notifications to the user when those dates approach.

[0997] 5. "Means for generating gift suggestions based on past gift history and the recipient's preferences" refers to means for generating appropriate gift suggestions based on gifts the user has previously given and the recipient's estimated preferences.

[0998] 6. "Means for presenting a proposal list to a user" refers to means for displaying the generated gift proposals in list form on the user's device.

[0999] 7. "Means for accepting inquiries from users regarding gift contents and generating a response" refers to the means by which a user inputs the inquiry content about a specific gift within the app, and the AI ​​generates an appropriate response to that inquiry.

[1000] 8. "Means for accepting a user's reservation request and reserving a service" refers to the means for carrying out the reservation procedure through the server when a user wishes to reserve a suggested gift or service.

[1001] 9. "Means for collecting feedback after using a gift or service" refers to a means for having users input their satisfaction and opinions after using a gift or service, and then sending and storing that information on a server.

[1002] 10. "Means for collecting user behavioral data in physical stores and making product suggestions in real time" refers to a means for recording behavioral data such as the sales areas visited by users in physical stores and the products tried on by users, and then proposing optimal products and services in real time based on that data.

[1003] This invention applies an AI concierge system that runs on existing messaging apps to brick-and-mortar stores to meet the diverse needs of users. This system registers basic user information and estimates the relationship between the user and each contact by collecting and analyzing daily message content and stamp usage information. It then generates and sends reminder notifications based on a time schedule, and generates and presents gift suggestions based on past gift history and the recipient's preferences. It also accepts inquiries from users about gift ideas, generates appropriate responses, and accepts reservation requests to reserve services. Feedback is collected after gifts and service usage, and that information is used to improve the accuracy of future suggestions.

[1004] In the present invention, a means is added for collecting user behavior data even in physical stores and making product suggestions in real time. The specific configuration and operation process of this system are described below.

[1005] User registration and initial settings

[1006] The device (smartphone or tablet) displays an interface for the user to enter basic information (such as name, birthday, and product categories of interest). After the user enters and submits the information, the device sends it to the cloud server. The server stores the received information in a database and notifies the device that the initial settings are complete. The device then notifies the user that the service is now available for use.

[1007] Data collection and analysis

[1008] The device automatically records the user's daily message content and stamp usage information and periodically uploads it to a cloud server. The server uses an AI model (e.g., logistic regression) to analyze this data and score the user's relationship with each contact. Additionally, in physical stores, behavioral data such as the departments the user visited and the products they tried on is recorded and sent to the server.

[1009] Reminder execution

[1010] The server checks the user's important dates (such as birthdays and anniversaries) based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The device displays the reminder notification to the user, and the user considers what action to take.

[1011] Gift suggestions

[1012] The server generates gift suggestions for the user based on the user's past gift history and the recipient's estimated preferences. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the terminal, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[1013] Consultation about gift contents

[1014] When a user asks the AI ​​concierge for advice about a particular gift through the chat interface, the device sends the request to the server. The server analyzes the user's request, generates an appropriate response, and sends it to the device. The device then displays the response to the user, allowing them to obtain the information they need.

[1015] Reservation procedure

[1016] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service collaboration with group companies. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[1017] Feedback and Improvements

[1018] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback can be used to improve the accuracy of future suggestions.

[1019] Examples of specific examples and prompts

[1020] For example, assume that user A's friend B's birthday is December 25th, and the initial data is registered. While A is shopping in a physical store, the AI ​​concierge detects that A is thinking about what gift to buy for B. In this case, the AI ​​will suggest the best gift idea by using the following prompt:

[1021] User ID: 12345

[1022] Important Date: 2023-12-25

[1023] Recent Date: 2023-10-01

[1024] Relationship score: 85

[1025] Interesting product categories: Fashion, Home appliances

[1026] In this way, the present invention allows users to smoothly prepare for celebrations without forgetting important dates, and also significantly improves convenience in physical stores by suggesting optimal products and services in real time.

[1027] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1028] Step 1: User registration and initial setup

[1029] The user launches the application on the device and enters basic information (such as name, birthday, and product categories of interest). The device then sends the entered information to the cloud server. The server stores the received information in a database and notifies the device that initial setup is complete. Input data: basic user information. Output data: notification that initial setup is complete.

[1030] Step 2: Collect message content and stamp usage information

[1031] In the messaging apps that users use daily, the device automatically records message content and stamp usage information. This information is periodically uploaded to a cloud server. The server stores the received data in a database. Input data: message content and stamp usage information. Output data: recorded data stored in the database.

[1032] Step 3: Data analysis and inferring relationships

[1033] The server analyzes the collected message content and stamp usage information using a generative AI model (such as Logistic Regression). During this process, it derives a relationship score between the user and each person. Input data: collected message content and stamp usage information. Output data: relationship score.

[1034] Step 4: Generate and send reminder notifications

[1035] The server checks the user's important dates based on the time schedule. If a relevant event is approaching, it generates a reminder notification and sends it to the device. The device displays the reminder notification to the user. Input data: time schedule and important dates. Output data: reminder notification.

[1036] Step 5: Generate gift ideas

[1037] The server generates gift suggestions for the user based on the user's past gift history and the recipient's estimated preferences. The suggestions include physical gifts, travel plans, restaurant reservations, and other services. The generated suggestion list is sent to the device, which displays it to the user. Input data: past gift history, recipient's preferences. Output data: suggestion list.

[1038] Step 6: Accepting gift content inquiries and generating a response

[1039] When a user uses the chat interface to ask for advice about a particular gift, the device sends the advice to the server. The server analyzes the advice, generates an appropriate response, and sends it to the device. The device displays the generated response to the user. Input data: advice. Output data: response.

[1040] Step 7: Booking process

[1041] When a user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server executes the reservation procedure through service collaboration between group companies, and sends confirmation information to the device after the reservation is completed. The device displays the confirmation information to the user. Input data: reservation request. Output data: reservation confirmation information.

[1042] Step 8: Gather feedback

[1043] After the user uses a gift or service, the device sends the user's feedback to the server. The server stores the feedback in a database and uses it to improve the accuracy of the next suggestion. Input data: Feedback content. Output data: Improved suggestion content.

[1044] Step 9: Collecting behavioral data in physical stores and making product recommendations

[1045] When a user visits a physical store, the device records the user's behavioral data (which departments they visited, which products they tried on, etc.). This data is sent to a cloud server in real time, and the server uses an AI model to suggest optimal products and services, which are then sent to the device. The device then displays the suggestions to the user. Input data: behavioral data from the physical store. Output data: real-time product suggestions.

[1046] This allows users to not only receive highly accurate suggestions derived from past data, but also enjoy real-time suggestions for optimal products and services when making purchases in physical stores.

[1047] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1048] This invention relates to an AI concierge system that runs on a messaging app, reminding users of important dates and suggesting appropriate gifts and services. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to provide more personalized suggestions. An embodiment of this system will be described.

[1049] User registration and initial settings

[1050] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[1051] Data collection and analysis

[1052] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to a server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses an AI model to analyze this data and estimate the preferences of the user's friends and family.

[1053] emotion recognition

[1054] The emotion engine recognizes emotions from users' daily message content and stamp usage information. This process utilizes natural language processing technology and emotion analysis algorithms. Based on the user's emotions, gift suggestions and reminder notifications are more individually optimized.

[1055] Reminder execution

[1056] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The emotion engine adjusts the content and timing of the reminder notification. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[1057] Gift suggestions

[1058] The server generates gift suggestions for the user based on the user's past gift-giving history and the recipient's estimated preferences. The emotion engine recognizes the user's emotions and provides more appropriate gift suggestions. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the device, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[1059] Consultation about gift contents

[1060] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry and generates an appropriate response using the emotion engine. The device then displays the generated response to the user, allowing them to obtain the information they need.

[1061] Reservation procedure

[1062] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service collaboration with group companies. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[1063] Feedback and Improvements

[1064] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback is used to improve the accuracy of future suggestions. The emotion engine is also used to analyze the feedback and make improvements to provide a better user experience.

[1065] Such a system will help users to plan celebrations smoothly without forgetting important dates, and will also help them choose gifts that will please their recipients by providing personalized suggestions that take into account the user's emotions.

[1066] The processing flow will be explained below.

[1067] Step 1:

[1068] The user presses a button within the messaging app to launch the AI ​​concierge service.

[1069] Step 2:

[1070] The device displays an interface for entering basic user information (such as name, birthday, contact list, etc.).

[1071] Step 3:

[1072] The user enters the required information and presses the send button.

[1073] Step 4:

[1074] The terminal transmits the input information to the server.

[1075] Step 5:

[1076] The server stores the received user basic information in a database.

[1077] Step 6:

[1078] The device will notify the user that the initial setup is complete and the AI ​​concierge is available.

[1079] Step 7:

[1080] The terminal records the user's daily message contents and stamp usage information.

[1081] Step 8:

[1082] The device periodically uploads the recorded data to the server.

[1083] Step 9:

[1084] The server analyzes the collected message and stamp data and scores the user's relationship with each contact.

[1085] Step 10:

[1086] The server uses an AI model to estimate the preferences of the user's friends and family based on relationship scores.

[1087] Step 11:

[1088] The emotion engine recognizes the user's emotion from the message content and stamp usage information.

[1089] Step 12:

[1090] The emotion engine transmits the user's emotion data recognized to the server.

[1091] Step 13:

[1092] The server checks the birthdays and anniversaries of the user's friends and family based on a time schedule.

[1093] Step 14:

[1094] The server generates a reminder notification before the event.

[1095] Step 15:

[1096] The emotion engine adjusts the content and timing of reminder notifications.

[1097] Step 16:

[1098] The terminal receives the reminder notification from the server and displays it to the user.

[1099] Step 17:

[1100] The user checks the reminder notification and considers the necessary action.

[1101] Step 18:

[1102] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[1103] Step 19:

[1104] To provide more appropriate gift suggestions based on the user's emotions recognized by an emotion engine.

[1105] Step 20:

[1106] The server creates a list of the generated gift ideas and transmits it to the terminal.

[1107] Step 21:

[1108] The terminal displays the suggestion list to the user.

[1109] Step 22:

[1110] The user reviews the list of suggestions and selects the gift ideas that interest them.

[1111] Step 23:

[1112] The user consults with an AI concierge through a chat interface about the gift contents.

[1113] Step 24:

[1114] The device sends the user's questions or requests to the server.

[1115] Step 25:

[1116] The server analyzes the user's inquiry and generates an appropriate response using an emotion engine.

[1117] Step 26:

[1118] The terminal displays the response from the server to the user.

[1119] Step 27:

[1120] The user wishes to reserve a suggested gift or service.

[1121] Step 28:

[1122] The terminal transmits the user's reservation request to the server.

[1123] Step 29:

[1124] The server executes the reservation procedure through service collaboration between group companies.

[1125] Step 30:

[1126] The server sends a reservation confirmation to the terminal.

[1127] Step 31:

[1128] The terminal displays a reservation completion notice from the server to the user.

[1129] Step 32:

[1130] Users provide feedback after receiving gifts or using services.

[1131] Step 33:

[1132] The terminal sends the user's feedback to the server.

[1133] Step 34:

[1134] The server stores the feedback in a database and uses the emotion engine to improve the accuracy of future suggestions.

[1135] Example 2

[1136] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1137] Conventional reminder systems and gift suggestion systems make uniform suggestions without considering the user's emotional state or relationships, which means they cannot respond to individual situations. Another issue is that user feedback is not easily reflected in the next suggestion, which prevents the quality of the user experience from improving. Furthermore, there are many cases where the system does not provide appropriate responses when users ask for advice on gift selection or service reservations, which raises concerns about a decline in user satisfaction.

[1138] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1139] In this invention, the server includes means for registering basic user information, means for collecting the user's daily message content and stamp usage information, means for analyzing the collected data and estimating the user's relationship with each recipient, means for generating and sending reminder notifications based on a time schedule, means for generating gift suggestions based on the user's past gift history and the recipient's preferences, means for presenting a list of suggestions to the user, means for recognizing the user's emotional state using an emotion engine and optimizing the suggestions, means for accepting inquiries from the user regarding gift suggestions and generating responses, means for accepting the user's reservation requests and reserving services, and means for collecting feedback after purchasing gifts and using services. This enables personalized suggestions that take the user's emotions and relationships into consideration. Furthermore, by reflecting the feedback in the next suggestions, the user experience can be continuously improved. Furthermore, by generating appropriate responses to the user's inquiries, user satisfaction can be increased.

[1140] "Basic user information" refers to information that identifies an individual, such as name, birthday, and contact list.

[1141] "Message content" refers to sentences or text data that a user exchanges with others on a daily basis.

[1142] "Stamp usage information" is information about digital items such as emojis and illustrations that users use within messaging apps.

[1143] A "server" is a centralized computer system that collects, stores, analyzes, and processes user data.

[1144] An "emotion engine" is a system that uses natural language processing technology and emotion analysis algorithms to recognize a user's emotional state.

[1145] A "remind notification" is a notification message that notifies the user that an important date or event is approaching.

[1146] "Gift history" is information about gifts that a user has given to others in the past.

[1147] The "relationship score" is a numerical representation of the strength of the relationship between the user and each person, and is calculated based on the number of messages, frequency of stamp use, shared event information, and the like.

[1148] A "gift idea" is a gift suggestion that a user can give to another person, including a physical gift or a service (such as a travel plan or restaurant reservation).

[1149] The "proposal list" is a list of generated gift proposals that is presented to the user.

[1150] The "means for generating a response" is a system for analyzing the content of the user's inquiry and providing an appropriate response.

[1151] The "means for accepting reservation requests" is a system for accepting and processing reservation requests for gifts or services desired by users.

[1152] "Feedback" refers to the user providing their impressions and evaluations of the gifts and services they have used.

[1153] "Partner Companies" are external companies that work with this system to provide services and gifts.

[1154] A "generative AI model" is an artificial intelligence algorithm or model that generates optimal suggestions for users from collected data.

[1155] MODE FOR CARRYING OUT THE INVENTION

[1156] This invention is an AI concierge system that runs on a messaging app. It reminds users of important dates and suggests appropriate gifts and services. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to provide more personalized suggestions. The following describes an embodiment of the invention.

[1157] User registration and initial settings

[1158] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[1159] Data collection and analysis

[1160] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to the server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses a generative AI model to analyze this data and estimate the preferences of the user's friends and family.

[1161] emotion recognition

[1162] The emotion engine recognizes emotions from users' daily message content and stamp usage information. This process utilizes natural language processing technology and emotion analysis algorithms. Based on the user's emotions, gift suggestions and reminder notifications are more individually optimized.

[1163] Reminder execution

[1164] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The emotion engine adjusts the content and timing of the reminder notification. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[1165] Gift suggestions

[1166] The server generates gift suggestions for the user based on the user's past gift-giving history and the recipient's estimated preferences. The emotion engine recognizes the user's emotions and provides more appropriate gift suggestions. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the device, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[1167] Consultation about gift contents

[1168] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry and generates an appropriate response using the emotion engine. The device then displays the generated response to the user, allowing them to obtain the information they need.

[1169] Reservation procedure

[1170] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server, which then executes the reservation procedure through the services of a partner company. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[1171] Feedback and Improvements

[1172] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback is used to improve the accuracy of future suggestions. The emotion engine is also used to analyze the feedback and make improvements to provide a better user experience.

[1173] As a concrete example, here is an example of a prompt for a generative AI model:

[1174] "What interface should be provided for users to enter the information needed to complete the initial setup?"

[1175] "How can we calculate a relationship score based on a user's daily message data and stamp information?"

[1176] "What natural language processing techniques and sentiment analysis algorithms are best suited to recognizing emotions from user message content?"

[1177] "What's the best way to determine the best timing and content for reminding users about important dates?"

[1178] "When providing gift suggestions to users, how can we present them with the most appropriate choices based on their past history and current emotional state?"

[1179] "When a user asks for a gift, how can AI generate the most appropriate response?"

[1180] "What is the best process to streamline the process for users to book gifts and services?"

[1181] "How can we use user-provided feedback to improve the accuracy of our next suggestions?"

[1182] This allows users to plan their celebrations smoothly without forgetting important dates. In addition, personalized suggestions that take into account the user's emotions can help users choose a gift that will please the recipient.

[1183] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1184] Step 1:

[1185] Enter and submit basic user information

[1186] In order for a user to start the AI ​​concierge service, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). When the user enters information into this interface and presses the "Send" button, the entered data is sent from the device to the server. The server saves the received information in a database and sends a notification to the device that initial setup is complete. The input data includes name, birthday, contact list, etc., and the output is saving the information to the database and a notification that initial setup is complete. As a specific example, consider the case where a user enters their name as "Taro Tanaka," their birthday as "January 1, 1990," and their contact list as "Hanako Yamada, Ichiro Suzuki."

[1187] Step 2:

[1188] Recording message content and stamp usage information

[1189] During daily use, the device automatically records the content of messages sent by the user and information on stamps used. This data is uploaded to the server periodically (for example, late at night every day). The input is the content of daily messages and stamp usage information, and the output is the uploading of the recorded data to the server. As a concrete example, consider the case where a user sends a message saying "Good morning" to a friend "Yamada Hanako" and uses a stamp.

[1190] Step 3:

[1191] Relationship Scoring

[1192] The server scores the relationship between the user and each person based on the uploaded message content and stamp usage information. The input is the recorded message content and stamp usage information, and the output is the relationship score between the user and each person. Data processing involves aggregating the number of messages, frequency of stamp usage, shared event information, etc., and calculating an overall relationship score. As a specific example, let's take a case where the server calculates a relationship score of "85 points" based on the number of messages between "Taro Tanaka and Hanako Yamada" (10 times), frequency of stamp usage (5 times), and shared events (3).

[1193] Step 4:

[1194] emotion recognition

[1195] The emotion engine recognizes the user's emotions based on the message content and stamp usage information uploaded to the server. This process uses natural language processing technology and emotion analysis algorithms. The input is the uploaded text data and stamp usage information, and the output is the recognition result of the emotional state (e.g., positive, negative, etc.). As a concrete example, if a user sends a message saying "I had fun today," the emotion engine will recognize this as "positive."

[1196] Step 5:

[1197] Generate and send reminder notifications

[1198] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule, and if a relevant event is approaching, it generates a reminder notification and sends it to the device. The input is the user's time schedule and event information, and the output is the generated reminder notification. As a specific example, let's consider a case where the server confirms that "Yamada Hanako's birthday is in one week," and generates and sends a reminder notification saying "Yamada Hanako's birthday is in one week" to the device.

[1199] Step 6:

[1200] Generate and present gift offers

[1201] The server generates gift suggestions based on the user's past gift history and estimated preferences. During this process, an emotion engine optimizes the suggestions based on the user's emotional state. The generated suggestion list is sent to the device, which displays it to the user. The input is the user's past gift history and emotional state, and the output is the generated gift suggestion list. As a concrete example, consider a case where the server previously selected "cosmetic set" and this time selected "aroma diffuser" as the suggestion, and displays the suggestion list "aroma diffuser, spa ticket, cake set" to the user.

[1202] Step 7:

[1203] Gift content consultation and response generation

[1204] When a user consults an AI concierge about a specific gift through a chat interface, the device sends this to the server. The server analyzes the content of the consultation and, using an emotion engine, generates an appropriate response, which it then sends to the device. The input is the user's consultation, and the output is the generated response. As a concrete example, let's consider a case where a user asks, "What kind of aroma diffuser would be good for Yamada Hanako?" and the server replies, "I recommend a relaxing scent. A lavender aroma diffuser would be good."

[1205] Step 8:

[1206] Submit your reservation request and complete the procedure

[1207] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through the services of an affiliated company, and once completed, sends confirmation information to the device. The input is the user's reservation request, and the output is the completed reservation information. As a specific example, consider the case where the user selects "I would like to reserve a spa ticket," and the server accesses the spa's reservation system to complete the reservation, and notifies the device that "Your spa ticket reservation has been completed."

[1208] Step 9:

[1209] Feedback collection and analysis

[1210] After receiving a gift or using a service, the user sends feedback from their device to the server. The server stores the feedback in a database and uses it to improve the accuracy of the next suggestion. The emotion engine also uses it to analyze the feedback. The input is the user's feedback, and the output is the analysis results and improvements for the next suggestion. As a concrete example, let's say a user sends feedback saying "The spa ticket was great," and the server saves it as "95% satisfaction" and reflects it in the next suggestion.

[1211] (Application example 2)

[1212] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1213] In conventional messaging applications, users tend to forget important anniversaries, making it difficult to suggest personalized gifts and services based on emotions.In addition, the lack of functionality to make optimal suggestions taking users' emotions into account made improving user satisfaction a challenge.

[1214] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1215] In this invention, the server includes means for registering basic information about the user, means for collecting the user's daily message content and emoji usage information, means for analyzing the collected data and estimating the relationship between the user and each recipient, means for generating and sending reminder notifications based on a time schedule, means for generating gift suggestions based on past gift-giving history and the recipient's preferences, means for presenting a suggestion list to the user, means for generating emotion-based gift suggestions using an emotion engine that recognizes the user's emotions, means for accepting inquiries about gift content from the user and generating responses, means for accepting user reservation requests and reserving services, and means for collecting feedback after using gifts and services. This allows users to receive personalized gift and service suggestions based on their emotions without forgetting important anniversaries.

[1216] The "means for registering basic user information" is a means for collecting and registering basic information such as a user's name, birthday, and contact list.

[1217] The "means for collecting daily message content and emoticon usage information" is a means for automatically recording information on the content of a user's daily messages and the emoticons used.

[1218] "Means for analyzing collected data and inferring the relationship between the user and each contact" refers to means for analyzing collected data such as message content and emoji usage information, and for evaluating and inferring the relationship between the user and each contact based on that data.

[1219] The "means for generating and transmitting a reminder notification based on a time schedule" is a means for generating a reminder notification based on a preset schedule and transmitting it to the user's device.

[1220] "Means for generating gift suggestions based on past gift history and the recipient's preferences" refers to means for generating appropriate gift suggestions based on the user's past gift history and the recipient's preferences estimated from collected data.

[1221] The "means for presenting a proposal list to a user" is a means for displaying the generated gift proposals as a list on the user's device.

[1222] The "means for generating gift suggestions based on emotions using an emotion engine that recognizes the user's emotions" refers to a means for analyzing the content of a user's daily messages and emoji usage information to recognize emotions, and using an emotion engine to generate gift suggestions based on those emotions.

[1223] "Means for accepting inquiries from users regarding gift ideas and generating a response" refers to a means for analyzing the content of an inquiry made to an AI concierge by a user regarding a specific gift idea and generating an appropriate response.

[1224] The "means for accepting a user's reservation request and reserving a service" refers to a means for accepting a user's request and carrying out the reservation procedure when the user wishes to reserve a suggested gift or service.

[1225] The "means for collecting feedback after using a gift or service" refers to a means for collecting feedback such as the user's impression of use and satisfaction after using the gift or service provided.

[1226] "Means for providing physical gifts, travel plans, and restaurant reservations in collaboration with third-party companies' services" refers to means for providing services such as physical gifts, travel plans, and restaurant reservations to users through collaboration with other companies or service providers.

[1227] This invention relates to an AI concierge system that reminds users of important dates and suggests appropriate gifts and services. This system collects and analyzes basic information about users and makes suggestions that take their emotions into account.

[1228] System Overview

[1229] The system includes the following main components:

[1230] 1. User registration and initial settings

[1231] Displays an interface for registering basic user information (name, birthday, contact list, etc.).

[1232] The registered information is sent to a server and stored in a database.

[1233] 2. Data Collection and Analysis

[1234] Users' daily message content and emoji usage information is collected and periodically uploaded to the server.

[1235] The server analyzes the collected data using an AI model to estimate the relationship between the user and each contact.

[1236] 3. Emotion recognition

[1237] The emotion engine uses natural language processing technology to recognize the user's emotions from message content and emojis.

[1238] Personalize gift suggestions and reminders based on user sentiment.

[1239] 4. Reminder function

[1240] The server generates and sends reminder notifications when an event is approaching based on a time schedule.

[1241] The emotion engine adjusts the content and timing of reminder notifications.

[1242] 5. Gift Suggestions

[1243] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[1244] Provide more personalized gift suggestions based on emotion recognition.

[1245] 6. Discuss the gift contents

[1246] Users consult with an AI concierge through a chat interface.

[1247] The server analyzes the consultation and generates an appropriate response.

[1248] 7. Reservation Procedure

[1249] If the user wishes to reserve a suggested gift or service, the server executes the reservation procedure.

[1250] After the reservation is completed, the server sends confirmation information to the terminal and displays it.

[1251] 8. Feedback

[1252] Collect feedback from users after using the gift or service.

[1253] The server stores the feedback in a database and uses it to improve the accuracy of future suggestions.

[1254] Detailed technical explanation

[1255] Program processing:

[1256] The system is implemented using a Python program and uses the following hardware and software:

[1257] SQLite3: Database Management System

[1258] Transformers (Hugging Face): Natural Language Processing Library (Sentiment Analysis)

[1259] Requests: A library for making HTTP requests

[1260] Specific data processing and calculation:

[1261] User registration: Registered user information is stored in an SQLite3 database.

[1262] Message Analysis: Analyzes sentiment from daily message content using Transformers sentiment analysis pipeline.

[1263] Reminders: Use the Python datetime library to set reminders based on important dates.

[1264] Gift suggestions: Generate appropriate gift suggestions based on the user's relationship score and sentiment analysis results.

[1265] Reservation procedure: Reservation procedures for various services are carried out using HTTP requests.

[1266] Examples:

[1267] 1. User registration: User A enters their name, birthday, and contact information into the app and sends it to the server.

[1268] 2. Message analysis: When User B sends a message saying "I'm a little tired today," the sentiment analysis engine determines it as "negative."

[1269] 3. Reminder setting: User C's birthday is coming up in a week, so a reminder notification is generated.

[1270] 4. Gift Suggestion: Based on the results of sentiment analysis, we suggest a refreshing travel plan.

[1271] 5. Booking procedure: When user D books a sightseeing plan, the booking procedure is executed through an HTTP request.

[1272] Example prompt sentence:

[1273] As the user uses a messaging app, interpret the user's emotions from the following messages and suggest gifts and services based on those emotions.

[1274] Message: I'm a little tired today.

[1275] In this way, users can remember important dates and receive personalized gift and service suggestions based on their emotions.

[1276] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1277] Step 1:

[1278] The terminal displays an interface for inputting the user's basic information (name, birthday, contact list, etc.).

[1279] What happens: A user enters their name, birthdate, contact information, etc. and presses the submit button.

[1280] Input: User's name, birthdate, and contact list data.

[1281] Output: User information sent to the server.

[1282] Step 2:

[1283] The server stores the received basic information in a database.

[1284] Specific operation: Executes an INSERT query into the SQLite3 database to register the user's basic information.

[1285] Input: User information submitted in step 1.

[1286] Output: User information stored in the database.

[1287] Step 3:

[1288] The terminal collects the user's daily message content and emoji usage information and periodically uploads it to the server.

[1289] Specific operation: Collects message content and emoji information from the messaging app and sends it to the server in batch processing.

[1290] Input: User's daily message content and emoji information.

[1291] Output: Collected data uploaded to the server.

[1292] Step 4:

[1293] The server analyzes the uploaded data and estimates the relationship between the user and each of the contacts.

[1294] What it does: It uses AI models to analyze message frequency and emoji usage to derive a relationship score.

[1295] Input: The message content and emoji information uploaded in Step 3.

[1296] Output: Relationship score between the user and each contact.

[1297] Step 5:

[1298] The server uses natural language processing technology to recognize the user's emotions from the message content and emoticons.

[1299] What it does: Analyzes message data using Transformer's sentiment-analysis pipeline.

[1300] Input: Message content and emoji information.

[1301] Output: Emotion recognition result (e.g. positive, negative).

[1302] Step 6:

[1303] The server generates and sends reminder notifications based on a time schedule.

[1304] Specific behavior: Checks the user's important dates, generates notifications and sends them to the user's device.

[1305] Input: Important dates for registered users.

[1306] Output: The reminder notification sent to the user.

[1307] Step 7:

[1308] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[1309] What it does: Generates and lists appropriate gift ideas based on past purchase history and relationship scores.

[1310] Input: User's gift-giving history and recipient preferences.

[1311] Output: A list of gift ideas.

[1312] Step 8:

[1313] The terminal presents the suggestion list to the user.

[1314] Specific behavior: A list of suggested gift ideas is displayed on the user's screen.

[1315] Input: Gift Ideas List.

[1316] Output: The suggestion list that is displayed to the user.

[1317] Step 9:

[1318] The server uses the user's emotions to further personalize emotion-based gift suggestions.

[1319] Specific operation: Further narrow down the best gift suggestions based on the emotion recognition results.

[1320] Input: Emotion recognition results and gift suggestion list.

[1321] Output: Best gift ideas based on emotions.

[1322] Step 10:

[1323] The terminal accepts inquiries from the user regarding the contents of the present and transmits them to the server.

[1324] Specific operation: Accepts user inquiries through a chat interface.

[1325] Input: The user's inquiry.

[1326] Output: The consultation content sent to the server.

[1327] Step 11:

[1328] The server analyzes the user's inquiry and generates a response.

[1329] What it does: It uses AI models to analyze the consultation and generate an appropriate response.

[1330] Input: The user's inquiry.

[1331] Output: The generated response.

[1332] Step 12:

[1333] If the user wishes to reserve a suggested gift or service, the terminal transmits this request to the server.

[1334] Specific operation: The user enters the reservation request and presses the submit button.

[1335] Input: The user's reservation preference.

[1336] Output: The reservation request sent to the server.

[1337] Step 13:

[1338] The server executes the reservation procedure and sends a confirmation to the terminal.

[1339] Specific operation: Executes the reservation procedure via an HTTP request and sends the results to the terminal.

[1340] Input: The user's reservation preference.

[1341] Output: Booking confirmation information.

[1342] Step 14:

[1343] The terminal collects feedback on gifts and after using the service and transmits it to the server.

[1344] Specific behavior: Display the feedback input interface and send the feedback entered by the user to the server.

[1345] Input: User feedback.

[1346] Output: Feedback sent to the server.

[1347] Step 15:

[1348] The server stores the received feedback in a database and uses it to improve the accuracy of future suggestions.

[1349] What it does: Analyzes the feedback, stores it in a database, and uses it to improve the accuracy of the AI ​​model.

[1350] Input: User feedback.

[1351] Output: Stored feedback and improved accuracy of the AI ​​model.

[1352] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1353] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1354] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1355] [Third embodiment]

[1356] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1357] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1358] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1359] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1360] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1361] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1362] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1363] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1364] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1365] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1366] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1367] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1368] This invention relates to an AI concierge system that runs on a messaging app, reminding users of important dates and suggesting appropriate gifts and services. An embodiment of this system will be described.

[1369] User registration and initial settings

[1370] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[1371] Data collection and analysis

[1372] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to a server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses an AI model to analyze this data and estimate the preferences of the user's friends and family.

[1373] Reminder execution

[1374] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[1375] Gift suggestions

[1376] Based on the user's past gift-giving history and the recipient's estimated preferences, the server generates gift suggestions for the user. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the terminal, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[1377] Consultation about gift contents

[1378] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry, generates an appropriate response, and sends it to the device. The device then displays the response to the user, allowing them to obtain the information they need.

[1379] Reservation procedure

[1380] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service collaboration with group companies. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[1381] Feedback and Improvements

[1382] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback can be used to improve the accuracy of future suggestions.

[1383] This system allows users to smoothly prepare for celebrations without forgetting important dates, and also supports users in choosing a gift that will please them by providing a variety of gift ideas and service suggestions tailored to their needs.

[1384] The processing flow will be explained below.

[1385] Step 1:

[1386] The user presses a button within the messaging app to launch the AI ​​concierge service.

[1387] Step 2:

[1388] The device displays an interface for entering basic user information (such as name, birthday, contact list, etc.).

[1389] Step 3:

[1390] The user enters the required information and presses the send button.

[1391] Step 4:

[1392] The terminal transmits the input information to the server.

[1393] Step 5:

[1394] The server stores the received user basic information in a database.

[1395] Step 6:

[1396] The device will notify the user that the initial setup is complete and the AI ​​concierge is available.

[1397] Step 7:

[1398] The terminal records the user's daily message contents and stamp usage information.

[1399] Step 8:

[1400] The device periodically uploads the recorded data to the server.

[1401] Step 9:

[1402] The server analyzes the collected message and stamp data and scores the user's relationship with each contact.

[1403] Step 10:

[1404] The server uses an AI model to estimate the preferences of the user's friends and family based on relationship scores.

[1405] Step 11:

[1406] The server checks the birthdays and anniversaries of the user's friends and family based on a time schedule.

[1407] Step 12:

[1408] The server generates a reminder notification before the event.

[1409] Step 13:

[1410] The terminal receives the reminder notification from the server and displays it to the user.

[1411] Step 14:

[1412] The user checks the reminder notification and considers the necessary action.

[1413] Step 15:

[1414] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[1415] Step 16:

[1416] The server creates a list of the generated gift ideas and transmits it to the terminal.

[1417] Step 17:

[1418] The terminal displays the suggestion list to the user.

[1419] Step 18:

[1420] The user reviews the list of suggestions and selects the gift ideas that interest them.

[1421] Step 19:

[1422] The user consults with an AI concierge through a chat interface about the gift contents.

[1423] Step 20:

[1424] The device sends the user's questions or requests to the server.

[1425] Step 21:

[1426] The server analyzes the user's inquiry and generates an appropriate response.

[1427] Step 22:

[1428] The terminal displays the response from the server to the user.

[1429] Step 23:

[1430] The user wishes to reserve a suggested gift or service.

[1431] Step 24:

[1432] The terminal transmits the user's reservation request to the server.

[1433] Step 25:

[1434] The server executes the reservation procedure through service collaboration between group companies.

[1435] Step 26:

[1436] The server sends a reservation confirmation to the terminal.

[1437] Step 27:

[1438] The terminal displays a reservation completion notice from the server to the user.

[1439] Step 28:

[1440] Users provide feedback after receiving gifts or using services.

[1441] Step 29:

[1442] The terminal sends the user's feedback to the server.

[1443] Step 30:

[1444] The server stores the feedback in a database to help improve the accuracy of future suggestions.

[1445] Example 1

[1446] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1447] It is difficult for users to select appropriate gifts and services and provide them in a timely manner without worrying about forgetting important dates. It is also difficult for users to accurately understand the preferences of their friends and family and choose gifts that will please them. In addition, there are problems such as the time and effort required for reservation procedures and feedback management.

[1448] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1449] In this invention, the server includes means for registering the user's personal information, means for collecting the user's daily communication content and stamp usage information, means for analyzing the collected data and evaluating the relationship between the user and each recipient, means for generating and sending reminder notifications based on a schedule, means for generating gift ideas based on past gift-giving history and the recipient's preferences, means for presenting a list of suggestions to the user, means for accepting inquiries about gift ideas from the user and generating responses, means for accepting user reservation requests and reserving services, and means for collecting feedback after gifts and service use. This allows users to remember important dates and provide gifts and services that will please their recipients. Furthermore, reservations and feedback can be managed efficiently.

[1450] The "means for registering user's personal information" is a function for inputting and saving personal information such as the user's name, birthday, contact list, etc.

[1451] The "means for collecting information on the user's daily communication content and stamp usage" is a function for automatically capturing and recording the messages sent by the user and the stamp usage history.

[1452] The "means for analyzing collected data and evaluating the relationship between the user and each party" refers to an algorithm for quantifying and evaluating the relationship between the user and other people based on collected communication and stamp information.

[1453] The "means for generating and sending reminder notifications based on a schedule" is a function for generating and sending reminders for important dates to the user.

[1454] The "means for generating gift suggestions based on past gift history and the recipient's preferences" is an algorithm for creating optimal gift suggestions based on past gift data and the recipient's preferences.

[1455] The "means for presenting a proposal list to a user" is a function for displaying the generated gift proposal list on the user's screen.

[1456] The "means for accepting inquiries from users regarding gift contents and generating a response" is a function for generating and replying to an inquiry from a user regarding a specific gift.

[1457] The "means for accepting a user's reservation request and reserving a service" is a function for executing the reservation procedure for a gift or service selected by the user.

[1458] The "means for collecting feedback after using a gift or service" is a function for users to input and collect their impressions and evaluations after using a gift or service.

[1459] This invention relates to an AI concierge system that runs on a messaging app, reminding users of important dates and suggesting appropriate gifts and services. Specific embodiments of this system are described below.

[1460] User registration and initial settings

[1461] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[1462] Data collection and analysis

[1463] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to a server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses an AI model to analyze this data and estimate the preferences of the user's friends and family.

[1464] Reminder execution

[1465] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[1466] Gift suggestions

[1467] Based on the user's past gift-giving history and the recipient's estimated preferences, the server generates gift suggestions for the user. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the terminal, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[1468] Consultation about gift contents

[1469] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry, generates an appropriate response, and sends it to the device. The device then displays the response to the user, allowing them to obtain the information they need.

[1470] Reservation procedure

[1471] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service integration with an external company. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[1472] Feedback and Improvements

[1473] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback can be used to improve the accuracy of future suggestions.

[1474] Specific examples of hardware and software to be used

[1475] The server uses Python scripts to store data in database systems such as MySQL, and TensorFlow and PyTorch are used to build AI models. The terminal communicates via the HTTPS protocol, and the user interface is constructed using JavaScript and HTML.

[1476] Examples of specific examples and prompts

[1477] The user starts the AI ​​concierge service.

[1478] Example: A user opens a messaging app, enters basic information to use an AI concierge service, and submits.

[1479] Example prompt: "The user wants to choose a gift for a friend's birthday. Generate a list of gift suggestions and display them to the user."

[1480] With the above configuration, this invention is a system that enables users to efficiently select a gift that will please the recipient, make a reservation, and even provide feedback afterwards, without forgetting important dates.

[1481] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1482] Step 1:

[1483] The user starts the service

[1484] A user launches an existing messaging app and clicks the AI ​​concierge service button, which prompts the device to display the basic information entry screen.

[1485] Input: Click on AI Concierge Service button

[1486] Output: Display of basic information input screen

[1487] Step 2:

[1488] The device displays a screen for entering basic information.

[1489] The device displays a form prompting the user for their name, birthdate, and contact list, including text boxes and drop-down menus.

[1490] Input: A template for the basic information input screen provided by the server

[1491] Output: The basic information input screen is displayed in the user interface.

[1492] Step 3:

[1493] The user enters information and submits it.

[1494] The user enters the necessary information and presses the send button, which gives the terminal an input to "send the entered information."

[1495] Input: Basic information entered by the user (name, date of birth, contact list)

[1496] Output: The entered information is sent to the terminal

[1497] Step 4:

[1498] The device sends the information to the server

[1499] The device sends the information entered by the user to the server, where the data is transmitted securely using the HTTPS protocol.

[1500] Input: Basic information submitted by the user

[1501] Output: Information sent to the server

[1502] Step 5:

[1503] The server stores the information in a database

[1504] The server saves the received user information in a database, such as MySQL.

[1505] Input: Basic user information sent from the device

[1506] Output: Information is saved in a database

[1507] Step 6:

[1508] The server notifies you that the initial setup is complete.

[1509] The server notifies the terminal that the initial settings are complete, and generates a response message and sends it to the terminal.

[1510] Input: User information stored in the database

[1511] Output: Initialization completion notification is sent to the terminal

[1512] Step 7:

[1513] The device notifies you that the service is available

[1514] The device will inform the user that the service is available and will display a pop-up message saying "Initial setup completed."

[1515] Input: Initial setup completion notification from the server

[1516] Output: Service availability notification displayed in the user interface

[1517] Step 8:

[1518] The device records message and stamp usage information.

[1519] The device automatically records the user's daily message and stamp usage information, which is periodically sent to the server.

[1520] Input: User communication content and stamp usage information

[1521] Output: Usage information recorded on the device

[1522] Step 9:

[1523] The device uploads data to the server

[1524] The device sends the recorded data to the server at regular intervals. The data is transmitted securely using the HTTPS protocol.

[1525] Input: Usage information recorded on the device

[1526] Output: Data uploaded to the server

[1527] Step 10:

[1528] The server scores the data

[1529] The server scores messages based on message counts, stamp usage frequency, and shared event information. It uses Python scripts for data analysis and scoring.

[1530] Input: Uploaded message and stamp data

[1531] Output: Relationship score between the user and each contact

[1532] Step 11:

[1533] The server analyzes the data using an AI model

[1534] The server uses AI models to estimate the preferences of the user's friends and family, using frameworks such as TensorFlow and PyTorch.

[1535] Input: Relationship data between the user and each contact

[1536] Output: Estimated preferences of the user's friends and family

[1537] Step 12:

[1538] The server generates a reminder notification

[1539] The server generates reminder notifications based on a pre-defined time schedule, and creates reminders using notification message templates.

[1540] Input: Time schedule and important dates retrieved from database

[1541] Output: The generated reminder notification

[1542] Step 13:

[1543] The server sends a reminder notification to the device.

[1544] The server sends the generated reminder notification to the device via the HTTPS protocol.

[1545] Input: The generated reminder notification

[1546] Output: Reminder notification sent to device

[1547] Step 14:

[1548] The device displays a reminder notification

[1549] The device will display reminder notifications to the user, either via the notification center or as a pop-up message.

[1550] Input: Reminder notification sent from the server

[1551] Output: Reminder notification displayed in the user interface

[1552] Step 15:

[1553] The server generates gift ideas

[1554] The server generates gift suggestions based on the user's past gift history and the preferences of their friends and family. It uses a generative AI model to select and generate gift candidates.

[1555] Input: Gift history and preference data from a database

[1556] Output: Generated gift ideas

[1557] Step 16:

[1558] The server sends gift ideas to the device

[1559] The server sends the generated gift ideas to the device in JSON format.

[1560] Input: Generated gift idea

[1561] Output: Gift idea sent to device

[1562] Step 17:

[1563] The device displays gift ideas

[1564] The terminal displays the gift suggestions to the user. A list of gift suggestions is displayed on the user interface.

[1565] Input: Gift offer sent from server

[1566] Output: Gift ideas displayed in a user interface

[1567] Step 18:

[1568] The user checks and selects gift ideas

[1569] The user checks the displayed gift ideas and selects one that they are interested in. The next step is then performed based on the selected idea.

[1570] Input: List of suggested gift ideas

[1571] Output: Selected gift ideas

[1572] Step 19:

[1573] The user asks for a gift consultation

[1574] Users can discuss gifts through a chat interface, where they can type and submit questions about a particular gift.

[1575] Enter: Giveaway Question

[1576] Output: The consultation details are displayed on the terminal.

[1577] Step 20:

[1578] The device sends the consultation details to the server

[1579] The terminal sends the user's consultation details to the server as text data.

[1580] Input: User's inquiry

[1581] Output: Consultation details sent to the server

[1582] Step 21:

[1583] The server analyzes the consultation content

[1584] The server analyzes the received consultation content using natural language processing (NLP) technology.

[1585] Input: Consultation details sent by the user

[1586] Output: Parsed consultation content

[1587] Step 22:

[1588] The server generates an appropriate response

[1589] Based on the analysis results, the server generates an appropriate response to the user's inquiry.

[1590] Input: Parsed consultation content

[1591] Output: The generated response

[1592] Step 23:

[1593] The server sends the response to the device

[1594] The server generates a response and sends it to the terminal. The response is sent in text format.

[1595] Input: The generated response

[1596] Output: Response sent to the terminal

[1597] Step 24:

[1598] The terminal displays the response

[1599] The terminal displays the response to the user. The response message is displayed in the chat box.

[1600] Input: The response sent by the server

[1601] Output: The response displayed in the user interface

[1602] Step 25:

[1603] The user wishes to make a reservation

[1604] A user wishes to reserve a gift or service. The user selects the option they wish to reserve and presses the reservation button.

[1605] Input: User's reservation request

[1606] Output: Reservation request data is sent to the terminal

[1607] Step 26:

[1608] The device sends a reservation request to the server

[1609] The terminal sends the reservation request data to the server, which is then used by the reservation management system.

[1610] Input: User's reservation request data

[1611] Output: Reservation request data sent to the server

[1612] Step 27:

[1613] The server executes the reservation procedure.

[1614] The server executes the relevant reservation procedures and manages reservations using the service API of an external company.

[1615] Input: Reservation request data sent from the terminal

[1616] Output: Reservation procedure performed

[1617] Step 28:

[1618] The server sends the reservation confirmation information

[1619] After the reservation is completed, the server sends confirmation information to the terminal. The confirmation information is sent in JSON format.

[1620] Input: Booking procedure completion data

[1621] Output: Booking confirmation sent to the device

[1622] Step 29:

[1623] The device displays confirmation information

[1624] The terminal displays the reservation confirmation information to the user. The user interface displays a reservation completion message.

[1625] Input: Reservation confirmation information sent from the server

[1626] Output: Booking confirmation information displayed in the user interface

[1627] Step 30:

[1628] Users provide feedback

[1629] After using the gift or service, the user provides feedback by filling out the evaluation form and pressing the submit button.

[1630] Input: User feedback

[1631] Output: Feedback is sent to the device

[1632] Step 31:

[1633] The device sends feedback to the server

[1634] The terminal transmits the feedback information to the server, and the transmitted data is used in the feedback management system.

[1635] Input: User feedback

[1636] Output: Feedback data sent to the server

[1637] Step 32:

[1638] The server stores the feedback in a database

[1639] The server stores the feedback information in a database, which is used to improve the accuracy of the next proposal.

[1640] Input: Feedback data sent from the device

[1641] Output: Feedback stored in a database

[1642] Step 33:

[1643] The server improves based on feedback

[1644] The server will use the collected feedback to improve its next suggestion, feeding the feedback data into the AI ​​model to improve prediction accuracy.

[1645] Input: Feedback stored in the database

[1646] Output: An improved AI model reflected in the next proposal

[1647] These steps allow the entire system to remember important dates, provide appropriate gifts and services, and efficiently manage booking procedures and feedback.

[1648] (Application example 1)

[1649] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1650] Conventional AI concierge systems that run on messaging apps suggest gifts and services for friends and family based on the user's basic information, but the suggestions are limited, making it difficult to meet the diverse needs of users.In addition, when users make purchases in physical stores, they are unable to make timely suggestions about the most suitable products and services, which results in an inefficient purchasing experience.

[1651] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1652] In this invention, the server includes means for registering basic information about the user, means for collecting the user's daily message content and stamp usage information, means for analyzing the collected data and estimating the relationship between the user and each recipient, means for generating and sending reminder notifications based on a time schedule, means for generating gift ideas based on past gift-giving history and the recipient's preferences, means for presenting a list of ideas to the user, means for accepting inquiries about gift ideas from the user and generating responses, means for accepting user reservation requests and reserving services, means for collecting feedback after gifts and service usage, and means for collecting user behavior data in physical stores and making product suggestions in real time. This enables suggestions to be made according to the user's diverse needs, and also enables timely suggestions of optimal products and services in physical stores, thereby improving the purchasing experience.

[1653] 1. "Means for registering basic user information" refers to the means for sending personal information entered by the user into the application, such as name, birthday, and product categories of interest, to a cloud server and storing it in a database.

[1654] 2. "Means for collecting daily message content and stamp usage information of users" refers to the means for recording messages sent and received by users through messaging apps and stamp usage and sending this information to a server.

[1655] 3. "Means of analyzing collected data and estimating the relationship between the user and each person" refers to a means of using an AI model to score the degree of intimacy between the user and each person based on the collected message content and stamp usage information.

[1656] 4. "Means for generating and sending reminder notifications based on a time schedule" refers to a means for setting important dates (such as birthdays and anniversaries) for a user in advance and sending notifications to the user when those dates approach.

[1657] 5. "Means for generating gift suggestions based on past gift history and the recipient's preferences" refers to means for generating appropriate gift suggestions based on gifts the user has previously given and the recipient's estimated preferences.

[1658] 6. "Means for presenting a proposal list to a user" refers to means for displaying the generated gift proposals in list form on the user's device.

[1659] 7. "Means for accepting inquiries from users regarding gift contents and generating a response" refers to the means by which a user inputs the inquiry content about a specific gift within the app, and the AI ​​generates an appropriate response to that inquiry.

[1660] 8. "Means for accepting a user's reservation request and reserving a service" refers to the means for carrying out the reservation procedure through the server when a user wishes to reserve a suggested gift or service.

[1661] 9. "Means for collecting feedback after using a gift or service" refers to a means for having users input their satisfaction and opinions after using a gift or service, and then sending and storing that information on a server.

[1662] 10. "Means for collecting user behavioral data in physical stores and making product suggestions in real time" refers to a means for recording behavioral data such as the sales areas visited by users in physical stores and the products tried on by users, and then proposing optimal products and services in real time based on that data.

[1663] This invention applies an AI concierge system that runs on existing messaging apps to brick-and-mortar stores to meet the diverse needs of users. This system registers basic user information and estimates the relationship between the user and each contact by collecting and analyzing daily message content and stamp usage information. It then generates and sends reminder notifications based on a time schedule, and generates and presents gift suggestions based on past gift history and the recipient's preferences. It also accepts inquiries from users about gift ideas, generates appropriate responses, and accepts reservation requests to reserve services. Feedback is collected after gifts and service usage, and that information is used to improve the accuracy of future suggestions.

[1664] In the present invention, a means is added for collecting user behavior data even in physical stores and making product suggestions in real time. The specific configuration and operation process of this system are described below.

[1665] User registration and initial settings

[1666] The device (smartphone or tablet) displays an interface for the user to enter basic information (such as name, birthday, and product categories of interest). After the user enters and submits the information, the device sends it to the cloud server. The server stores the received information in a database and notifies the device that the initial settings are complete. The device then notifies the user that the service is now available for use.

[1667] Data collection and analysis

[1668] The device automatically records the user's daily message content and stamp usage information and periodically uploads it to a cloud server. The server uses an AI model (e.g., logistic regression) to analyze this data and score the user's relationship with each contact. Additionally, in physical stores, behavioral data such as the departments the user visited and the products they tried on is recorded and sent to the server.

[1669] Reminder execution

[1670] The server checks the user's important dates (such as birthdays and anniversaries) based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The device displays the reminder notification to the user, and the user considers what action to take.

[1671] Gift suggestions

[1672] The server generates gift suggestions for the user based on the user's past gift history and the recipient's estimated preferences. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the terminal, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[1673] Consultation about gift contents

[1674] When a user asks the AI ​​concierge for advice about a particular gift through the chat interface, the device sends the request to the server. The server analyzes the user's request, generates an appropriate response, and sends it to the device. The device then displays the response to the user, allowing them to obtain the information they need.

[1675] Reservation procedure

[1676] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service collaboration with group companies. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[1677] Feedback and Improvements

[1678] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback can be used to improve the accuracy of future suggestions.

[1679] Examples of specific examples and prompts

[1680] For example, assume that user A's friend B's birthday is December 25th, and the initial data is registered. While A is shopping in a physical store, the AI ​​concierge detects that A is thinking about what gift to buy for B. In this case, the AI ​​will suggest the best gift idea by using the following prompt:

[1681] User ID: 12345

[1682] Important Date: 2023-12-25

[1683] Recent Date: 2023-10-01

[1684] Relationship score: 85

[1685] Interesting product categories: Fashion, Home appliances

[1686] In this way, the present invention allows users to smoothly prepare for celebrations without forgetting important dates, and also significantly improves convenience in physical stores by suggesting optimal products and services in real time.

[1687] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1688] Step 1: User registration and initial setup

[1689] The user launches the application on the device and enters basic information (such as name, birthday, and product categories of interest). The device then sends the entered information to the cloud server. The server stores the received information in a database and notifies the device that initial setup is complete. Input data: basic user information. Output data: notification that initial setup is complete.

[1690] Step 2: Collect message content and stamp usage information

[1691] In the messaging apps that users use daily, the device automatically records message content and stamp usage information. This information is periodically uploaded to a cloud server. The server stores the received data in a database. Input data: message content and stamp usage information. Output data: recorded data stored in the database.

[1692] Step 3: Data analysis and inferring relationships

[1693] The server analyzes the collected message content and stamp usage information using a generative AI model (such as Logistic Regression). During this process, it derives a relationship score between the user and each person. Input data: collected message content and stamp usage information. Output data: relationship score.

[1694] Step 4: Generate and send reminder notifications

[1695] The server checks the user's important dates based on the time schedule. If a relevant event is approaching, it generates a reminder notification and sends it to the device. The device displays the reminder notification to the user. Input data: time schedule and important dates. Output data: reminder notification.

[1696] Step 5: Generate gift ideas

[1697] The server generates gift suggestions for the user based on the user's past gift history and the recipient's estimated preferences. The suggestions include physical gifts, travel plans, restaurant reservations, and other services. The generated suggestion list is sent to the device, which displays it to the user. Input data: past gift history, recipient's preferences. Output data: suggestion list.

[1698] Step 6: Accepting gift content inquiries and generating a response

[1699] When a user uses the chat interface to ask for advice about a particular gift, the device sends the advice to the server. The server analyzes the advice, generates an appropriate response, and sends it to the device. The device displays the generated response to the user. Input data: advice. Output data: response.

[1700] Step 7: Booking process

[1701] When a user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server executes the reservation procedure through service collaboration between group companies, and sends confirmation information to the device after the reservation is completed. The device displays the confirmation information to the user. Input data: reservation request. Output data: reservation confirmation information.

[1702] Step 8: Gather feedback

[1703] After the user uses a gift or service, the device sends the user's feedback to the server. The server stores the feedback in a database and uses it to improve the accuracy of the next suggestion. Input data: Feedback content. Output data: Improved suggestion content.

[1704] Step 9: Collecting behavioral data in physical stores and making product recommendations

[1705] When a user visits a physical store, the device records the user's behavioral data (which departments they visited, which products they tried on, etc.). This data is sent to a cloud server in real time, and the server uses an AI model to suggest optimal products and services, which are then sent to the device. The device then displays the suggestions to the user. Input data: behavioral data from the physical store. Output data: real-time product suggestions.

[1706] This allows users to not only receive highly accurate suggestions derived from past data, but also enjoy real-time suggestions for optimal products and services when making purchases in physical stores.

[1707] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1708] This invention relates to an AI concierge system that runs on a messaging app, reminding users of important dates and suggesting appropriate gifts and services. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to provide more personalized suggestions. An embodiment of this system will be described.

[1709] User registration and initial settings

[1710] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[1711] Data collection and analysis

[1712] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to a server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses an AI model to analyze this data and estimate the preferences of the user's friends and family.

[1713] emotion recognition

[1714] The emotion engine recognizes emotions from users' daily message content and stamp usage information. This process utilizes natural language processing technology and emotion analysis algorithms. Based on the user's emotions, gift suggestions and reminder notifications are more individually optimized.

[1715] Reminder execution

[1716] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The emotion engine adjusts the content and timing of the reminder notification. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[1717] Gift suggestions

[1718] The server generates gift suggestions for the user based on the user's past gift-giving history and the recipient's estimated preferences. The emotion engine recognizes the user's emotions and provides more appropriate gift suggestions. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the device, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[1719] Consultation about gift contents

[1720] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry and generates an appropriate response using the emotion engine. The device then displays the generated response to the user, allowing them to obtain the information they need.

[1721] Reservation procedure

[1722] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service collaboration with group companies. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[1723] Feedback and Improvements

[1724] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback is used to improve the accuracy of future suggestions. The emotion engine is also used to analyze the feedback and make improvements to provide a better user experience.

[1725] Such a system will help users to plan celebrations smoothly without forgetting important dates, and will also help them choose gifts that will please their recipients by providing personalized suggestions that take into account the user's emotions.

[1726] The processing flow will be explained below.

[1727] Step 1:

[1728] The user presses a button within the messaging app to launch the AI ​​concierge service.

[1729] Step 2:

[1730] The device displays an interface for entering basic user information (such as name, birthday, contact list, etc.).

[1731] Step 3:

[1732] The user enters the required information and presses the send button.

[1733] Step 4:

[1734] The terminal transmits the input information to the server.

[1735] Step 5:

[1736] The server stores the received user basic information in a database.

[1737] Step 6:

[1738] The device will notify the user that the initial setup is complete and the AI ​​concierge is available.

[1739] Step 7:

[1740] The terminal records the user's daily message contents and stamp usage information.

[1741] Step 8:

[1742] The device periodically uploads the recorded data to the server.

[1743] Step 9:

[1744] The server analyzes the collected message and stamp data and scores the user's relationship with each contact.

[1745] Step 10:

[1746] The server uses an AI model to estimate the preferences of the user's friends and family based on relationship scores.

[1747] Step 11:

[1748] The emotion engine recognizes the user's emotion from the message content and stamp usage information.

[1749] Step 12:

[1750] The emotion engine transmits the user's emotion data recognized to the server.

[1751] Step 13:

[1752] The server checks the birthdays and anniversaries of the user's friends and family based on a time schedule.

[1753] Step 14:

[1754] The server generates a reminder notification before the event.

[1755] Step 15:

[1756] The emotion engine adjusts the content and timing of reminder notifications.

[1757] Step 16:

[1758] The terminal receives the reminder notification from the server and displays it to the user.

[1759] Step 17:

[1760] The user checks the reminder notification and considers the necessary action.

[1761] Step 18:

[1762] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[1763] Step 19:

[1764] To provide more appropriate gift suggestions based on the user's emotions recognized by an emotion engine.

[1765] Step 20:

[1766] The server creates a list of the generated gift ideas and transmits it to the terminal.

[1767] Step 21:

[1768] The terminal displays the suggestion list to the user.

[1769] Step 22:

[1770] The user reviews the list of suggestions and selects the gift ideas that interest them.

[1771] Step 23:

[1772] The user consults with an AI concierge through a chat interface about the gift contents.

[1773] Step 24:

[1774] The device sends the user's questions or requests to the server.

[1775] Step 25:

[1776] The server analyzes the user's inquiry and generates an appropriate response using an emotion engine.

[1777] Step 26:

[1778] The terminal displays the response from the server to the user.

[1779] Step 27:

[1780] The user wishes to reserve a suggested gift or service.

[1781] Step 28:

[1782] The terminal transmits the user's reservation request to the server.

[1783] Step 29:

[1784] The server executes the reservation procedure through service collaboration between group companies.

[1785] Step 30:

[1786] The server sends a reservation confirmation to the terminal.

[1787] Step 31:

[1788] The terminal displays a reservation completion notice from the server to the user.

[1789] Step 32:

[1790] Users provide feedback after receiving gifts or using services.

[1791] Step 33:

[1792] The terminal sends the user's feedback to the server.

[1793] Step 34:

[1794] The server stores the feedback in a database and uses the emotion engine to improve the accuracy of future suggestions.

[1795] Example 2

[1796] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1797] Conventional reminder systems and gift suggestion systems make uniform suggestions without considering the user's emotional state or relationships, which means they cannot respond to individual situations. Another issue is that user feedback is not easily reflected in the next suggestion, which prevents the quality of the user experience from improving. Furthermore, there are many cases where the system does not provide appropriate responses when users ask for advice on gift selection or service reservations, which raises concerns about a decline in user satisfaction.

[1798] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1799] In this invention, the server includes means for registering basic user information, means for collecting the user's daily message content and stamp usage information, means for analyzing the collected data and estimating the user's relationship with each recipient, means for generating and sending reminder notifications based on a time schedule, means for generating gift suggestions based on the user's past gift history and the recipient's preferences, means for presenting a list of suggestions to the user, means for recognizing the user's emotional state using an emotion engine and optimizing the suggestions, means for accepting inquiries from the user regarding gift suggestions and generating responses, means for accepting the user's reservation requests and reserving services, and means for collecting feedback after purchasing gifts and using services. This enables personalized suggestions that take the user's emotions and relationships into consideration. Furthermore, by reflecting the feedback in the next suggestions, the user experience can be continuously improved. Furthermore, by generating appropriate responses to the user's inquiries, user satisfaction can be increased.

[1800] "Basic user information" refers to information that identifies an individual, such as name, birthday, and contact list.

[1801] "Message content" refers to sentences or text data that a user exchanges with others on a daily basis.

[1802] "Stamp usage information" is information about digital items such as emojis and illustrations that users use within messaging apps.

[1803] A "server" is a centralized computer system that collects, stores, analyzes, and processes user data.

[1804] An "emotion engine" is a system that uses natural language processing technology and emotion analysis algorithms to recognize a user's emotional state.

[1805] A "remind notification" is a notification message that notifies the user that an important date or event is approaching.

[1806] "Gift history" is information about gifts that a user has given to others in the past.

[1807] The "relationship score" is a numerical representation of the strength of the relationship between the user and each person, and is calculated based on the number of messages, frequency of stamp use, shared event information, and the like.

[1808] A "gift idea" is a gift suggestion that a user can give to another person, including a physical gift or a service (such as a travel plan or restaurant reservation).

[1809] The "proposal list" is a list of generated gift proposals that is presented to the user.

[1810] The "means for generating a response" is a system for analyzing the content of the user's inquiry and providing an appropriate response.

[1811] The "means for accepting reservation requests" is a system for accepting and processing reservation requests for gifts or services desired by users.

[1812] "Feedback" refers to the user providing their impressions and evaluations of the gifts and services they have used.

[1813] "Partner Companies" are external companies that work with this system to provide services and gifts.

[1814] A "generative AI model" is an artificial intelligence algorithm or model that generates optimal suggestions for users from collected data.

[1815] MODE FOR CARRYING OUT THE INVENTION

[1816] This invention is an AI concierge system that runs on a messaging app. It reminds users of important dates and suggests appropriate gifts and services. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to provide more personalized suggestions. The following describes an embodiment of the invention.

[1817] User registration and initial settings

[1818] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[1819] Data collection and analysis

[1820] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to the server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses a generative AI model to analyze this data and estimate the preferences of the user's friends and family.

[1821] emotion recognition

[1822] The emotion engine recognizes emotions from users' daily message content and stamp usage information. This process utilizes natural language processing technology and emotion analysis algorithms. Based on the user's emotions, gift suggestions and reminder notifications are more individually optimized.

[1823] Reminder execution

[1824] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The emotion engine adjusts the content and timing of the reminder notification. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[1825] Gift suggestions

[1826] The server generates gift suggestions for the user based on the user's past gift-giving history and the recipient's estimated preferences. The emotion engine recognizes the user's emotions and provides more appropriate gift suggestions. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the device, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[1827] Consultation about gift contents

[1828] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry and generates an appropriate response using the emotion engine. The device then displays the generated response to the user, allowing them to obtain the information they need.

[1829] Reservation procedure

[1830] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server, which then executes the reservation procedure through the services of a partner company. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[1831] Feedback and Improvements

[1832] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback is used to improve the accuracy of future suggestions. The emotion engine is also used to analyze the feedback and make improvements to provide a better user experience.

[1833] As a concrete example, here is an example of a prompt for a generative AI model:

[1834] "What interface should be provided for users to enter the information needed to complete the initial setup?"

[1835] "How can we calculate a relationship score based on a user's daily message data and stamp information?"

[1836] "What natural language processing techniques and sentiment analysis algorithms are best suited to recognizing emotions from user message content?"

[1837] "What's the best way to determine the best timing and content for reminding users about important dates?"

[1838] "When providing gift suggestions to users, how can we present them with the most appropriate choices based on their past history and current emotional state?"

[1839] "When a user asks for a gift, how can AI generate the most appropriate response?"

[1840] "What is the best process to streamline the process for users to book gifts and services?"

[1841] "How can we use user-provided feedback to improve the accuracy of our next suggestions?"

[1842] This allows users to plan their celebrations smoothly without forgetting important dates. In addition, personalized suggestions that take into account the user's emotions can help users choose a gift that will please the recipient.

[1843] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1844] Step 1:

[1845] Enter and submit basic user information

[1846] In order for a user to start the AI ​​concierge service, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). When the user enters information into this interface and presses the "Send" button, the entered data is sent from the device to the server. The server saves the received information in a database and sends a notification to the device that initial setup is complete. The input data includes name, birthday, contact list, etc., and the output is saving the information to the database and a notification that initial setup is complete. As a specific example, consider the case where a user enters their name as "Taro Tanaka," their birthday as "January 1, 1990," and their contact list as "Hanako Yamada, Ichiro Suzuki."

[1847] Step 2:

[1848] Recording message content and stamp usage information

[1849] During daily use, the device automatically records the content of messages sent by the user and information on stamps used. This data is uploaded to the server periodically (for example, late at night every day). The input is the content of daily messages and stamp usage information, and the output is the uploading of the recorded data to the server. As a concrete example, consider the case where a user sends a message saying "Good morning" to a friend "Yamada Hanako" and uses a stamp.

[1850] Step 3:

[1851] Relationship Scoring

[1852] The server scores the relationship between the user and each person based on the uploaded message content and stamp usage information. The input is the recorded message content and stamp usage information, and the output is the relationship score between the user and each person. Data processing involves aggregating the number of messages, frequency of stamp usage, shared event information, etc., and calculating an overall relationship score. As a specific example, let's take a case where the server calculates a relationship score of "85 points" based on the number of messages between "Taro Tanaka and Hanako Yamada" (10 times), frequency of stamp usage (5 times), and shared events (3).

[1853] Step 4:

[1854] emotion recognition

[1855] The emotion engine recognizes the user's emotions based on the message content and stamp usage information uploaded to the server. This process uses natural language processing technology and emotion analysis algorithms. The input is the uploaded text data and stamp usage information, and the output is the recognition result of the emotional state (e.g., positive, negative, etc.). As a concrete example, if a user sends a message saying "I had fun today," the emotion engine will recognize this as "positive."

[1856] Step 5:

[1857] Generate and send reminder notifications

[1858] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule, and if a relevant event is approaching, it generates a reminder notification and sends it to the device. The input is the user's time schedule and event information, and the output is the generated reminder notification. As a specific example, let's consider a case where the server confirms that "Yamada Hanako's birthday is in one week," and generates and sends a reminder notification saying "Yamada Hanako's birthday is in one week" to the device.

[1859] Step 6:

[1860] Generate and present gift offers

[1861] The server generates gift suggestions based on the user's past gift history and estimated preferences. During this process, an emotion engine optimizes the suggestions based on the user's emotional state. The generated suggestion list is sent to the device, which displays it to the user. The input is the user's past gift history and emotional state, and the output is the generated gift suggestion list. As a concrete example, consider a case where the server previously selected "cosmetic set" and this time selected "aroma diffuser" as the suggestion, and displays the suggestion list "aroma diffuser, spa ticket, cake set" to the user.

[1862] Step 7:

[1863] Gift content consultation and response generation

[1864] When a user consults an AI concierge about a specific gift through a chat interface, the device sends this to the server. The server analyzes the content of the consultation and, using an emotion engine, generates an appropriate response, which it then sends to the device. The input is the user's consultation, and the output is the generated response. As a concrete example, let's consider a case where a user asks, "What kind of aroma diffuser would be good for Yamada Hanako?" and the server replies, "I recommend a relaxing scent. A lavender aroma diffuser would be good."

[1865] Step 8:

[1866] Submit your reservation request and complete the procedure

[1867] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through the services of an affiliated company, and once completed, sends confirmation information to the device. The input is the user's reservation request, and the output is the completed reservation information. As a specific example, consider the case where the user selects "I would like to reserve a spa ticket," and the server accesses the spa's reservation system to complete the reservation, and notifies the device that "Your spa ticket reservation has been completed."

[1868] Step 9:

[1869] Feedback collection and analysis

[1870] After receiving a gift or using a service, the user sends feedback from their device to the server. The server stores the feedback in a database and uses it to improve the accuracy of the next suggestion. The emotion engine also uses it to analyze the feedback. The input is the user's feedback, and the output is the analysis results and improvements for the next suggestion. As a concrete example, let's say a user sends feedback saying "The spa ticket was great," and the server saves it as "95% satisfaction" and reflects it in the next suggestion.

[1871] (Application example 2)

[1872] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1873] In conventional messaging applications, users tend to forget important anniversaries, making it difficult to suggest personalized gifts and services based on emotions.In addition, the lack of functionality to make optimal suggestions taking users' emotions into account made improving user satisfaction a challenge.

[1874] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1875] In this invention, the server includes means for registering basic information about the user, means for collecting the user's daily message content and emoji usage information, means for analyzing the collected data and estimating the relationship between the user and each recipient, means for generating and sending reminder notifications based on a time schedule, means for generating gift suggestions based on past gift-giving history and the recipient's preferences, means for presenting a suggestion list to the user, means for generating emotion-based gift suggestions using an emotion engine that recognizes the user's emotions, means for accepting inquiries about gift content from the user and generating responses, means for accepting user reservation requests and reserving services, and means for collecting feedback after using gifts and services. This allows users to receive personalized gift and service suggestions based on their emotions without forgetting important anniversaries.

[1876] The "means for registering basic user information" is a means for collecting and registering basic information such as a user's name, birthday, and contact list.

[1877] The "means for collecting daily message content and emoticon usage information" is a means for automatically recording information on the content of a user's daily messages and the emoticons used.

[1878] "Means for analyzing collected data and inferring the relationship between the user and each contact" refers to means for analyzing collected data such as message content and emoji usage information, and for evaluating and inferring the relationship between the user and each contact based on that data.

[1879] The "means for generating and transmitting a reminder notification based on a time schedule" is a means for generating a reminder notification based on a preset schedule and transmitting it to the user's device.

[1880] "Means for generating gift suggestions based on past gift history and the recipient's preferences" refers to means for generating appropriate gift suggestions based on the user's past gift history and the recipient's preferences estimated from collected data.

[1881] The "means for presenting a proposal list to a user" is a means for displaying the generated gift proposals as a list on the user's device.

[1882] The "means for generating gift suggestions based on emotions using an emotion engine that recognizes the user's emotions" refers to a means for analyzing the content of a user's daily messages and emoji usage information to recognize emotions, and using an emotion engine to generate gift suggestions based on those emotions.

[1883] "Means for accepting inquiries from users regarding gift ideas and generating a response" refers to a means for analyzing the content of an inquiry made to an AI concierge by a user regarding a specific gift idea and generating an appropriate response.

[1884] The "means for accepting a user's reservation request and reserving a service" refers to a means for accepting a user's request and carrying out the reservation procedure when the user wishes to reserve a suggested gift or service.

[1885] The "means for collecting feedback after using a gift or service" refers to a means for collecting feedback such as the user's impression of use and satisfaction after using the gift or service provided.

[1886] "Means for providing physical gifts, travel plans, and restaurant reservations in collaboration with third-party companies' services" refers to means for providing services such as physical gifts, travel plans, and restaurant reservations to users through collaboration with other companies or service providers.

[1887] This invention relates to an AI concierge system that reminds users of important dates and suggests appropriate gifts and services. This system collects and analyzes basic information about users and makes suggestions that take their emotions into account.

[1888] System Overview

[1889] The system includes the following main components:

[1890] 1. User registration and initial settings

[1891] Displays an interface for registering basic user information (name, birthday, contact list, etc.).

[1892] The registered information is sent to a server and stored in a database.

[1893] 2. Data Collection and Analysis

[1894] Users' daily message content and emoji usage information is collected and periodically uploaded to the server.

[1895] The server analyzes the collected data using an AI model to estimate the relationship between the user and each contact.

[1896] 3. Emotion recognition

[1897] The emotion engine uses natural language processing technology to recognize the user's emotions from message content and emojis.

[1898] Personalize gift suggestions and reminders based on user sentiment.

[1899] 4. Reminder function

[1900] The server generates and sends reminder notifications when an event is approaching based on a time schedule.

[1901] The emotion engine adjusts the content and timing of reminder notifications.

[1902] 5. Gift Suggestions

[1903] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[1904] Provide more personalized gift suggestions based on emotion recognition.

[1905] 6. Discuss the gift contents

[1906] Users consult with an AI concierge through a chat interface.

[1907] The server analyzes the consultation and generates an appropriate response.

[1908] 7. Reservation Procedure

[1909] If the user wishes to reserve a suggested gift or service, the server executes the reservation procedure.

[1910] After the reservation is completed, the server sends confirmation information to the terminal and displays it.

[1911] 8. Feedback

[1912] Collect feedback from users after using the gift or service.

[1913] The server stores the feedback in a database and uses it to improve the accuracy of future suggestions.

[1914] Detailed technical explanation

[1915] Program processing:

[1916] The system is implemented using a Python program and uses the following hardware and software:

[1917] SQLite3: Database Management System

[1918] Transformers (Hugging Face): Natural Language Processing Library (Sentiment Analysis)

[1919] Requests: A library for making HTTP requests

[1920] Specific data processing and calculation:

[1921] User registration: Registered user information is stored in an SQLite3 database.

[1922] Message Analysis: Analyzes sentiment from daily message content using Transformers sentiment analysis pipeline.

[1923] Reminders: Use the Python datetime library to set reminders based on important dates.

[1924] Gift suggestions: Generate appropriate gift suggestions based on the user's relationship score and sentiment analysis results.

[1925] Reservation procedure: Reservation procedures for various services are carried out using HTTP requests.

[1926] Examples:

[1927] 1. User registration: User A enters their name, birthday, and contact information into the app and sends it to the server.

[1928] 2. Message analysis: When User B sends a message saying "I'm a little tired today," the sentiment analysis engine determines it as "negative."

[1929] 3. Reminder setting: User C's birthday is coming up in a week, so a reminder notification is generated.

[1930] 4. Gift Suggestion: Based on the results of sentiment analysis, we suggest a refreshing travel plan.

[1931] 5. Booking procedure: When user D books a sightseeing plan, the booking procedure is executed through an HTTP request.

[1932] Example prompt sentence:

[1933] As the user uses a messaging app, interpret the user's emotions from the following messages and suggest gifts and services based on those emotions.

[1934] Message: I'm a little tired today.

[1935] In this way, users can remember important dates and receive personalized gift and service suggestions based on their emotions.

[1936] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1937] Step 1:

[1938] The terminal displays an interface for inputting the user's basic information (name, birthday, contact list, etc.).

[1939] What happens: A user enters their name, birthdate, contact information, etc. and presses the submit button.

[1940] Input: User's name, birthdate, and contact list data.

[1941] Output: User information sent to the server.

[1942] Step 2:

[1943] The server stores the received basic information in a database.

[1944] Specific operation: Executes an INSERT query into the SQLite3 database to register the user's basic information.

[1945] Input: User information submitted in step 1.

[1946] Output: User information stored in the database.

[1947] Step 3:

[1948] The terminal collects the user's daily message content and emoji usage information and periodically uploads it to the server.

[1949] Specific operation: Collects message content and emoji information from the messaging app and sends it to the server in batch processing.

[1950] Input: User's daily message content and emoji information.

[1951] Output: Collected data uploaded to the server.

[1952] Step 4:

[1953] The server analyzes the uploaded data and estimates the relationship between the user and each of the contacts.

[1954] What it does: It uses AI models to analyze message frequency and emoji usage to derive a relationship score.

[1955] Input: The message content and emoji information uploaded in Step 3.

[1956] Output: Relationship score between the user and each contact.

[1957] Step 5:

[1958] The server uses natural language processing technology to recognize the user's emotions from the message content and emoticons.

[1959] What it does: Analyzes message data using Transformer's sentiment-analysis pipeline.

[1960] Input: Message content and emoji information.

[1961] Output: Emotion recognition result (e.g. positive, negative).

[1962] Step 6:

[1963] The server generates and sends reminder notifications based on a time schedule.

[1964] Specific behavior: Checks the user's important dates, generates notifications and sends them to the user's device.

[1965] Input: Important dates for registered users.

[1966] Output: The reminder notification sent to the user.

[1967] Step 7:

[1968] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[1969] What it does: Generates and lists appropriate gift ideas based on past purchase history and relationship scores.

[1970] Input: User's gift-giving history and recipient preferences.

[1971] Output: A list of gift ideas.

[1972] Step 8:

[1973] The terminal presents the suggestion list to the user.

[1974] Specific behavior: A list of suggested gift ideas is displayed on the user's screen.

[1975] Input: Gift Ideas List.

[1976] Output: The suggestion list that is displayed to the user.

[1977] Step 9:

[1978] The server uses the user's emotions to further personalize emotion-based gift suggestions.

[1979] Specific operation: Further narrow down the best gift suggestions based on the emotion recognition results.

[1980] Input: Emotion recognition results and gift suggestion list.

[1981] Output: Best gift ideas based on emotions.

[1982] Step 10:

[1983] The terminal accepts inquiries from the user regarding the contents of the present and transmits them to the server.

[1984] Specific operation: Accepts user inquiries through a chat interface.

[1985] Input: The user's inquiry.

[1986] Output: The consultation content sent to the server.

[1987] Step 11:

[1988] The server analyzes the user's inquiry and generates a response.

[1989] What it does: It uses AI models to analyze the consultation and generate an appropriate response.

[1990] Input: The user's inquiry.

[1991] Output: The generated response.

[1992] Step 12:

[1993] If the user wishes to reserve a suggested gift or service, the terminal transmits this request to the server.

[1994] Specific operation: The user enters the reservation request and presses the submit button.

[1995] Input: The user's reservation preference.

[1996] Output: The reservation request sent to the server.

[1997] Step 13:

[1998] The server executes the reservation procedure and sends a confirmation to the terminal.

[1999] Specific operation: Executes the reservation procedure via an HTTP request and sends the results to the terminal.

[2000] Input: The user's reservation preference.

[2001] Output: Booking confirmation information.

[2002] Step 14:

[2003] The terminal collects feedback on gifts and after using the service and transmits it to the server.

[2004] Specific behavior: Display the feedback input interface and send the feedback entered by the user to the server.

[2005] Input: User feedback.

[2006] Output: Feedback sent to the server.

[2007] Step 15:

[2008] The server stores the received feedback in a database and uses it to improve the accuracy of future suggestions.

[2009] What it does: Analyzes the feedback, stores it in a database, and uses it to improve the accuracy of the AI ​​model.

[2010] Input: User feedback.

[2011] Output: Stored feedback and improved accuracy of the AI ​​model.

[2012] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2013] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2014] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2015] [Fourth embodiment]

[2016] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2017] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2018] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2019] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2020] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2021] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2022] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2023] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2024] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2025] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2026] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2027] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2028] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2029] This invention relates to an AI concierge system that runs on a messaging app, reminding users of important dates and suggesting appropriate gifts and services. An embodiment of this system will be described.

[2030] User registration and initial settings

[2031] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[2032] Data collection and analysis

[2033] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to a server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses an AI model to analyze this data and estimate the preferences of the user's friends and family.

[2034] Reminder execution

[2035] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[2036] Gift suggestions

[2037] Based on the user's past gift-giving history and the recipient's estimated preferences, the server generates gift suggestions for the user. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the terminal, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[2038] Consultation about gift contents

[2039] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry, generates an appropriate response, and sends it to the device. The device then displays the response to the user, allowing them to obtain the information they need.

[2040] Reservation procedure

[2041] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service collaboration with group companies. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[2042] Feedback and Improvements

[2043] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback can be used to improve the accuracy of future suggestions.

[2044] This system allows users to smoothly prepare for celebrations without forgetting important dates, and also supports users in choosing a gift that will please them by providing a variety of gift ideas and service suggestions tailored to their needs.

[2045] The processing flow will be explained below.

[2046] Step 1:

[2047] The user presses a button within the messaging app to launch the AI ​​concierge service.

[2048] Step 2:

[2049] The device displays an interface for entering basic user information (such as name, birthday, contact list, etc.).

[2050] Step 3:

[2051] The user enters the required information and presses the send button.

[2052] Step 4:

[2053] The terminal transmits the input information to the server.

[2054] Step 5:

[2055] The server stores the received user basic information in a database.

[2056] Step 6:

[2057] The device will notify the user that the initial setup is complete and the AI ​​concierge is available.

[2058] Step 7:

[2059] The terminal records the user's daily message contents and stamp usage information.

[2060] Step 8:

[2061] The device periodically uploads the recorded data to the server.

[2062] Step 9:

[2063] The server analyzes the collected message and stamp data and scores the user's relationship with each contact.

[2064] Step 10:

[2065] The server uses an AI model to estimate the preferences of the user's friends and family based on relationship scores.

[2066] Step 11:

[2067] The server checks the birthdays and anniversaries of the user's friends and family based on a time schedule.

[2068] Step 12:

[2069] The server generates a reminder notification before the event.

[2070] Step 13:

[2071] The terminal receives the reminder notification from the server and displays it to the user.

[2072] Step 14:

[2073] The user checks the reminder notification and considers the necessary action.

[2074] Step 15:

[2075] The server generates gift suggestions based on the past gift history and the recipient's preferences.

[2076] Step 16:

[2077] The server creates a list of the generated gift ideas and transmits it to the terminal.

[2078] Step 17:

[2079] The terminal displays the suggestion list to the user.

[2080] Step 18:

[2081] The user reviews the list of suggestions and selects the gift ideas that interest them.

[2082] Step 19:

[2083] The user consults with an AI concierge through a chat interface about the gift contents.

[2084] Step 20:

[2085] The device sends the user's questions or requests to the server.

[2086] Step 21:

[2087] The server analyzes the user's inquiry and generates an appropriate response.

[2088] Step 22:

[2089] The terminal displays the response from the server to the user.

[2090] Step 23:

[2091] The user wishes to reserve a suggested gift or service.

[2092] Step 24:

[2093] The terminal transmits the user's reservation request to the server.

[2094] Step 25:

[2095] The server executes the reservation procedure through service collaboration between group companies.

[2096] Step 26:

[2097] The server sends a reservation confirmation to the terminal.

[2098] Step 27:

[2099] The terminal displays a reservation completion notice from the server to the user.

[2100] Step 28:

[2101] Users provide feedback after receiving gifts or using services.

[2102] Step 29:

[2103] The terminal sends the user's feedback to the server.

[2104] Step 30:

[2105] The server stores the feedback in a database to help improve the accuracy of future suggestions.

[2106] Example 1

[2107] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2108] It is difficult for users to select appropriate gifts and services and provide them in a timely manner without worrying about forgetting important dates. It is also difficult for users to accurately understand the preferences of their friends and family and choose gifts that will please them. In addition, there are problems such as the time and effort required for reservation procedures and feedback management.

[2109] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2110] In this invention, the server includes means for registering the user's personal information, means for collecting the user's daily communication content and stamp usage information, means for analyzing the collected data and evaluating the relationship between the user and each recipient, means for generating and sending reminder notifications based on a schedule, means for generating gift ideas based on past gift-giving history and the recipient's preferences, means for presenting a list of suggestions to the user, means for accepting inquiries about gift ideas from the user and generating responses, means for accepting user reservation requests and reserving services, and means for collecting feedback after gifts and service use. This allows users to remember important dates and provide gifts and services that will please their recipients. Furthermore, reservations and feedback can be managed efficiently.

[2111] The "means for registering user's personal information" is a function for inputting and saving personal information such as the user's name, birthday, contact list, etc.

[2112] The "means for collecting information on the user's daily communication content and stamp usage" is a function for automatically capturing and recording the messages sent by the user and the stamp usage history.

[2113] The "means for analyzing collected data and evaluating the relationship between the user and each party" refers to an algorithm for quantifying and evaluating the relationship between the user and other people based on collected communication and stamp information.

[2114] The "means for generating and sending reminder notifications based on a schedule" is a function for generating and sending reminders for important dates to the user.

[2115] The "means for generating gift suggestions based on past gift history and the recipient's preferences" is an algorithm for creating optimal gift suggestions based on past gift data and the recipient's preferences.

[2116] The "means for presenting a proposal list to a user" is a function for displaying the generated gift proposal list on the user's screen.

[2117] The "means for accepting inquiries from users regarding gift contents and generating a response" is a function for generating and replying to an inquiry from a user regarding a specific gift.

[2118] The "means for accepting a user's reservation request and reserving a service" is a function for executing the reservation procedure for a gift or service selected by the user.

[2119] The "means for collecting feedback after using a gift or service" is a function for users to input and collect their impressions and evaluations after using a gift or service.

[2120] This invention relates to an AI concierge system that runs on a messaging app, reminding users of important dates and suggesting appropriate gifts and services. Specific embodiments of this system are described below.

[2121] User registration and initial settings

[2122] When a user starts the AI ​​concierge service within a messaging app, the device displays an interface for entering the user's basic information (name, birthday, contact list, etc.). After the user enters and submits the information, the device sends it to the server. The server stores the received information in a database and notifies the device that the initial setup is complete. The device then notifies the user that the service is now available.

[2123] Data collection and analysis

[2124] The device automatically records the user's daily message content and stamp usage information. The recorded data is periodically uploaded to a server, which uses it to score the user's relationship with each person. The relationship score is derived based on the number of messages, frequency of stamp usage, shared event information, etc. The server uses an AI model to analyze this data and estimate the preferences of the user's friends and family.

[2125] Reminder execution

[2126] The server checks the birthdays and anniversaries of the user's friends and family based on the time schedule. If a relevant event is approaching, the server generates a reminder notification and sends it to the device. The device displays the reminder notification to the user, allowing the user to consider the necessary action.

[2127] Gift suggestions

[2128] Based on the user's past gift-giving history and the recipient's estimated preferences, the server generates gift suggestions for the user. These gift suggestions include not only physical gifts but also services such as travel plans and restaurant reservations. The generated suggestion list is sent to the terminal, which displays it to the user. The user can review the suggestion list and select the gift suggestions that interest them.

[2129] Consultation about gift contents

[2130] When a user wants to consult an AI concierge about a particular gift through the chat interface, the device sends this to the server. The server analyzes the user's inquiry, generates an appropriate response, and sends it to the device. The device then displays the response to the user, allowing them to obtain the information they need.

[2131] Reservation procedure

[2132] If the user wishes to reserve a suggested gift or service, the device sends the reservation request to the server. The server then executes the reservation procedure through service integration with an external company. After the reservation is completed, the server sends confirmation information to the device, which displays it to the user.

[2133] Feedback and Improvements

[2134] After receiving a gift or using a service, users can provide feedback. The device sends the user's feedback to the server, which stores it in a database. The collected feedback can be used to improve the accuracy of future suggestions.

[2135] Specific examples of hardware and software to be used

[2136] The server uses Python scripts to store data in database systems such as MySQL, and TensorFlow and PyTorch are used to build AI models. The terminal communicates via the HTTPS protocol, and the user interface is constructed using JavaScript and HTML.

[2137] Examples of specific examples and prompts

[2138] The user starts the AI ​​concierge service.

[2139] Example: A user opens a messaging app, enters basic information to use an AI concierge service, and submits.

[2140] Example prompt: "The user wants to choose a gift for a friend's birthday. Generate a list of gift suggestions and display them to the user."

[2141] With the above configuration, this invention is a system that enables users to efficiently select a gift that will please the recipient, make a reservation, and even provide feedback afterwards, without forgetting important dates.

[2142] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2143] Step 1:

[2144] The user starts the service

[2145] A user launches an existing messaging app and clicks the AI ​​concierge service button, which prompts the device to display the basic information entry screen.

[2146] Input: Click on AI Concierge Service button

[2147] Output: Display of basic information input screen

[2148] Step 2:

[2149] The device displays a screen for entering basic information.

[2150] The device displays a form prompting the user for their name, birthdate, and contact list, including text boxes and drop-down menus.

[2151] Input: A template for the basic information input screen provided by the server

[2152] Output: The basic information input screen is displayed in the user interface.

[2153] Step 3:

[2154] The user enters information and submits it.

[2155] The user enters the necessary information and presses the send button, which gives the terminal an input to "send the entered information."

[2156] Input: Basic information entered by the user (name, date of birth, contact list)

[2157] Output: The entered information is sent to the terminal

[2158] Step 4:

[2159] The device sends the information to the server

[2160] The device sends the information entered by the user to the server, where the data is transmitted securely using the HTTPS protocol.

[2161] Input: Basic information submitted by the user

[2162] Output: Information sent to the server

[2163] Step 5:

[2164] The server stores the information in a database

[2165] The server saves the received user information in a database, such as MySQL.

[2166] Input: Basic user information sent from the device

[2167] Output: Information is saved in a database

[2168] Step 6:

[2169] The server notifies you that the initial setup is complete.

[2170] The server notifies the terminal that the initial settings are complete, and generates a response message and sends it to the terminal.

[2171] Input: User information stored in the database

[2172] Output: Initialization completion notification is sent to the terminal

[2173] Step 7:

[2174] The device notifies you that the service is available

[2175] The device will inform the user that the service is available and will display a pop-up message saying "Initial setup completed."

[2176] Input: Initial setup completion notification from the server

[2177] Output: Service availability notification displayed in the user interface

[2178] Step 8:

[2179] The device records message and stamp usage information.

[2180] The device automatically records the user's daily message and stamp usage information, which is periodically sent to the server.

[2181] Input: User communication content and stamp usage information

[2182] Output: Usage information recorded on the device

[2183] Step 9:

[2184] The device uploads data to the server

[2185] The device sends the recorded data to the server at regular intervals. The data is transmitted securely using the HTTPS protocol.

[2186] Input: Usage information recorded on the device

[2187] Output: Data uploaded to the server

[2188] Step 10:

[2189] The server scores the data

[2190] The server scores messages based on message counts, stamp usage frequency, and shared event information. It uses Python scripts for data analysis and scoring.

[2191] Input: Uploaded message and stamp data

[2192] Output: Relationship score between the user and each contact

[2193] Step 11:

[2194] The server analyzes the data using an AI model

[2195] The server uses AI models to estimate the preferences of the user's friends and family, using frameworks such as TensorFlow and PyTorch.

[2196] Input: Relationship data between the user and each contact

[2197] Output: Estimated preferences of the user's friends and family

[2198] Step 12:

[2199] The server generates a reminder notification

[2200] The server generates reminder notifications based on a pre-defined time schedule, and creates reminders using notification message templates.

[2201] Input: Time schedule and important dates retrieved from database

[2202] Output: The generated reminder notification

[2203] Step 13:

[2204] The server sends a reminder notification to the device.

[2205] The server sends the generated reminder notification to the device via the HTTPS protocol.

[2206] Input: The generated reminder notification

[2207] Output: Reminder notification sent to device

[2208] Step 14:

[2209] The device displays a reminder notification

[2210] The device will display reminder notifications to the user, either via the notification center or as a pop-up message.

[2211] Input: Reminder notification sent from the server

[2212] Output: Reminder notification displayed in the user interface

[2213] Step 15:

[2214] The server generates gift ideas

[2215] The server generates gift suggestions based on the user's past gift history and the preferences of their friends and family. It uses a generative AI model to select and generate gift candidates.

[2216] Input: Gift history and preference data from a database

[2217] Output: Generated gift ideas

[2218] Step 16:

[2219] The server sends gift ideas to the device

[2220] The server sends the generated gift ideas to the device in JSON format.

[2221] Input: Generated gift idea

[2222] Output: Gift idea sent to device

[2223] Step 17:

[2224] The device displays gift ideas

[2225] The terminal displays the gift suggestions to the user. A list of gift suggestions is displayed on the user interface.

[2226] Input: Gift offer sent from server

[2227] Output: Gift ideas displayed in a user interface

[2228] Step 18:

[2229] The user checks and selects gift ideas

[2230] The user checks the displayed gift ideas and selects one that they are interested in. The next step is then performed based on the selected idea.

[2231] Input: List of suggested gift ideas

[2232] Output: Selected gift ideas

[2233] Step 19:

[2234] The user asks for a gift consultation

[2235] Users can discuss gifts through a chat interface, where they can type and submit questions about a particular gift.

[2236] Enter: Giveaway Question

[2237] Output: The consultation details are displayed on the terminal.

[2238] Step 20:

[2239] The device sends the consultation details to the server

[2240] The terminal sends the user's consultation details to the server as text data.

[2241] Input: User's inquiry

[2242] Output: Consultation details sent to the server

[2243] Step 21:

[2244] The server analyzes the consultation content

[2245] The server analyzes the received consultation content using natural language processing (NLP) technology.

[2246] Input: Consultation details sent by the user

[2247] Output: Parsed consultation content

[2248] Step 22:

[2249] The server generates an appropriate response

[2250] Based on the analysis results, the server generates an appropriate response to the user's inquiry.

[2251] Input: Parsed consultation content

[2252] Output: The generated response

[2253] Step 23:

[2254] The server sends the response to the device

[2255] The server generates a response and sends it to the terminal. The response is sent in text format.

[2256] Input: The generated response

[2257] Output: Response sent to the terminal

[2258] Step 24:

[2259] The terminal displays the response

[2260] The terminal displays the response to the user. The response message is displayed in the chat box.

[2261] Input: The response sent by the server

[2262] Output: The response displayed in the user interface

[2263] Step 25:

[2264] The user wishes to make a reservation

[2265] A user wishes to reserve a gift or service. The user selects the option they wish to reserve and presses the reservation button.

[2266] Input: User's reservation request

[2267] Output: Reservation request data is sent to the terminal

[2268] Step 26:

[2269] The device sends a reservation request to the server

[2270] The terminal sends the reservation request data to the server, which is then used by the reservation management system.

[2271] Input: User's reservation request data

[2272] Output: Reservation request data sent to the server

[2273] Step 27:

[2274] The server executes the reservation procedure.

[2275] The server executes the relevant reservation procedures and manages reservations using the service API of an external company.

[2276] Input: Reservation request data sent from the terminal

[2277] Output: Reservation procedure performed

[2278] Step 28:

[2279] The server sends the reservation confirmation information

[2280] After the reservation is completed, the server sends confirmation information to the terminal. The confirmation information is sent in JSON format.

[2281] Input: Booking procedure completion data

[2282] Output: Booking confirmation sent to the device

[2283] Step 29:

[2284] The device displays confirmation information

[2285] The terminal displays the reservation confirmation information to the user. The user interface displays a reservation completion message.

[2286] Input: Reservation confirmation information sent from the server

[2287] Output: Booking confirmation information displayed in the user interface

[2288] Step 30:

[2289] Users provide feedback

[2290] After using the gift or service, the user provides feedback by filling out the evaluation form and pressing the submit button.

[2291] Input: User feedback

[2292] Output: Feedback is sent to the device

[2293] Step 31:

[2294] The device sends feedback to the server

[2295] The terminal transmits the feedback information to the server, and the transmitted data is used in the feedback management system.

[2296] Input: User feedback

[2297] Output: Feedback data sent to the server

[2298] Step 32:

[2299] The server stores the feedback in a database

[2300] The server stores the feedback information in a database, which is used to improve the accuracy of the next proposal.

[2301] Input: Feedback data sent from the device

[2302] Output: Feedback stored in a database

[2303] Step 33:

[2304] The server improves based on feedback

[2305] The server will use the collected feedback to improve its next suggestion, feeding the feedback data into the AI ​​model to improve prediction accuracy.

[2306] Input: Feedback stored in the database

[2307] Output: An improved AI model reflected in the next proposal

[2308] These steps allow the entire system to remember important dates, provide appropriate gifts and services, and efficiently manage booking procedures and feedback.

[2309] (Application example 1)

[2310] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2311] Conventional AI concierge systems that run on messaging apps suggest gifts and services for friends and family based on the user's basic information, but the suggestions are limited, making it difficult to meet the diverse needs of users.In addition, when users make purchases in physical stores, they are unable to make timely suggestions about the most suitable products and services, which results in an inefficient purchasing experience.

[2312] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2313] In this invention, the server includes means for registering basic information about the user, means for collecting the user's daily message content and stamp usage information, means for analyzing the collected data and estimating the relationship between the user and each recipient, means for generating and sending reminder notifications based on a time schedule, means for generating gift ideas based on past gift-giving history and the recipient's preferences, means for presenting a list of ideas to the user, means for accepting inquiries about gift ideas from the user and generating responses, means for accepting user reservation requests and reserving services, means for collecting feedback after gifts and service usage, and means for collecting user behavior data in physical stores and making product suggestions in real time. This enables suggestions to be made according to the user's diverse needs, and also e...

Claims

1. A means for registering basic information of a user; A means for collecting daily message content and stamp usage information of users; means for analyzing the collected data and estimating the relationship between the user and each of the parties; means for generating and sending reminder notices based on a time schedule; A means for generating gift suggestions based on past gift history and the recipient's preferences; means for presenting the suggestion list to a user; A means for receiving a consultation regarding a gift from a user and generating a response; A means for accepting a user's reservation request and reserving a service; A means of collecting feedback after using gifts and services, A system including:

2. The system of claim 1 further comprising means for accumulating user data and using the data to improve the accuracy of subsequent suggestions.

3. 10. The system of claim 1, further comprising means for providing physical gifts, travel plans, and restaurant reservations in conjunction with services of group companies.

Images