system

Abstract

We provide the system. [Solution] Means for acquiring event information, A means for generating event invitation messages, The means of sending event invitation messages, Using generative AI, information is processed to propose the characteristics of home appliances, Proposal information is generated and displayed, The discount information is obtained and displayed, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance that responds to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Conventional event inducement methods, guidance methods for recommended points of home appliances, and discount guidance methods have the following problems. First, in conventional event inducement methods, the approach to users is one-sided and it is difficult to attract interest. Next, when guiding the recommended points of home appliances, it is difficult to appropriately respond to different needs of each user. Furthermore, regarding discount guidance, users have to manually check, which is time-consuming and there is a possibility of overlooking it. The present invention aims to solve these problems.

Means for Solving the Problems

[0005] The present invention makes it possible to solve the aforementioned problems by the following means. First, it provides a means for acquiring event information and generating and sending event invitation messages to users. This makes it possible to more effectively attract the user's interest. Next, it provides a means for processing information that suggests the features of home appliances using a generative AI. This makes it possible to appropriately respond to the different needs of each user and guide them with personalized recommendations. Furthermore, by providing a means for acquiring and displaying discount information, users can obtain discount information without effort and take advantage of it without missing out. A system including the above means can effectively solve the conventional problems.

[0006] "Means for obtaining event information" refers to means that have the function of obtaining detailed information about an event from a database or other information source.

[0007] "Event invitation message generation means" refers to means that have the function of creating an invitation message to a user based on acquired event information.

[0008] "Event invitation message sending means" refers to means that have the function of sending the generated invitation message to the user's terminal.

[0009] "Generative AI" refers to a system that utilizes artificial intelligence technology to generate new information based on input data.

[0010] "Information processing means for suggesting the features of home appliances" refers to means that use generative AI to analyze user questions and generate information to suggest the features and recommended points of home appliances.

[0011] "Means for generating and displaying suggested information" refers to means that have the function of generating suggested information for the user from information obtained by a generative AI and displaying it on the user's terminal.

[0012] "Means for acquiring and displaying discount information" refers to means that have the function of acquiring discount information from a database or other information source and displaying it on the user terminal. [Brief explanation of the drawing]

[0013] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, when an emotion engine is combined. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined.

Embodiments for Carrying Out the Invention

[0014] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0017] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0018] In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0019] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0021] [First Embodiment]

[0022] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0023] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0026] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0034] This invention is a system that can acquire event information, generate and send invitation messages to users, suggest features of home appliances using generative AI, and acquire and display discount information. The specific server, terminal, and user operations for implementing this invention are described below.

[0035] Event information acquisition and invitations

[0036] 1. Server: First, the server retrieves detailed event information (e.g., event name, date and time, location, content) from the database or other sources. This retrieved information pertains to a specific event, such as a "character event."

[0037] 2. Server: Based on the acquired event information, the server generates an invitation message to send to each user. This invitation message includes detailed information about the event.

[0038] 3. Server: The generated invitation message is sent to each user's device using the user's identification information (e.g., user ID, email address).

[0039] 4. Device: The user's device receives the invitation message sent from the server and displays it to the user in the form of a push notification or similar.

[0040] 5. User: The user checks the event invitation message displayed on their device and selects whether or not to participate.

[0041] Information suggestions for home appliances using generative AI

[0042] 1. User: The user enters questions about the home appliance they are considering purchasing through the terminal. For example, they might enter a question such as, "What are the features of the latest refrigerators?"

[0043] 2. Terminal: The user's terminal sends the entered question to the server.

[0044] 3. Server: The server receives the user's question and sends its content as a query to the generative AI.

[0045] 4. Generative AI: Generative AI analyzes submitted queries and generates information about the features of home appliances. For example, it can create specific answers such as, "The latest refrigerators can connect to Wi-Fi and the temperature settings can be changed from a smartphone."

[0046] 5. Server: The server receives information obtained from the generative AI and formats it as suggested information for the user.

[0047] 6. Server: The formatted suggestion information is sent to the user's terminal.

[0048] 7. Terminal: The user's terminal displays the suggestion information sent from the server, and the user confirms it.

[0049] Discount information for simultaneous contract with SB Services

[0050] 1. User: The user selects the product they intend to purchase through their device. For example, they might select a refrigerator.

[0051] 2. Terminal: The selected product information is sent from the terminal to the server.

[0052] 3. Server: The server receives product information and retrieves relevant discount information from the database.

[0053] 4. Server: Based on the acquired discount information, the server generates a discount notification message to present to the user. For example, it may include content such as, "Get a 20,000 yen discount when you purchase this refrigerator at the same time as signing up for SB service."

[0054] 5. Server: The generated discount offer message is sent to the user's terminal.

[0055] 6. Terminal: The user's terminal displays the discount notification message sent from the server, and the user confirms it.

[0056] 7. User: The user confirms the discount offer message and decides to purchase.

[0057] As described above, the system of the present invention operates in cooperation with a server, terminal, and user, effectively performing event triggering, suggesting information on home appliances using a generative AI, and providing discount information.

[0058] The following describes the processing flow.

[0059] Event information acquisition and invitations

[0060] Step 1:

[0061] Server: Retrieves detailed event information from databases and other sources. This includes event name, date and time, location, and content.

[0062] Step 2:

[0063] Server: Generates an invitation message to send to the user based on the acquired event information. The invitation message includes details of the event.

[0064] Step 3:

[0065] Server: Sends the generated invitation message to each user's terminal using their identification information (e.g., user ID, email address).

[0066] Step 4:

[0067] Device: The user's device receives the invitation message sent from the server and displays it to the user as a push notification.

[0068] Step 5:

[0069] User: The user checks the event invitation message displayed on their device and selects whether or not to participate in the event.

[0070] Information suggestions for home appliances using generative AI

[0071] Step 1:

[0072] User: The user enters questions about the home appliance they are considering purchasing into the terminal. Example: "What are the features of the latest refrigerators?"

[0073] Step 2:

[0074] Terminal: The user's terminal sends the question to the server.

[0075] Step 3:

[0076] Server: The server receives user questions, formats them appropriately, and sends them as queries to the generative AI.

[0077] Step 4:

[0078] Generative AI: Generative AI analyzes received queries and generates answers to user questions. Example: "The latest refrigerators can connect via Wi-Fi, and the temperature settings can be changed from a smartphone."

[0079] Step 5:

[0080] Server: Receives responses from the generative AI and formats them into suggestion messages for the user.

[0081] Step 6:

[0082] Server: Sends the formatted suggestion message to the user's terminal.

[0083] Step 7:

[0084] Terminal: The user's terminal receives the suggestion message and displays it on the screen.

[0085] Step 8:

[0086] User: The user checks the suggestion message displayed on the device.

[0087] Discount information for simultaneous contract with SB Services

[0088] Step 1:

[0089] User: The user selects the product they intend to purchase on their device. Example: A new refrigerator.

[0090] Step 2:

[0091] Terminal: Sends the selected product information to the server.

[0092] Step 3:

[0093] Server: Receives product information and retrieves relevant discount information from the database.

[0094] Step 4:

[0095] Server: Based on the acquired discount information, it generates a discount notification message for the user. Example: "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[0096] Step 5:

[0097] Server: Sends a discount notification message to the user's device.

[0098] Step 6:

[0099] Terminal: The user's terminal receives the discount notification message and displays it on the screen.

[0100] Step 7:

[0101] User: The user checks the discount offer message displayed on the device and decides to make a purchase.

[0102] The above is a detailed explanation of each processing step for carrying out the present invention.

[0103] (Example 1)

[0104] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0105] Modern consumers expect to quickly and efficiently obtain information on various events, product features, and even discounts when making purchases. However, many systems on the market only provide this information individually, and there is a lack of systems that offer integrated suggestions. As a result, users have to refer to multiple sources to obtain information, wasting time and effort. This invention aims to solve this problem by providing a system that provides event information acquisition, product suggestions generated by AI, and discount information in an integrated manner.

[0106] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0107] In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for sending event invitation messages, means for processing information to suggest the features of home appliances using a generative AI, means for receiving and analyzing user questions, means for sending questions to a generative AI and generating answers, means for formatting the generated answers, means for generating and displaying suggestion information, and means for acquiring and displaying discount information. This makes it possible for users to efficiently acquire event information, information on the features of home appliances, and discount information through a single system.

[0108] "Event information" refers to detailed information about the event, such as its name, date and time, location, and content.

[0109] "Means of acquisition" refers to the means of obtaining necessary information from databases or external APIs.

[0110] An "event invitation message" refers to a message that contains detailed information about an event and is sent to a user.

[0111] "Generation means" refers to the means of generating messages or information in a specific format based on data.

[0112] "Transmission means" refers to the means used to send generated messages and information to users or devices.

[0113] "Generative AI" refers to artificial intelligence systems that use natural language processing to generate appropriate outputs for specific inputs.

[0114] "Information for suggesting features" refers to information about the features and functions of home appliances that are suggested to users.

[0115] "Processing means" refers to the means used for analyzing data and generating information.

[0116] "User questions" refer to questions or requests that users ask the system regarding home appliances.

[0117] "Receiving means" refers to the means of receiving input or data from an external source.

[0118] "Means of analysis" refers to the means of understanding received data or questions and processing them appropriately.

[0119] "Means of generating answers" refers to methods for creating answers to user questions using generative AI.

[0120] "Formatting methods" refer to means of displaying generated information in an appropriate format for the user.

[0121] "Proposed information" refers to specific information about the products and services offered to users.

[0122] "Display means" refers to the means of providing generated information or messages to the user visually.

[0123] "Discount information" refers to information about discounts and benefits that apply when purchasing goods or services.

[0124] This invention is a system that integrates the acquisition of event information, the generation and sending of invitation messages to users, the suggestion of features for home appliances using generative AI, and the provision of discount information. The operation of each component is described below.

[0125] Event information acquisition and invitations

[0126] Get event information

[0127] Server: Event information is retrieved from a database or Web API. SQL queries are used to extract detailed information from the database, such as event name, date and time, location, and content. A concrete example is retrieving information about a new movie premiere from the database.

[0128] Generating an invitation message

[0129] Server: Based on the acquired event information, it generates an invitation message using a template engine (e.g., Mustache or Jinja). For example, a message like "You're invited to the XX event! Date: Month XX, Day XX, Location: XX" is generated.

[0130] Sending an invitation message

[0131] Server: The generated invitation message is sent to each user's device using the user's identification information (e.g., email address, user ID). The email is sent using the SMTP protocol.

[0132] Displaying the invitation message

[0133] Device: The user's device receives the sent invitation message and displays it via push notification or email app. For mobile devices, Firebase Cloud Messaging (FCM) can be used.

[0134] User actions

[0135] User: Review the invitation message and choose whether or not to participate. For example, they can indicate their participation using a button within the app or a reply email.

[0136] Information suggestions for home appliances using generative AI

[0137] User question input

[0138] User: Enter a question (prompt) about the home appliance you are considering purchasing from your device. For example, enter "What are the features of the latest refrigerators?"

[0139] Submit a question

[0140] Terminal: User questions are sent to the server. They are sent as POST requests using the REST API.

[0141] Sending queries to generative AI

[0142] Server: Sends received questions as queries to the generative AI. For example, it may use the OpenAI® API.

[0143] Answer generation by generative AI

[0144] Generative AI: Analyzes submitted queries and generates information about the features of home appliances. For example, it might generate answers such as, "The latest refrigerators can connect via Wi-Fi, and the temperature settings can be changed from a smartphone."

[0145] Formatting user-facing proposals

[0146] Server: Based on the generated responses, it formats them as user-facing suggestion information. It can be converted to Markdown or HTML format.

[0147] Submitting proposal information

[0148] Server: The formatted suggestion information is sent to the user's terminal.

[0149] Display of proposed information

[0150] Device: The user's device receives the suggested information and displays it in the app's interface. For example, information might be displayed as "Features of the latest refrigerators."

[0151] Discount information for simultaneous contract with SB Services

[0152] Product Selection

[0153] User: Select the item you intend to purchase on your device. For example, select "refrigerator".

[0154] Sending Selection Information

[0155] Terminal: Selected product information is sent to the server. Communication is performed using a REST API.

[0156] Obtaining discount information

[0157] Server: Based on product information, retrieve relevant discount information from the database. Execute SQL queries.

[0158] Generating discount information

[0159] Server: Based on discount information, it generates discount offer messages. For example, a message such as "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service" is generated.

[0160] Sending discount information

[0161] Server: Sends the generated discount offer message to the user's terminal.

[0162] Display of discount information

[0163] Device: Displays the discount offer message that was sent. It appears as a pop-up or notification within the app.

[0164] User's purchase decision

[0165] User: Check the discount offer and decide to purchase. Clicking the purchase button within the app completes the purchase process.

[0166] This enables the construction of a detailed system that can centrally provide event information, information suggestions for home appliances generated by a generative AI, and discount information.

[0167] Example of a prompt

[0168] "Could you tell me about the features of the latest refrigerators?"

[0169] "Please tell me more about the event 'XX'."

[0170] "Please tell me about any discounts I could get if I purchase this refrigerator."

[0171] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0172] Event information acquisition and invitations

[0173] Step 1:

[0174] The server accesses a database or external API to retrieve detailed event information. It executes SQL queries or API requests to extract information such as the event name, date and time, location, and content.

[0175] (Input) Database query or API request

[0176] (Data processing) Analyze the query results and extract the necessary information.

[0177] (Output) Event details

[0178] As a concrete example, execute the query "SELECT FROM events WHERE type='Character Events'" and retrieve the results.

[0179] Step 2:

[0180] Based on the acquired event information, the server generates an invitation message for the user using a template engine (such as Mustache or Jinja).

[0181] (Input) Event details

[0182] (Data processing) Embed information into a template to generate a message.

[0183] (Output) Generated invitation message

[0184] As a concrete example, we will generate a message that says, "You are invited to the XX event! Date: Month XX, Day XX, Location: XX".

[0185] Step 3:

[0186] The server sends the generated invitation message based on the user's identification information (e.g., user ID, email address). The email is sent using the SMTP protocol.

[0187] (Input) Invitation message, user identification information

[0188] (Data processing) Create email structure using SMTP client and send.

[0189] (Output) Confirmation of sent messages

[0190] As a concrete example, an invitation email is sent to each user's email address.

[0191] Step 4:

[0192] The device receives the invitation message sent from the server and displays it to the user via push notification or email app. Firebase Cloud Messaging (FCM) or an email app is used.

[0193] (Input) Received invitation message

[0194] (Data processing) Display as notification or email.

[0195] (Output) Invitation message displayed on the terminal

[0196] As a concrete example, FCM is used to display a push notification on the device saying, "You're invited to the XX event!"

[0197] Step 5:

[0198] Users review the invitation message displayed on their device and choose whether or not to participate. They can do so using the "Join" button or a reply email.

[0199] (Enter) Invitation message

[0200] (Data processing) Recording user actions

[0201] (Output) Participation intention information

[0202] As a concrete example, you can confirm your participation by clicking the "Join" button in the invitation email.

[0203] Information suggestions for home appliances using generative AI

[0204] Step 1:

[0205] The user enters questions about the home appliance they are considering purchasing via their device, using the app's text input field.

[0206] (Input) User's question

[0207] (Data processing) Text analysis

[0208] (Output) Structured query

[0209] As a concrete example, enter "What are the features of the latest refrigerators?"

[0210] Step 2:

[0211] The terminal sends the entered question to the server. It sends a POST request using the REST API.

[0212] (Input) User's question

[0213] (Data processing) Send to the server via REST API

[0214] (Output) Request to the server

[0215] As a concrete example, the "question content" is included as the payload of the POST request and sent to the server.

[0216] Step 3:

[0217] The server receives the user's question and sends its content as a query to the generative AI. For example, it might call the OpenAI API.

[0218] (Input) User's question

[0219] (Data processing) Send the question to the generative AI.

[0220] (Output) Query to a generative AI

[0221] As a concrete example, we send a question to the OpenAI GPT-3 (registered trademark) endpoint and obtain a response.

[0222] Step 4:

[0223] The generative AI analyzes the submitted query and generates information about the features of home appliances. It uses natural language processing to generate appropriate answers.

[0224] (Input) User's question

[0225] (Data processing) Answer generation based on natural language processing

[0226] (Output) Generated answer

[0227] As a concrete example, it generates specific answers such as, "The latest refrigerators can connect via Wi-Fi, allowing you to change the temperature settings from your smartphone."

[0228] Step 5:

[0229] The server receives the responses from the generative AI and formats them as user-friendly suggestions. It can also convert them to Markdown or HTML format.

[0230] (Input) Generated response

[0231] (Data processing) Formatting of answers (e.g., Markdown or HTML format)

[0232] (Output) Response as proposed information

[0233] As a concrete example, information can be formatted in the following way: "The features of the latest refrigerator are as follows: - WiFi connectivity - Temperature can be set from your smartphone."

[0234] Step 6:

[0235] The server sends the formatted suggestion information to the user's terminal. Communication then occurs again using the REST API.

[0236] (Input) Formatted proposal information

[0237] (Data processing) Sent via REST API

[0238] (Output) Response to terminal

[0239] As a concrete example, a response containing the proposed information is sent to the terminal.

[0240] Step 7:

[0241] The user's device displays the received suggestion information through the app's interface.

[0242] (Input) Proposal Information

[0243] (Data processing) Conversion to display format

[0244] (Output) Displayed within the app

[0245] As a concrete example, information such as "Features of the latest refrigerator" is displayed in a text view within the app.

[0246] Discount information for simultaneous contract with SB Services

[0247] Step 1:

[0248] Users select the items they intend to purchase through their device. They can choose from a product list within the app.

[0249] (Input) Selected product

[0250] (Data processing) Retrieval of product ID

[0251] (Output) Product ID

[0252] As a concrete example, select "refrigerator" from the product list.

[0253] Step 2:

[0254] The terminal sends the selected product information to the server. Communication is performed using a REST API.

[0255] (Input) Selected product information

[0256] (Data processing) Send to the server via REST API

[0257] (Output) Request to the server

[0258] As a concrete example, data containing the product ID of "refrigerator" is sent to the server.

[0259] Step 3:

[0260] The server receives product information and retrieves relevant discount information from the database. It then executes an SQL query.

[0261] (Input) Selected product information

[0262] (Data processing) Execution of database queries

[0263] (Output) Discount Information

[0264] As a concrete example, execute the query "SELECT FROM discounts WHERE product_id='refrigerator'" to retrieve discount information.

[0265] Step 4:

[0266] The server generates a discount notification message to present to the user based on the acquired discount information. A template engine is used.

[0267] (Input) Discount information

[0268] (Data processing) Message generation using a template engine

[0269] (Output) Discount notification message

[0270] As a concrete example, it generates messages such as, "If you purchase this refrigerator at the same time as signing up for SB Service, you will receive a 20,000 yen discount."

[0271] Step 5:

[0272] The server sends the generated discount offer message to the user's device. Communication is performed using a REST API.

[0273] (Input) Discount offer message

[0274] (Data processing) Sent via REST API

[0275] (Output) Response to terminal

[0276] As a concrete example, a discount offer message is sent as a response.

[0277] Step 6:

[0278] The device will display the discount offer message that was sent. It will appear as a pop-up or notification within the app.

[0279] (Input) Discount guidance message

[0280] (Data processing) Conversion to display format

[0281] (Output) Display on user terminal

[0282] As a specific example, data such as "Purchase this refrigerator and get a discount of 20,000 yen" is pop-up displayed.

[0283] Step 7:

[0284] The user checks the discount guidance message and decides to purchase. By clicking the purchase button of the app, the purchase is confirmed.

[0285] (Input) Discount guidance message

[0286] (Data processing) Record user actions

[0287] (Output) Purchase decision information

[0288] As a specific example, tap the "Purchase" button to complete the purchase procedure.

[0289] Thus, through these detailed processing steps, the system of the present invention can integrally and efficiently perform event invitations, home appliance information proposals, and discount information provision.

[0290] (Application Example 1)

[0291] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as a "server", and the smart device 14 is referred to as a "terminal".

[0292] While modern consumers have access to a wide variety of products and event information, the sheer volume of information makes it difficult for them to make informed decisions. Furthermore, the ability to quickly access detailed product information and discount offers can significantly boost purchasing behavior. In particular, there is a growing need to utilize generative AI to provide users with the information they seek in a timely manner. Current systems only provide event and discount information individually, lacking a unified and efficient means of delivery. This makes it difficult for consumers to make optimal choices, leading to decreased satisfaction.

[0293] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0294] In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for sending event invitation messages, means for processing information for suggesting product features using a generative AI, means for generating and displaying suggestion information, means for acquiring and displaying discount information, means for calling a generative AI that receives user questions and generates answer information, and means for sending push notifications to the user terminal. This makes it possible to centrally and timely provide event invitations, product information suggestions, and discount information notifications.

[0295] "Event information" refers to detailed information about an event that will be held at a specific date, time, and location.

[0296] "Generative AI" refers to a system that uses artificial intelligence technology to generate new information or answers from input data.

[0297] "Suggested information" refers to information about a product, such as its features and usage, that a generative AI provides based on the user's questions and purchase intentions.

[0298] "Discount information" refers to information about discounts and promotions offered for specific products or services.

[0299] The "user terminal" is a device directly operated by the user, including smartphones, tablets, personal computers, etc.

[0300] The "push notification" is a notification message sent from the server to the user terminal in real time.

[0301] The "event invitation message" is a message containing detailed information for inviting the user to a specific event.

[0302] The "processing means" is a combination of hardware and software for receiving and processing data.

[0303] The "generation means" is a combination of hardware and software for generating new information and messages based on specific data.

[0304] The "transmission means" is a communication means for sending information from the server to the user terminal.

[0305] The "calling means" is a means for issuing a trigger or instruction to execute a specific function or service when needed.

[0306] The "acquisition means" is a combination of hardware and software for acquiring specific information from a database, external API, etc.

[0307] The "display means" is a function for visually displaying information on the screen of the user terminal, etc.

[0308] The present invention is a system that acquires event information, generates and transmits an invitation message to the user, proposes product features using generative AI, and acquires and displays discount information. The operations of the server, terminal, and user necessary to implement the present invention are as follows.

[0309] Acquisition and invitation of event information

[0310] The server first retrieves event information from a database or other sources. This event information includes the event name, date and time, location, and content. Next, the server generates an event invitation message to send to each user based on this retrieved information. The generated invitation message is sent to each user's device using the user's identification information (e.g., user ID or email address). The user's device displays the received invitation message as a push notification, allowing the user to confirm the invitation message.

[0311] Product information suggestions using generative AI

[0312] The user enters a question about a product they are considering purchasing through their device. For example, "What are the features of the latest refrigerator?" The user's device sends this question to the server. The server passes the received question to a generative AI, which analyzes the question and generates information about the product's features. The generated information is sent to the user's device via the server and displayed on the device.

[0313] Discount information

[0314] The user selects the items they intend to purchase through their device. The selected item information is sent from the device to the server, which retrieves relevant discount information from its database. Based on this discount information, the server generates a discount notification message to present to the user. The generated discount notification message is sent to the user's device, where the user can review it.

[0315] Hardware and software to be used

[0316] Server: The server-side uses a web framework such as Flask to perform data processing and message generation.

[0317] Generative AI models: We use generative AI models such as OpenAI's GPT-3.

[0318] User terminal: A device operated by the user, such as a smartphone, tablet, or personal computer.

[0319] Push notification service: Real-time notifications are provided using services such as Firebase and OneSignal.

[0320] Example of program processing

[0321] For example, if a user asks, "What features do the latest refrigerators have?", the generative AI will generate information such as, "The latest refrigerators can connect to Wi-Fi and allow you to change the temperature settings from your smartphone."

[0322] Examples of generated AI prompts:

[0323] User question: What features do the latest refrigerators have?

[0324] What are the features of the latest home appliances (such as refrigerators)?

[0325] Thus, the system of the present invention can efficiently and effectively notify users of event invitations, product information suggestions, and discount information through cooperation between a server, a terminal, and a generative AI model.

[0326] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0327] Step 1:

[0328] The server retrieves event information from a database or external API. The retrieved event information includes the event name, date and time, location, and content. Based on this data, the server performs the following processing.

[0329] Input: Event information obtained from a database or external API (event name, date and time, location, details)

[0330] Output: List of retrieved event information

[0331] Step 2:

[0332] Based on the event information acquired by the server, an event invitation message is generated to be sent to each user. The generated message includes detailed information about the event.

[0333] Input: Retrieved event information

[0334] Output: Event invitation message to send to each user

[0335] Step 3:

[0336] The server generates an event invitation message and sends it to each user's device using the user's identification information (e.g., user ID or email address).

[0337] Input: Event invitation message, user identification information

[0338] Output: Event invitation message sent to the user's terminal

[0339] Step 4:

[0340] The event invitation message received by the user's device from the server is displayed to the user as a push notification.

[0341] Input: Event invitation message received from the server

[0342] Output: Event invitation message displayed on the user's device's push notification screen.

[0343] Step 5:

[0344] The user enters questions about the product they are considering purchasing through a terminal. For example, a question like, "What are the features of the latest refrigerator?" The terminal then sends the entered questions to the server.

[0345] Input: A product-related question entered by the user.

[0346] Output: Question data sent to the server

[0347] Step 6:

[0348] The server passes the question received from the user to a generative AI. The generative AI analyzes the question and generates information about the product's features.

[0349] Input: User's question data

[0350] Output: Response data generated by the AI.

[0351] Step 7:

[0352] The server receives the response data obtained from the generative AI, formats it, and sends it to the user's terminal as suggested information for the user.

[0353] Input: Response data received from a generative AI.

[0354] Output: Formatted proposal information

[0355] Step 8:

[0356] The user's device displays the suggestion information sent from the server.

[0357] Input: Suggestion information received from the server

[0358] Output: Suggestion information displayed on the user's terminal screen

[0359] Step 9:

[0360] The user selects the items they intend to purchase through their device. The device then sends the selected item information to the server.

[0361] Input: Product information selected by the user

[0362] Output: Product information sent to the server

[0363] Step 10:

[0364] The server receives product information and retrieves relevant discount information from the database.

[0365] Input: Product information sent to the server

[0366] Output: Discount information retrieved from the database

[0367] Step 11:

[0368] Based on the discount information acquired by the server, a discount notification message is generated to be presented to the user.

[0369] Input: Retrieved discount information

[0370] Output: Generated discount offer message

[0371] Step 12:

[0372] The server generates a discount offer message and sends it to the user's device.

[0373] Input: Discount offer message

[0374] Output: Discount notification message sent to the user's terminal

[0375] Step 13:

[0376] The user's device displays the discount notification message received from the server.

[0377] Input: Discount notification message received from the server

[0378] Output: Discount notification message displayed on the user's terminal screen

[0379] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0380] This invention is a system that combines the acquisition of event information, generation and transmission of invitation messages, suggestion of home appliance features using generative AI, acquisition and display of discount information, and an emotion engine that recognizes user emotions and adjusts the presented content. The operation of the server, terminal, user, and emotion engine in an embodiment of this invention is described below.

[0381] Event information acquisition and invitations

[0382] 1. Server: Retrieves detailed event information (event name, date and time, location, content, etc.) from databases and other sources.

[0383] 2. Server: Based on the acquired event information, it generates an invitation message to send to the user. The generated invitation message includes detailed information about the event.

[0384] 3. Server: Uses user identification information (e.g., user ID, email address) to send the generated invitation message to each user's device.

[0385] 4. Device: The user's device receives the invitation message sent from the server and displays it to the user as a push notification.

[0386] 5. User: The user checks the event invitation message displayed on their device and selects whether or not to participate in the event.

[0387] Information suggestions for home appliances using generative AI

[0388] 1. User: The user enters questions about the home appliance they are considering purchasing into the terminal. For example, "What are the features of the latest refrigerators?"

[0389] 2. Terminal: The user's terminal sends the entered question to the server.

[0390] 3. Server: The server receives the user's question and sends it as a query to the generative AI.

[0391] 4. Generative AI: Generative AI analyzes queries and generates answers to user questions. For example, information such as, "The latest refrigerators can connect to Wi-Fi and the temperature settings can be changed from a smartphone."

[0392] 5. Server: Receives responses from the generative AI and formats them into suggestion messages for the user.

[0393] 6. Server: Sends the formatted suggestion message to the user's terminal.

[0394] 7. Terminal: The user's terminal receives the suggestion message and displays it on the screen.

[0395] 8. User: The user checks the suggestion message displayed on the device.

[0396] Discount information for simultaneous contract with SB Services

[0397] 1. User: The user selects the product they intend to purchase on the device. For example, they might select the latest refrigerator.

[0398] 2. Terminal: Sends the selected product information to the server.

[0399] 3. Server: Receives product information and retrieves relevant discount information from the database.

[0400] 4. Server: Based on the acquired discount information, it generates discount notification messages for users. For example, it may include content such as, "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[0401] 5. Server: Sends the generated discount offer message to the user's terminal.

[0402] 6. Terminal: The user's terminal receives the discount notification message and displays it on the screen.

[0403] 7. User: The user checks the discount offer message displayed on the device and decides to make a purchase.

[0404] Adjustment by the emotion engine

[0405] 1. Emotion Engine: Analyzes the user's current emotions using sensor data and machine learning models to recognize the user's emotions.

[0406] 2. Emotion Engine: In the case of event invitation messages, the message content is adjusted based on the user's emotions. For example, when the user is excited, more passionate language is used.

[0407] 3. Emotional Engine: In the case of suggestion information for home appliances, the tone and level of detail of the suggestions are adjusted based on the user's emotions. For example, if the user is calm, more technical details are provided.

[0408] 4. Emotion Engine: In the case of discount announcement messages, the way the message is presented is adjusted based on the user's emotions. For example, if the user is confused, a more concise and intuitive message is provided.

[0409] As described above, the system of the present invention works in cooperation with a server, terminal, user, generative AI, and emotion engine to effectively provide event triggers, home appliance information suggestions, and discount announcements. The addition of the emotion engine further personalizes the user experience and enables more efficient information delivery.

[0410] The following describes the processing flow.

[0411] Event information acquisition and invitations

[0412] Step 1:

[0413] Server: Retrieves detailed event information (event name, date and time, location, content, etc.) from databases and other sources.

[0414] Step 2:

[0415] Server: Generates an invitation message based on the acquired event information.

[0416] Step 3:

[0417] Server: Uses user identification information (such as user ID) to send an invitation message to the user's device.

[0418] Step 4:

[0419] Terminal: Receives invitation messages sent from the server and displays them to the user as push notifications.

[0420] Step 5:

[0421] User: Check the invitation message displayed on the device and choose whether or not to participate in the event.

[0422] Information suggestions for home appliances using generative AI

[0423] Step 1:

[0424] User: Enters questions about the home appliance they are considering purchasing into the terminal. Example: "What are the features of the latest refrigerators?"

[0425] Step 2:

[0426] Terminal: The user's terminal sends the entered question to the server.

[0427] Step 3:

[0428] Server: Receives user questions and sends them as queries to the generative AI.

[0429] Step 4:

[0430] Generative AI: Analyzes submitted queries and generates answers to user questions. For example, it might respond with information such as, "The latest refrigerators can connect via Wi-Fi, and the temperature settings can be changed from a smartphone."

[0431] Step 5:

[0432] Server: Formats the responses received from the generative AI into user-facing suggestion messages.

[0433] Step 6:

[0434] Server: Sends the formatted suggestion message to the user's terminal.

[0435] Step 7:

[0436] Terminal: Receives suggestion messages and displays them on the screen.

[0437] Step 8:

[0438] User: Check the displayed suggestion message.

[0439] Discount information for simultaneous contract with SB Services

[0440] Step 1:

[0441] User: Select the product you intend to purchase on your device. Example: A new refrigerator.

[0442] Step 2:

[0443] Terminal: Sends the selected product information to the server.

[0444] Step 3:

[0445] Server: Receives product information and retrieves relevant discount information from the database.

[0446] Step 4:

[0447] Server: Based on the acquired discount information, it generates a discount notification message for the user. Example: "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[0448] Step 5:

[0449] Server: Sends the generated discount offer message to the user's terminal.

[0450] Step 6:

[0451] Terminal: Receives discount notification messages and displays them on the screen.

[0452] Step 7:

[0453] User: Checks the displayed discount message and decides to purchase.

[0454] Adjustment by the emotion engine

[0455] Step 1:

[0456] Emotion Engine: Analyzes the user's current emotions using sensor data and machine learning models to recognize the user's feelings.

[0457] Step 2:

[0458] Emotion Engine: Adjusts the content of event invitation messages based on recognized emotions. For example, if the user is excited, it will use more passionate language.

[0459] Step 3:

[0460] Emotion Engine: Adjusts suggested information for home appliances based on recognized emotions. For example, if the user is calm, it will provide more technical details.

[0461] Step 4:

[0462] Emotion Engine: Based on recognized emotions, it adjusts how discount offer messages are presented. For example, if a user is confused, it provides a concise and intuitive message.

[0463] The above is a detailed processing flow when combining the emotion engine. This system allows for a more personalized user experience and more efficient information delivery.

[0464] (Example 2)

[0465] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0466] While systems exist that provide event information, product information, and discount information individually, few systems integrate this information and provide personalized information tailored to the user's emotions. There is a need to improve the user experience by providing optimal information according to the user's needs and emotions, but conventional systems have not adequately achieved this. This invention aims to solve this problem and provide users with more effective and personalized information.

[0467] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for transmitting event invitation messages, means for receiving questions about home appliances and querying a generative AI, means for processing information to propose the features of home appliances using the generative AI, means for generating and displaying the proposed information, means for acquiring and displaying discount information, and an emotion engine that recognizes the user's emotions and adjusts the message content based on those emotions. This enables the effective provision of event information, features of home appliances, and discount information to the user, as well as the provision of personalized information according to emotions.

[0468] "Event information" refers to detailed information about the event, such as its name, date and time, location, and content.

[0469] "Means of acquisition" refers to methods and devices for collecting necessary information from databases, external APIs, etc.

[0470] "Generative means" refers to methods or devices for creating messages or proposals tailored to specific purposes based on collected information.

[0471] "Transmission means" refers to methods and devices for delivering generated messages and information to the user's terminal via communication means.

[0472] "Questions about home appliances" refers to inquiries from users about specific information and features they want to know about home appliances.

[0473] "Generative AI" refers to artificial intelligence models and systems that generate appropriate answers and suggestions in response to user questions and requests.

[0474] "Suggested information" refers to advice and guides provided in the form of detailed information, features, and usage examples regarding home appliances.

[0475] "Display means" refers to devices such as displays and monitors used to visually present collected or generated information to the user.

[0476] "Discount information" refers to information about discounts and benefits that apply when purchasing specific products or services.

[0477] An "emotion engine" refers to a system or algorithm that recognizes a user's emotions and adjusts how information is presented based on those emotions.

[0478] "User terminal" refers to a device used directly by the user (e.g., smartphone, tablet, personal computer).

[0479] This invention is a system that combines the acquisition of event information, generation and transmission of invitation messages, suggestion of home appliance features using generative AI, acquisition and display of discount information, and an emotion engine that recognizes user emotions and adjusts the presented content. The operation of the server, terminal, user, and emotion engine in an embodiment of this invention is described below.

[0480] Event information acquisition and invitations

[0481] Server: Retrieves detailed event information (event name, date and time, location, content, etc.) from a database or external API. Based on the retrieved information, the server generates an invitation message to send to users and sends the message to each user's device using the user's identification information.

[0482] Terminal: Receives invitation messages sent from the server and displays them to the user as push notifications.

[0483] User: Check the event invitation message displayed on the device and select whether or not to participate in the event.

[0484] Information suggestions for home appliances using generative AI

[0485] User: Enter questions into the terminal about the home appliance you are considering purchasing. For example, you might enter a question like, "What are the features of the latest refrigerators?"

[0486] Terminal: Sends the questions entered by the user to the server.

[0487] Server: Receives user questions and sends them as queries to the generative AI. The server receives the answers from the generative AI, formats them as suggestion messages for the user, and sends them to the user's terminal.

[0488] Generative AI: Analyzes queries and generates answers to user questions. For example, it might generate information such as, "The latest refrigerators can connect to Wi-Fi and allow you to change the temperature setting from your smartphone."

[0489] Terminal: Receives suggestion messages and displays them on the screen.

[0490] User: Check the suggestion message displayed on the device.

[0491] Discount information for simultaneous contract with SB Services

[0492] User: Select the product you intend to purchase on your device. For example, select the latest refrigerator.

[0493] Terminal: Sends the selected product information to the server.

[0494] Server: Receives product information, retrieves relevant discount information from the database, and generates a discount notification message for the user. For example, it may include content such as, "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[0495] Terminal: Receives discount notification messages and displays them on the screen.

[0496] User: Checks the discount offer message displayed on the device and decides to purchase.

[0497] Adjustment by the emotion engine

[0498] Emotion Engine: To recognize the user's emotions, it analyzes the user's current emotions using data collected from sensors, cameras, microphones, etc., as well as machine learning models.

[0499] Emotion Engine: For event invitation messages, the message content is adjusted based on the user's emotions. For example, when the user is excited, more passionate language is used.

[0500] Emotional Engine: In the case of consumer electronics product recommendations, the tone and level of detail of the recommendations are adjusted based on the user's emotions. For example, if the user is calm, more technical details are provided.

[0501] Emotion Engine: In the case of discount offer messages, the way the message is presented is adjusted based on the user's emotions. For example, if the user is confused, a more concise and intuitive message is provided.

[0502] Specific example

[0503] Event information acquisition and invitations

[0504] Example: When a user receives an invitation message for an event called "Summer Concert 2023".

[0505] Example prompt: "Please create an invitation message based on the following event information: Event name: Summer Concert 2023, Date: August 15, 2023, Location: Tokyo Dome, Content: Live performance by popular artists"

[0506] Information suggestions for home appliances using generative AI

[0507] Example: When a user asks about the features of a new refrigerator.

[0508] Example prompt: "Please tell me about the features of the latest refrigerators. I would especially appreciate details about any features such as Wi-Fi and smart functions."

[0509] Discount information for simultaneous contract with SB Services

[0510] Example: When a user decides to purchase a refrigerator and receives discount information.

[0511] Example prompt: "Please create a message offering a discount when selecting the latest refrigerator model. Include discount information for simultaneous contract with SB Service."

[0512] Adjustment by the emotion engine

[0513] Example: When a user receives an event invitation while in an excited state.

[0514] Example prompt: "Create an event invitation message for when the user is excited. Use passionate language."

[0515] As described above, the system of the present invention works in cooperation with a server, terminal, user, generative AI, and emotion engine to effectively trigger events, suggest information on home appliances, and provide discount information. The addition of the emotion engine further personalizes the user experience and enables efficient information delivery.

[0516] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0517] Program processing flow

[0518] Event information acquisition and invitations

[0519] Step 1:

[0520] Server: Retrieves event information. In this step, detailed event information (event name, date and time, location, content, etc.) is retrieved from a database or external API. This data is the input, and the output is the retrieved event information.

[0521] Step 2:

[0522] Server: Generates an invitation message based on the acquired event information. The input is the acquired event information, and the output is an invitation message to be sent to the user. Specifically, it embeds the event information according to a template and generates the message.

[0523] Step 3:

[0524] Server: Uses user identification information (e.g., user ID, email address) to send a generated invitation message to each user's device. Input is user information and the generated invitation message, and output is the sent message.

[0525] Step 4:

[0526] Terminal: Receives invitation messages sent from the server and displays them to the user as push notifications. The input is the invitation message received on the terminal, and the output is the push notification displayed on the screen.

[0527] Step 5:

[0528] User: The user reviews the event invitation message displayed on their device and selects whether or not to attend the event. The input is the displayed invitation message, and the output is the user's selection.

[0529] Information suggestions for home appliances using generative AI

[0530] Step 1:

[0531] User: Enters questions into the terminal about home appliances they are considering purchasing. For example, they might enter a question like, "What are the features of the latest refrigerators?" The input is the user's question, and the output is the entry to the terminal.

[0532] Step 2:

[0533] Terminal: Sends user-entered questions to the server. Input is the user's question, and output is the query sent to the server.

[0534] Step 3:

[0535] Server: Receives user questions and sends them as queries to the generative AI. The input is the user's question, and the output is the query to the generative AI.

[0536] Step 4:

[0537] Generative AI: Analyzes queries and generates answers to user questions. For example, it might generate information such as, "The latest refrigerators can connect to Wi-Fi and allow temperature settings to be changed from a smartphone." The input is a query from the server, and the output is the answer generated by the AI.

[0538] Step 5:

[0539] Server: Receives responses from generative AI and formats them into user-facing suggestion messages. The input is the response from the generative AI, and the output is the formatted suggestion message.

[0540] Step 6:

[0541] Server: Sends a formatted suggestion message to the user's terminal. The input is the formatted suggestion message, and the output is the message sent to the user's terminal.

[0542] Step 7:

[0543] Terminal: Receives suggestion messages and displays them on the screen. Input is the message received from the server, and output is the suggestion message displayed on the terminal.

[0544] Step 8:

[0545] User: Confirm the suggestion message displayed on the terminal. The input is the suggestion message displayed on the terminal, and the output is the user's confirmation result.

[0546] Discount information for simultaneous contract with SB Services

[0547] Step 1:

[0548] User: Selects the product they intend to purchase on the terminal. For example, they might select the latest refrigerator. The input is the user's selection, and the output is the information about the selected product.

[0549] Step 2:

[0550] Terminal: Sends selected product information to the server. The input is the selected product information, and the output is the data sent to the server.

[0551] Step 3:

[0552] Server: Receives product information and retrieves relevant discount information from the database. The input is the selected product information, and the output is the retrieved discount information.

[0553] Step 4:

[0554] Server: Based on the acquired discount information, it generates a discount notification message for the user. For example, it might include content such as, "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service." The input is discount information, and the output is the generated discount notification message.

[0555] Step 5:

[0556] Server: Sends the generated discount offer message to the user's terminal. The input is the discount offer message, and the output is the message sent to the user's terminal.

[0557] Step 6:

[0558] Terminal: Receives discount offer messages and displays them on the screen. The input is the message received from the server, and the output is the discount offer displayed on the terminal.

[0559] Step 7:

[0560] User: Checks the discount offer message displayed on the device and decides to purchase. The input is the discount offer message displayed on the device, and the output is the user's purchase decision.

[0561] Adjustment by the emotion engine

[0562] Step 1:

[0563] Emotion Engine: To recognize the user's emotions, it analyzes the user's current emotions using data collected from sensors, cameras, microphones, etc., and machine learning models. The input is data collected from sensors, etc., and the output is the analysis result.

[0564] Step 2:

[0565] Emotion Engine: For event invitation messages, this adjusts the message content based on the user's emotions. When the user is excited, it uses more passionate language. The input is the user's emotion analysis result and the original invitation message, and the output is the adjusted invitation message.

[0566] Step 3:

[0567] Emotional Engine: In the case of consumer electronics product recommendations, the tone and level of detail of the recommendations are adjusted based on the user's emotions. For example, if the user is calm, more technical details are provided. The input is the user's emotion analysis results and the original recommendation information, and the output is the adjusted recommendation message.

[0568] Step 4:

[0569] Emotion Engine: In the case of discount offer messages, it adjusts how the message is presented based on the user's emotions. For example, if the user is confused, it provides a more concise and intuitive message. The input is the user's emotion analysis result and the original discount offer message, and the output is the adjusted discount offer message.

[0570] (Application Example 2)

[0571] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0572] Conventional online shopping systems often provide users with uniform information and promotions, lacking personalized suggestions that take into account individual users' interests and emotions. This can limit the user experience and potentially lower customer satisfaction. This invention aims to increase customer satisfaction and purchasing intent by providing information and promotions that take user emotions into consideration.

[0573] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0574] In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for sending event invitation messages, means for processing information for suggesting product information using a generative AI, means for generating and displaying suggestion information, means for acquiring and displaying discount information, and means including an emotion engine that identifies the user's emotions and adjusts the message content. This enables personalized information provision and promotion based on the user's individual emotional state.

[0575] "Event information" refers to detailed information (such as name, date, time, location, and content) about a specific event, sale, or promotion.

[0576] An "invitation message" refers to a message generated based on event information that includes content encouraging users to participate in the event.

[0577] "Generative AI" refers to artificial intelligence that automatically generates and provides specific information in response to user queries.

[0578] "Product information" includes detailed descriptions and recommendations about the product's features and attributes.

[0579] "Recommended information" refers to recommendations for specific products or services that are generated based on the user's search history and questions.

[0580] "Discount information" refers to information regarding price reductions or promotions for specific products.

[0581] An "emotion engine" refers to a system that uses machine learning models and sensor data to identify a user's emotions and adjust the content and tone of the messages presented based on those emotions.

[0582] A "user terminal" refers to a mobile device such as a smartphone that has the function of receiving messages from a server and displaying them to the user.

[0583] "Push notifications" refer to a notification method in which information is sent from a server in real time and immediately displayed on the user's device screen.

[0584] This invention relates to an online shopping system for providing personalized information and promotions that take user emotions into consideration. The system consists of a server, a user terminal, a generative AI, and an emotion engine.

[0585] Server Functions

[0586] The server has the following main functions:

[0587] 1. Retrieving event information: The server retrieves detailed information about the event (name, date and time, location, content, etc.) from the database and other sources.

[0588] 2. Generating invitation messages: Based on the acquired event information, an invitation message is generated for each user. The message will include details of the event.

[0589] 3. Sending the message: The generated invitation message is sent to the user's device using the user's identification information (such as email address or user ID).

[0590] 4. Product Information Suggestion: Based on user queries, the system collaborates with a generative AI to generate and organize product information and propose it to the user.

[0591] 5. Provision of discount information: Based on the product information of the item the user intends to purchase, relevant discount information will be retrieved from the database and provided to the user.

[0592] User terminal functions

[0593] The user terminal has the following functions:

[0594] 1. Receiving and displaying messages: Receive invitation messages, discount information, and product suggestion messages sent from the server, and provide them to the user as push notifications or on-screen displays.

[0595] 2. User query submission: The user enters a question about a product they are considering purchasing and sends that query to the server.

[0596] Functions of Generative AI

[0597] Generative AI generates information based on user queries:

[0598] 1. Query Analysis: Analyze user questions and collect and generate appropriate information.

[0599] 2. Answer generation: For the analyzed query, specific information is generated (e.g., for "What are the features of the latest refrigerators?", the answer is "The latest refrigerators are Wi-Fi enabled and the temperature settings can be changed from a smartphone").

[0600] Functions of the Emotion Engine

[0601] The emotion engine identifies the user's emotions and tailors the messages it delivers:

[0602] 1. Emotion Identification: Sensor data and machine learning models are used to determine the user's current emotional state.

[0603] 2. Message Adjustment: Adjust the tone and content of the message based on the determined emotion. For example, if the user is excited, use more energetic language.

[0604] Hardware and software to use

[0605] Smartphone: Used as a user terminal. It receives and displays messages.

[0606] EmotionEngine: Used as an emotion engine to analyze user emotions. It leverages existing models such as Microsoft® Azure® Emotion API and Emotion SDK.

[0607] AIGenerator: Used as a generative AI to generate information in response to user queries. It utilizes OpenAI GPT-3, ChatGPT (registered trademark), and other technologies.

[0608] Specific example

[0609] If a user is considering purchasing a refrigerator, they might send a query via a smartphone app asking, "What are the features of the latest refrigerators?" The server uses generative AI to generate a response such as, "The latest refrigerators are Wi-Fi enabled and allow you to change the temperature settings from your smartphone." The emotion engine analyzes the user's emotions and, for example, if the user is excited, provides the user with a more tailored message, such as, "Wow! The latest refrigerators are Wi-Fi enabled and allow you to change the temperature settings from your smartphone."

[0610] Example of a prompt:

[0611] "What are the features of the latest refrigerators?"

[0612] "Do you have any information on discounts for the refrigerator I'm considering purchasing?"

[0613] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0614] Step 1:

[0615] The server retrieves event information from databases and other sources. The input is detailed information about the event (name, date and time, location, content, etc.), and by obtaining this information, it obtains the basic data to generate event invitation messages.

[0616] Step 2:

[0617] The server generates an invitation message for each user based on the acquired event information. The input is the event information acquired in step 1, and the output is the invitation message. The generated message includes details of the event.

[0618] Step 3:

[0619] The server sends the generated invitation message to the user's terminal. The input is the invitation message generated in step 2 and the user's identification information (user ID, email address, etc.), and the output is the message sent to the user's terminal.

[0620] Step 4:

[0621] The user terminal receives the invitation message sent from the server and provides it to the user as a push notification or screen display. The input is the invitation message sent from the server, and the output is the user's confirmation of the message.

[0622] Step 5:

[0623] The user enters questions about the product they are considering purchasing into the terminal. For example, they might enter a query such as, "What are the features of the latest refrigerator?" The input is the user's query, and the output is the submission of the query.

[0624] Step 6:

[0625] The user terminal sends the user's inputted question to the server. The input is the user's query, and the output is the query sent to the server.

[0626] Step 7:

[0627] The server sends the received user query to a generative AI, which then generates appropriate information. The input is the user's query, and the output is the answer obtained from the generative AI. Specifically, the generative AI analyzes the query and generates relevant product information.

[0628] Step 8:

[0629] The server formats the responses obtained from the generative AI and compiles them into a message to be provided. The input is the response from the generative AI, and the output is the formatted suggestion message.

[0630] Step 9:

[0631] The server sends the formatted suggestion message to the user terminal. The input is the formatted suggestion message, and the output is the message sent to the user terminal.

[0632] Step 10:

[0633] The user terminal receives the suggestion message and displays it on the screen. The input is the suggestion message sent from the server, and the output is the displayed message. The user then confirms the suggested information.

[0634] Step 11:

[0635] The server retrieves relevant discount information from the database based on the product information the user intends to purchase. The input is the product information to be purchased, and the output is the discount information.

[0636] Step 12:

[0637] The server generates discount offer messages for users based on the acquired discount information. The input is discount information, and the output is a discount offer message. For example, the message might say, "Get a 20,000 yen discount when you purchase this refrigerator in conjunction with a contract for a specific service."

[0638] Step 13:

[0639] The server sends the generated discount offer message to the user's terminal. The input is the discount offer message, and the output is the message sent to the user's terminal.

[0640] Step 14:

[0641] The user terminal receives a discount offer message and displays it on the screen. The input is the discount offer message sent from the server, and the output is the displayed message. The user then reviews the discount offer and decides to make a purchase.

[0642] Step 15:

[0643] The emotion engine identifies the user's emotions and adjusts the content and tone of the messages it delivers. The input is the user's emotion data, and the output is the adjusted message. Specifically, it uses sensor data and machine learning models to determine the user's emotional state and adapts the message based on the results.

[0644] Specific example

[0645] Example prompt: "What are the features of the latest refrigerators?"

[0646] If the emotion engine identifies the user as excited, the output message will be "Wow! The latest refrigerators are Wi-Fi enabled and you can change the temperature settings from your smartphone."

[0647] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0648] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0649] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0650] [Second Embodiment]

[0651] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0652] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0653] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0654] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0655] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0656] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0657] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0658] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0659] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0660] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0661] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0662] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0663] This invention is a system that can acquire event information, generate and send invitation messages to users, suggest features of home appliances using generative AI, and acquire and display discount information. The specific server, terminal, and user operations for implementing this invention are described below.

[0664] Event information acquisition and invitations

[0665] 1. Server: First, the server retrieves detailed event information (e.g., event name, date and time, location, content) from the database or other sources. This retrieved information pertains to a specific event, such as a "character event."

[0666] 2. Server: Based on the acquired event information, the server generates an invitation message to send to each user. This invitation message includes detailed information about the event.

[0667] 3. Server: The generated invitation message is sent to each user's device using the user's identification information (e.g., user ID, email address).

[0668] 4. Device: The user's device receives the invitation message sent from the server and displays it to the user in the form of a push notification or similar.

[0669] 5. User: The user checks the event invitation message displayed on their device and selects whether or not to participate.

[0670] Information suggestions for home appliances using generative AI

[0671] 1. User: The user enters questions about the home appliance they are considering purchasing through the terminal. For example, they might enter a question such as, "What are the features of the latest refrigerators?"

[0672] 2. Terminal: The user's terminal sends the entered question to the server.

[0673] 3. Server: The server receives the user's question and sends its content as a query to the generative AI.

[0674] 4. Generative AI: Generative AI analyzes submitted queries and generates information about the features of home appliances. For example, it can create specific answers such as, "The latest refrigerators can connect to Wi-Fi and the temperature settings can be changed from a smartphone."

[0675] 5. Server: The server receives information obtained from the generative AI and formats it as suggested information for the user.

[0676] 6. Server: The formatted suggestion information is sent to the user's terminal.

[0677] 7. Terminal: The user's terminal displays the suggestion information sent from the server, and the user confirms it.

[0678] Discount information for simultaneous contract with SB Services

[0679] 1. User: The user selects the product they intend to purchase through their device. For example, they might select a refrigerator.

[0680] 2. Terminal: The selected product information is sent from the terminal to the server.

[0681] 3. Server: The server receives product information and retrieves relevant discount information from the database.

[0682] 4. Server: Based on the acquired discount information, the server generates a discount notification message to present to the user. For example, it may include content such as, "Get a 20,000 yen discount when you purchase this refrigerator at the same time as signing up for SB service."

[0683] 5. Server: The generated discount offer message is sent to the user's terminal.

[0684] 6. Terminal: The user's terminal displays the discount notification message sent from the server, and the user confirms it.

[0685] 7. User: The user confirms the discount offer message and decides to purchase.

[0686] As described above, the system of the present invention operates in cooperation with a server, terminal, and user, effectively performing event triggering, suggesting information on home appliances using a generative AI, and providing discount information.

[0687] The following describes the processing flow.

[0688] Event information acquisition and invitations

[0689] Step 1:

[0690] Server: Retrieves detailed event information from databases and other sources. This includes event name, date and time, location, and content.

[0691] Step 2:

[0692] Server: Generates an invitation message to send to the user based on the acquired event information. The invitation message includes details of the event.

[0693] Step 3:

[0694] Server: Sends the generated invitation message to each user's terminal using their identification information (e.g., user ID, email address).

[0695] Step 4:

[0696] Device: The user's device receives the invitation message sent from the server and displays it to the user as a push notification.

[0697] Step 5:

[0698] User: The user checks the event invitation message displayed on their device and selects whether or not to participate in the event.

[0699] Information suggestions for home appliances using generative AI

[0700] Step 1:

[0701] User: The user enters questions about the home appliance they are considering purchasing into the terminal. Example: "What are the features of the latest refrigerators?"

[0702] Step 2:

[0703] Terminal: The user's terminal sends the question to the server.

[0704] Step 3:

[0705] Server: The server receives user questions, formats them appropriately, and sends them as queries to the generative AI.

[0706] Step 4:

[0707] Generative AI: Generative AI analyzes received queries and generates answers to user questions. Example: "The latest refrigerators can connect via Wi-Fi, and the temperature settings can be changed from a smartphone."

[0708] Step 5:

[0709] Server: Receives responses from the generative AI and formats them into suggestion messages for the user.

[0710] Step 6:

[0711] Server: Sends the formatted suggestion message to the user's terminal.

[0712] Step 7:

[0713] Terminal: The user's terminal receives the suggestion message and displays it on the screen.

[0714] Step 8:

[0715] User: The user checks the suggestion message displayed on the device.

[0716] Discount information for simultaneous contract with SB Services

[0717] Step 1:

[0718] User: The user selects the product they intend to purchase on their device. Example: A new refrigerator.

[0719] Step 2:

[0720] Terminal: Sends the selected product information to the server.

[0721] Step 3:

[0722] Server: Receives product information and retrieves relevant discount information from the database.

[0723] Step 4:

[0724] Server: Based on the acquired discount information, it generates a discount notification message for the user. Example: "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[0725] Step 5:

[0726] Server: Sends a discount notification message to the user's device.

[0727] Step 6:

[0728] Terminal: The user's terminal receives the discount notification message and displays it on the screen.

[0729] Step 7:

[0730] User: The user checks the discount offer message displayed on the device and decides to make a purchase.

[0731] The above is a detailed explanation of each processing step for carrying out the present invention.

[0732] (Example 1)

[0733] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0734] Modern consumers expect to quickly and efficiently obtain information on various events, product features, and even discounts when making purchases. However, many systems on the market only provide this information individually, and there is a lack of systems that offer integrated suggestions. As a result, users have to refer to multiple sources to obtain information, wasting time and effort. This invention aims to solve this problem by providing a system that provides event information acquisition, product suggestions generated by AI, and discount information in an integrated manner.

[0735] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0736] In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for sending event invitation messages, means for processing information to suggest the features of home appliances using a generative AI, means for receiving and analyzing user questions, means for sending questions to a generative AI and generating answers, means for formatting the generated answers, means for generating and displaying suggestion information, and means for acquiring and displaying discount information. This makes it possible for users to efficiently acquire event information, information on the features of home appliances, and discount information through a single system.

[0737] "Event information" refers to detailed information about the event, such as its name, date and time, location, and content.

[0738] "Means of acquisition" refers to the means of obtaining necessary information from databases or external APIs.

[0739] An "event invitation message" refers to a message that contains detailed information about an event and is sent to a user.

[0740] "Generation means" refers to the means of generating messages or information in a specific format based on data.

[0741] "Transmission means" refers to the means used to send generated messages and information to users or devices.

[0742] "Generative AI" refers to artificial intelligence systems that use natural language processing to generate appropriate outputs for specific inputs.

[0743] "Information for suggesting features" refers to information about the features and functions of home appliances that are suggested to users.

[0744] "Processing means" refers to the means used for analyzing data and generating information.

[0745] "User questions" refer to questions or requests that users ask the system regarding home appliances.

[0746] "Receiving means" refers to the means of receiving input or data from an external source.

[0747] "Means of analysis" refers to the means of understanding received data or questions and processing them appropriately.

[0748] "Means of generating answers" refers to methods for creating answers to user questions using generative AI.

[0749] "Formatting methods" refer to means of displaying generated information in an appropriate format for the user.

[0750] "Proposed information" refers to specific information about the products and services offered to users.

[0751] "Display means" refers to the means of providing generated information or messages to the user visually.

[0752] "Discount information" refers to information about discounts and benefits that apply when purchasing goods or services.

[0753] This invention is a system that integrates the acquisition of event information, the generation and sending of invitation messages to users, the suggestion of features for home appliances using generative AI, and the provision of discount information. The operation of each component is described below.

[0754] Event information acquisition and invitations

[0755] Get event information

[0756] Server: Event information is retrieved from a database or Web API. SQL queries are used to extract detailed information from the database, such as event name, date and time, location, and content. A concrete example is retrieving information about a new movie premiere from the database.

[0757] Generating an invitation message

[0758] Server: Based on the acquired event information, it generates an invitation message using a template engine (e.g., Mustache or Jinja). For example, a message like "You're invited to the XX event! Date: Month XX, Day XX, Location: XX" is generated.

[0759] Sending an invitation message

[0760] Server: The generated invitation message is sent to each user's device using the user's identification information (e.g., email address, user ID). The email is sent using the SMTP protocol.

[0761] Displaying the invitation message

[0762] Device: The user's device receives the sent invitation message and displays it via push notification or email app. For mobile devices, Firebase Cloud Messaging (FCM) can be used.

[0763] User actions

[0764] User: Review the invitation message and choose whether or not to participate. For example, they can indicate their participation using a button within the app or a reply email.

[0765] Information suggestions for home appliances using generative AI

[0766] User question input

[0767] User: Enter a question (prompt) about the home appliance you are considering purchasing from your device. For example, enter "What are the features of the latest refrigerators?"

[0768] Submit a question

[0769] Terminal: User questions are sent to the server. They are sent as POST requests using the REST API.

[0770] Sending queries to generative AI

[0771] Server: Sends received questions as queries to the generative AI. For example, the OpenAI API may be used.

[0772] Answer generation by generative AI

[0773] Generative AI: Analyzes submitted queries and generates information about the features of home appliances. For example, it might generate answers such as, "The latest refrigerators can connect via Wi-Fi, and the temperature settings can be changed from a smartphone."

[0774] Formatting user-facing proposals

[0775] Server: Based on the generated responses, it formats them as user-facing suggestion information. It can be converted to Markdown or HTML format.

[0776] Submitting proposal information

[0777] Server: The formatted suggestion information is sent to the user's terminal.

[0778] Display of proposed information

[0779] Device: The user's device receives the suggested information and displays it in the app's interface. For example, information might be displayed as "Features of the latest refrigerators."

[0780] Discount information for simultaneous contract with SB Services

[0781] Product Selection

[0782] User: Select the item you intend to purchase on your device. For example, select "refrigerator".

[0783] Sending Selection Information

[0784] Terminal: Selected product information is sent to the server. Communication is performed using a REST API.

[0785] Obtaining discount information

[0786] Server: Based on product information, retrieve relevant discount information from the database. Execute SQL queries.

[0787] Generating discount information

[0788] Server: Based on discount information, it generates discount offer messages. For example, a message such as "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service" is generated.

[0789] Sending discount information

[0790] Server: Sends the generated discount offer message to the user's terminal.

[0791] Display of discount information

[0792] Device: Displays the discount offer message that was sent. It appears as a pop-up or notification within the app.

[0793] User's purchase decision

[0794] User: Check the discount offer and decide to purchase. Clicking the purchase button within the app completes the purchase process.

[0795] This enables the construction of a detailed system that can centrally provide event information, information suggestions for home appliances generated by a generative AI, and discount information.

[0796] Example of a prompt

[0797] "Could you tell me about the features of the latest refrigerators?"

[0798] "Please tell me more about the event 'XX'."

[0799] "Please tell me about any discounts I could get if I purchase this refrigerator."

[0800] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0801] Event information acquisition and invitations

[0802] Step 1:

[0803] The server accesses a database or external API to retrieve detailed event information. It executes SQL queries or API requests to extract information such as the event name, date and time, location, and content.

[0804] (Input) Database query or API request

[0805] (Data processing) Analyze the query results and extract the necessary information.

[0806] (Output) Event details

[0807] As a concrete example, execute the query "SELECT FROM events WHERE type='Character Events'" and retrieve the results.

[0808] Step 2:

[0809] Based on the acquired event information, the server generates an invitation message for the user using a template engine (such as Mustache or Jinja).

[0810] (Input) Event details

[0811] (Data processing) Embed information into a template to generate a message.

[0812] (Output) Generated invitation message

[0813] As a concrete example, we will generate a message that says, "You are invited to the XX event! Date: Month XX, Day XX, Location: XX".

[0814] Step 3:

[0815] The server sends the generated invitation message based on the user's identification information (e.g., user ID, email address). The email is sent using the SMTP protocol.

[0816] (Input) Invitation message, user identification information

[0817] (Data processing) Create email structure using SMTP client and send.

[0818] (Output) Confirmation of sent messages

[0819] As a concrete example, an invitation email is sent to each user's email address.

[0820] Step 4:

[0821] The device receives the invitation message sent from the server and displays it to the user via push notification or email app. Firebase Cloud Messaging (FCM) or an email app is used.

[0822] (Input) Received invitation message

[0823] (Data processing) Display as notification or email.

[0824] (Output) Invitation message displayed on the terminal

[0825] As a concrete example, FCM is used to display a push notification on the device saying, "You're invited to the XX event!"

[0826] Step 5:

[0827] Users review the invitation message displayed on their device and choose whether or not to participate. They can do so using the "Join" button or a reply email.

[0828] (Enter) Invitation message

[0829] (Data processing) Recording user actions

[0830] (Output) Participation intention information

[0831] As a concrete example, you can confirm your participation by clicking the "Join" button in the invitation email.

[0832] Information suggestions for home appliances using generative AI

[0833] Step 1:

[0834] The user enters questions about the home appliance they are considering purchasing via their device, using the app's text input field.

[0835] (Input) User's question

[0836] (Data processing) Text analysis

[0837] (Output) Structured query

[0838] As a concrete example, enter "What are the features of the latest refrigerators?"

[0839] Step 2:

[0840] The terminal sends the entered question to the server. It sends a POST request using the REST API.

[0841] (Input) User's question

[0842] (Data processing) Send to the server via REST API

[0843] (Output) Request to the server

[0844] As a concrete example, the "question content" is included as the payload of the POST request and sent to the server.

[0845] Step 3:

[0846] The server receives the user's question and sends its content as a query to the generative AI. For example, it might call the OpenAI API.

[0847] (Input) User's question

[0848] (Data processing) Send the question to the generative AI.

[0849] (Output) Query to a generative AI

[0850] As a concrete example, we send a question to the OpenAI GPT-3 endpoint and obtain a response.

[0851] Step 4:

[0852] The generative AI analyzes the submitted query and generates information about the features of home appliances. It uses natural language processing to generate appropriate answers.

[0853] (Input) User's question

[0854] (Data processing) Answer generation based on natural language processing

[0855] (Output) Generated answer

[0856] As a concrete example, it generates specific answers such as, "The latest refrigerators can connect via Wi-Fi, allowing you to change the temperature settings from your smartphone."

[0857] Step 5:

[0858] The server receives the responses from the generative AI and formats them as user-friendly suggestions. It can also convert them to Markdown or HTML format.

[0859] (Input) Generated response

[0860] (Data processing) Formatting of answers (e.g., Markdown or HTML format)

[0861] (Output) Response as proposed information

[0862] As a concrete example, information can be formatted in the following way: "The features of the latest refrigerator are as follows: - WiFi connectivity - Temperature can be set from your smartphone."

[0863] Step 6:

[0864] The server sends the formatted suggestion information to the user's terminal. Communication then occurs again using the REST API.

[0865] (Input) Formatted proposal information

[0866] (Data processing) Sent via REST API

[0867] (Output) Response to terminal

[0868] As a concrete example, a response containing the proposed information is sent to the terminal.

[0869] Step 7:

[0870] The user's device displays the received suggestion information through the app's interface.

[0871] (Input) Proposal Information

[0872] (Data processing) Conversion to display format

[0873] (Output) Displayed within the app

[0874] As a concrete example, information such as "Features of the latest refrigerator" is displayed in a text view within the app.

[0875] Discount information for simultaneous contract with SB Services

[0876] Step 1:

[0877] Users select the items they intend to purchase through their device. They can choose from a product list within the app.

[0878] (Input) Selected product

[0879] (Data processing) Retrieval of product ID

[0880] (Output) Product ID

[0881] As a concrete example, select "refrigerator" from the product list.

[0882] Step 2:

[0883] The terminal sends the selected product information to the server. Communication is performed using a REST API.

[0884] (Input) Selected product information

[0885] (Data processing) Send to the server via REST API

[0886] (Output) Request to the server

[0887] As a concrete example, data containing the product ID of "refrigerator" is sent to the server.

[0888] Step 3:

[0889] The server receives product information and retrieves relevant discount information from the database. It then executes an SQL query.

[0890] (Input) Selected product information

[0891] (Data processing) Execution of database queries

[0892] (Output) Discount Information

[0893] As a concrete example, execute the query "SELECT FROM discounts WHERE product_id='refrigerator'" to retrieve discount information.

[0894] Step 4:

[0895] The server generates a discount notification message to present to the user based on the acquired discount information. A template engine is used.

[0896] (Input) Discount information

[0897] (Data processing) Message generation using a template engine

[0898] (Output) Discount notification message

[0899] As a concrete example, it generates messages such as, "If you purchase this refrigerator at the same time as signing up for SB Service, you will receive a 20,000 yen discount."

[0900] Step 5:

[0901] The server sends the generated discount offer message to the user's device. Communication is performed using a REST API.

[0902] (Input) Discount offer message

[0903] (Data processing) Sent via REST API

[0904] (Output) Response to terminal

[0905] As a concrete example, a discount offer message is sent as a response.

[0906] Step 6:

[0907] The device will display the discount offer message that was sent. It will appear as a pop-up or notification within the app.

[0908] (Input) Discount offer message

[0909] (Data processing) Conversion to display format

[0910] (Output) Display on user terminal

[0911] For example, data such as "Get a 20,000 yen discount when you buy this refrigerator" will pop up.

[0912] Step 7:

[0913] The user reviews the discount offer message and decides to purchase. The purchase is confirmed by clicking the purchase button in the app.

[0914] (Input) Discount offer message

[0915] (Data processing) Recording user actions

[0916] (Output) Purchase decision information

[0917] As a concrete example, tap the "Purchase" button to complete the purchase process.

[0918] As a result, through these detailed processing steps, the system of the present invention can provide event invitations, information suggestions for home appliances, and discount information in an integrated and efficient manner.

[0919] (Application Example 1)

[0920] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0921] While modern consumers have access to a wide variety of products and event information, the sheer volume of information makes it difficult for them to make informed decisions. Furthermore, the ability to quickly access detailed product information and discount offers can significantly boost purchasing behavior. In particular, there is a growing need to utilize generative AI to provide users with the information they seek in a timely manner. Current systems only provide event and discount information individually, lacking a unified and efficient means of delivery. This makes it difficult for consumers to make optimal choices, leading to decreased satisfaction.

[0922] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0923] In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for sending event invitation messages, means for processing information for suggesting product features using a generative AI, means for generating and displaying suggestion information, means for acquiring and displaying discount information, means for calling a generative AI that receives user questions and generates answer information, and means for sending push notifications to the user terminal. This makes it possible to centrally and timely provide event invitations, product information suggestions, and discount information notifications.

[0924] "Event information" refers to detailed information about an event that will be held at a specific date, time, and location.

[0925] "Generative AI" refers to a system that uses artificial intelligence technology to generate new information or answers from input data.

[0926] "Suggested information" refers to information about a product, such as its features and usage, that a generative AI provides based on the user's questions and purchase intentions.

[0927] "Discount information" refers to information about discounts and promotions offered for specific products or services.

[0928] A "user terminal" refers to a device that the user directly operates, and includes smartphones, tablets, and personal computers.

[0929] A "push notification" is a notification message sent in real time from a server to a user's device.

[0930] An "event invitation message" is a message containing detailed information to invite a user to a specific event.

[0931] "Processing means" refers to a combination of hardware and software for receiving and processing data.

[0932] A "generation method" is a combination of hardware and software used to generate new information or messages based on specific data.

[0933] "Transmission means" refers to the means of communication used to send information from a server to a user terminal.

[0934] A "means of invocation" refers to a means of issuing a trigger or instruction to execute a specific function or service when needed.

[0935] "Acquisition method" refers to a combination of hardware and software used to retrieve specific information from databases, external APIs, etc.

[0936] "Display means" refers to a function for visually displaying information on the screen of a user's terminal or similar device.

[0937] This invention is a system that acquires event information, generates and sends invitation messages to users, suggests product features using a generative AI, and acquires and displays discount information. The operations of the server, terminal, and user necessary to implement this invention are as follows.

[0938] Event information acquisition and invitations

[0939] The server first retrieves event information from a database or other sources. This event information includes the event name, date and time, location, and content. Next, the server generates an event invitation message to send to each user based on this retrieved information. The generated invitation message is sent to each user's device using the user's identification information (e.g., user ID or email address). The user's device displays the received invitation message as a push notification, allowing the user to confirm the invitation message.

[0940] Product information suggestions using generative AI

[0941] The user enters a question about a product they are considering purchasing through their device. For example, "What are the features of the latest refrigerator?" The user's device sends this question to the server. The server passes the received question to a generative AI, which analyzes the question and generates information about the product's features. The generated information is sent to the user's device via the server and displayed on the device.

[0942] Discount information

[0943] The user selects the items they intend to purchase through their device. The selected item information is sent from the device to the server, which retrieves relevant discount information from its database. Based on this discount information, the server generates a discount notification message to present to the user. The generated discount notification message is sent to the user's device, where the user can review it.

[0944] Hardware and software to be used

[0945] Server: The server-side uses a web framework such as Flask to perform data processing and message generation.

[0946] Generative AI models: We use generative AI models such as OpenAI's GPT-3.

[0947] User terminal: A device operated by the user, such as a smartphone, tablet, or personal computer.

[0948] Push notification service: Real-time notifications are provided using services such as Firebase and OneSignal.

[0949] Example of program processing

[0950] For example, if a user asks, "What features do the latest refrigerators have?", the generative AI will generate information such as, "The latest refrigerators can connect to Wi-Fi and allow you to change the temperature settings from your smartphone."

[0951] Examples of generated AI prompts:

[0952] User question: What features do the latest refrigerators have?

[0953] What are the features of the latest home appliances (such as refrigerators)?

[0954] Thus, the system of the present invention can efficiently and effectively notify users of event invitations, product information suggestions, and discount information through cooperation between a server, a terminal, and a generative AI model.

[0955] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0956] Step 1:

[0957] The server retrieves event information from a database or external API. The retrieved event information includes the event name, date and time, location, and content. Based on this data, the server performs the following processing.

[0958] Input: Event information obtained from a database or external API (event name, date and time, location, details)

[0959] Output: List of retrieved event information

[0960] Step 2:

[0961] Based on the event information acquired by the server, an event invitation message is generated to be sent to each user. The generated message includes detailed information about the event.

[0962] Input: Retrieved event information

[0963] Output: Event invitation message to send to each user

[0964] Step 3:

[0965] The server generates an event invitation message and sends it to each user's device using the user's identification information (e.g., user ID or email address).

[0966] Input: Event invitation message, user identification information

[0967] Output: Event invitation message sent to the user's terminal

[0968] Step 4:

[0969] The event invitation message received by the user's device from the server is displayed to the user as a push notification.

[0970] Input: Event invitation message received from the server

[0971] Output: Event invitation message displayed on the user's device's push notification screen.

[0972] Step 5:

[0973] The user enters questions about the product they are considering purchasing through a terminal. For example, a question like, "What are the features of the latest refrigerator?" The terminal then sends the entered questions to the server.

[0974] Input: A product-related question entered by the user.

[0975] Output: Question data sent to the server

[0976] Step 6:

[0977] The server passes the question received from the user to a generative AI. The generative AI analyzes the question and generates information about the product's features.

[0978] Input: User's question data

[0979] Output: Response data generated by the AI.

[0980] Step 7:

[0981] The server receives the response data obtained from the generative AI, formats it, and sends it to the user's terminal as suggested information for the user.

[0982] Input: Response data received from a generative AI.

[0983] Output: Formatted proposal information

[0984] Step 8:

[0985] The user's device displays the suggestion information sent from the server.

[0986] Input: Suggestion information received from the server

[0987] Output: Suggestion information displayed on the user's terminal screen

[0988] Step 9:

[0989] The user selects the items they intend to purchase through their device. The device then sends the selected item information to the server.

[0990] Input: Product information selected by the user

[0991] Output: Product information sent to the server

[0992] Step 10:

[0993] The server receives product information and retrieves relevant discount information from the database.

[0994] Input: Product information sent to the server

[0995] Output: Discount information retrieved from the database

[0996] Step 11:

[0997] Based on the discount information acquired by the server, a discount notification message is generated to be presented to the user.

[0998] Input: Retrieved discount information

[0999] Output: Generated discount offer message

[1000] Step 12:

[1001] The server generates a discount offer message and sends it to the user's device.

[1002] Input: Discount offer message

[1003] Output: Discount notification message sent to the user's terminal

[1004] Step 13:

[1005] The user's device displays the discount notification message received from the server.

[1006] Input: Discount notification message received from the server

[1007] Output: Discount notification message displayed on the user's terminal screen

[1008] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1009] This invention is a system that combines the acquisition of event information, generation and transmission of invitation messages, suggestion of home appliance features using generative AI, acquisition and display of discount information, and an emotion engine that recognizes user emotions and adjusts the presented content. The operation of the server, terminal, user, and emotion engine in an embodiment of this invention is described below.

[1010] Event information acquisition and invitations

[1011] 1. Server: Retrieves detailed event information (event name, date and time, location, content, etc.) from databases and other sources.

[1012] 2. Server: Based on the acquired event information, it generates an invitation message to send to the user. The generated invitation message includes detailed information about the event.

[1013] 3. Server: Uses user identification information (e.g., user ID, email address) to send the generated invitation message to each user's device.

[1014] 4. Device: The user's device receives the invitation message sent from the server and displays it to the user as a push notification.

[1015] 5. User: The user checks the event invitation message displayed on their device and selects whether or not to participate in the event.

[1016] Information suggestions for home appliances using generative AI

[1017] 1. User: The user enters questions about the home appliance they are considering purchasing into the terminal. For example, "What are the features of the latest refrigerators?"

[1018] 2. Terminal: The user's terminal sends the entered question to the server.

[1019] 3. Server: The server receives the user's question and sends it as a query to the generative AI.

[1020] 4. Generative AI: Generative AI analyzes queries and generates answers to user questions. For example, information such as, "The latest refrigerators can connect to Wi-Fi and the temperature settings can be changed from a smartphone."

[1021] 5. Server: Receives responses from the generative AI and formats them into suggestion messages for the user.

[1022] 6. Server: Sends the formatted suggestion message to the user's terminal.

[1023] 7. Terminal: The user's terminal receives the suggestion message and displays it on the screen.

[1024] 8. User: The user checks the suggestion message displayed on the device.

[1025] Discount information for simultaneous contract with SB Services

[1026] 1. User: The user selects the product they intend to purchase on the device. For example, they might select the latest refrigerator.

[1027] 2. Terminal: Sends the selected product information to the server.

[1028] 3. Server: Receives product information and retrieves relevant discount information from the database.

[1029] 4. Server: Based on the acquired discount information, it generates discount notification messages for users. For example, it may include content such as, "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[1030] 5. Server: Sends the generated discount offer message to the user's terminal.

[1031] 6. Terminal: The user's terminal receives the discount notification message and displays it on the screen.

[1032] 7. User: The user checks the discount offer message displayed on the device and decides to make a purchase.

[1033] Adjustment by the emotion engine

[1034] 1. Emotion Engine: Analyzes the user's current emotions using sensor data and machine learning models to recognize the user's emotions.

[1035] 2. Emotion Engine: In the case of event invitation messages, the message content is adjusted based on the user's emotions. For example, when the user is excited, more passionate language is used.

[1036] 3. Emotional Engine: In the case of suggestion information for home appliances, the tone and level of detail of the suggestions are adjusted based on the user's emotions. For example, if the user is calm, more technical details are provided.

[1037] 4. Emotion Engine: In the case of discount announcement messages, the way the message is presented is adjusted based on the user's emotions. For example, if the user is confused, a more concise and intuitive message is provided.

[1038] As described above, the system of the present invention works in cooperation with a server, terminal, user, generative AI, and emotion engine to effectively provide event triggers, home appliance information suggestions, and discount announcements. The addition of the emotion engine further personalizes the user experience and enables more efficient information delivery.

[1039] The following describes the processing flow.

[1040] Event information acquisition and invitations

[1041] Step 1:

[1042] Server: Retrieves detailed event information (event name, date and time, location, content, etc.) from databases and other sources.

[1043] Step 2:

[1044] Server: Generates an invitation message based on the acquired event information.

[1045] Step 3:

[1046] Server: Uses user identification information (such as user ID) to send an invitation message to the user's device.

[1047] Step 4:

[1048] Terminal: Receives invitation messages sent from the server and displays them to the user as push notifications.

[1049] Step 5:

[1050] User: Check the invitation message displayed on the device and choose whether or not to participate in the event.

[1051] Information suggestions for home appliances using generative AI

[1052] Step 1:

[1053] User: Enters questions about the home appliance they are considering purchasing into the terminal. Example: "What are the features of the latest refrigerators?"

[1054] Step 2:

[1055] Terminal: The user's terminal sends the entered question to the server.

[1056] Step 3:

[1057] Server: Receives user questions and sends them as queries to the generative AI.

[1058] Step 4:

[1059] Generative AI: Analyzes submitted queries and generates answers to user questions. For example, it might respond with information such as, "The latest refrigerators can connect via Wi-Fi, and the temperature settings can be changed from a smartphone."

[1060] Step 5:

[1061] Server: Formats the responses received from the generative AI into user-facing suggestion messages.

[1062] Step 6:

[1063] Server: Sends the formatted suggestion message to the user's terminal.

[1064] Step 7:

[1065] Terminal: Receives suggestion messages and displays them on the screen.

[1066] Step 8:

[1067] User: Check the displayed suggestion message.

[1068] Discount information for simultaneous contract with SB Services

[1069] Step 1:

[1070] User: Select the product you intend to purchase on your device. Example: A new refrigerator.

[1071] Step 2:

[1072] Terminal: Sends the selected product information to the server.

[1073] Step 3:

[1074] Server: Receives product information and retrieves relevant discount information from the database.

[1075] Step 4:

[1076] Server: Based on the acquired discount information, it generates a discount notification message for the user. Example: "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[1077] Step 5:

[1078] Server: Sends the generated discount offer message to the user's terminal.

[1079] Step 6:

[1080] Terminal: Receives discount notification messages and displays them on the screen.

[1081] Step 7:

[1082] User: Checks the displayed discount message and decides to purchase.

[1083] Adjustment by the emotion engine

[1084] Step 1:

[1085] Emotion Engine: Analyzes the user's current emotions using sensor data and machine learning models to recognize the user's feelings.

[1086] Step 2:

[1087] Emotion Engine: Adjusts the content of event invitation messages based on recognized emotions. For example, if the user is excited, it will use more passionate language.

[1088] Step 3:

[1089] Emotion Engine: Adjusts suggested information for home appliances based on recognized emotions. For example, if the user is calm, it will provide more technical details.

[1090] Step 4:

[1091] Emotion Engine: Based on recognized emotions, it adjusts how discount offer messages are presented. For example, if a user is confused, it provides a concise and intuitive message.

[1092] The above is a detailed processing flow when combining the emotion engine. This system allows for a more personalized user experience and more efficient information delivery.

[1093] (Example 2)

[1094] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[1095] While systems exist that provide event information, product information, and discount information individually, few systems integrate this information and provide personalized information tailored to the user's emotions. There is a need to improve the user experience by providing optimal information according to the user's needs and emotions, but conventional systems have not adequately achieved this. This invention aims to solve this problem and provide users with more effective and personalized information.

[1096] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for transmitting event invitation messages, means for receiving questions about home appliances and querying a generative AI, means for processing information to propose the features of home appliances using the generative AI, means for generating and displaying the proposed information, means for acquiring and displaying discount information, and an emotion engine that recognizes the user's emotions and adjusts the message content based on those emotions. This enables the effective provision of event information, features of home appliances, and discount information to the user, as well as the provision of personalized information according to emotions.

[1097] "Event information" refers to detailed information about the event, such as its name, date and time, location, and content.

[1098] "Means of acquisition" refers to methods and devices for collecting necessary information from databases, external APIs, etc.

[1099] "Generative means" refers to methods or devices for creating messages or proposals tailored to specific purposes based on collected information.

[1100] "Transmission means" refers to methods and devices for delivering generated messages and information to the user's terminal via communication means.

[1101] "Questions about home appliances" refers to inquiries from users about specific information and features they want to know about home appliances.

[1102] "Generative AI" refers to artificial intelligence models and systems that generate appropriate answers and suggestions in response to user questions and requests.

[1103] "Suggested information" refers to advice and guides provided in the form of detailed information, features, and usage examples regarding home appliances.

[1104] "Display means" refers to devices such as displays and monitors used to visually present collected or generated information to the user.

[1105] "Discount information" refers to information about discounts and benefits that apply when purchasing specific products or services.

[1106] An "emotion engine" refers to a system or algorithm that recognizes a user's emotions and adjusts how information is presented based on those emotions.

[1107] "User terminal" refers to a device used directly by the user (e.g., smartphone, tablet, personal computer).

[1108] This invention is a system that combines the acquisition of event information, generation and transmission of invitation messages, suggestion of home appliance features using generative AI, acquisition and display of discount information, and an emotion engine that recognizes user emotions and adjusts the presented content. The operation of the server, terminal, user, and emotion engine in an embodiment of this invention is described below.

[1109] Event information acquisition and invitations

[1110] Server: Retrieves detailed event information (event name, date and time, location, content, etc.) from a database or external API. Based on the retrieved information, the server generates an invitation message to send to users and sends the message to each user's device using the user's identification information.

[1111] Terminal: Receives invitation messages sent from the server and displays them to the user as push notifications.

[1112] User: Check the event invitation message displayed on the device and select whether or not to participate in the event.

[1113] Information suggestions for home appliances using generative AI

[1114] User: Enter questions into the terminal about the home appliance you are considering purchasing. For example, you might enter a question like, "What are the features of the latest refrigerators?"

[1115] Terminal: Sends the questions entered by the user to the server.

[1116] Server: Receives user questions and sends them as queries to the generative AI. The server receives the answers from the generative AI, formats them as suggestion messages for the user, and sends them to the user's terminal.

[1117] Generative AI: Analyzes queries and generates answers to user questions. For example, it might generate information such as, "The latest refrigerators can connect to Wi-Fi and allow you to change the temperature setting from your smartphone."

[1118] Terminal: Receives suggestion messages and displays them on the screen.

[1119] User: Check the suggestion message displayed on the device.

[1120] Discount information for simultaneous contract with SB Services

[1121] User: Select the product you intend to purchase on your device. For example, select the latest refrigerator.

[1122] Terminal: Sends the selected product information to the server.

[1123] Server: Receives product information, retrieves relevant discount information from the database, and generates a discount notification message for the user. For example, it may include content such as, "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[1124] Terminal: Receives discount notification messages and displays them on the screen.

[1125] User: Checks the discount offer message displayed on the device and decides to purchase.

[1126] Adjustment by the emotion engine

[1127] Emotion Engine: To recognize the user's emotions, it analyzes the user's current emotions using data collected from sensors, cameras, microphones, etc., as well as machine learning models.

[1128] Emotion Engine: For event invitation messages, the message content is adjusted based on the user's emotions. For example, when the user is excited, more passionate language is used.

[1129] Emotional Engine: In the case of consumer electronics product recommendations, the tone and level of detail of the recommendations are adjusted based on the user's emotions. For example, if the user is calm, more technical details are provided.

[1130] Emotion Engine: In the case of discount offer messages, the way the message is presented is adjusted based on the user's emotions. For example, if the user is confused, a more concise and intuitive message is provided.

[1131] Specific example

[1132] Event information acquisition and invitations

[1133] Example: When a user receives an invitation message for an event called "Summer Concert 2023".

[1134] Example prompt: "Please create an invitation message based on the following event information: Event name: Summer Concert 2023, Date: August 15, 2023, Location: Tokyo Dome, Content: Live performance by popular artists"

[1135] Information suggestions for home appliances using generative AI

[1136] Example: When a user asks about the features of a new refrigerator.

[1137] Example prompt: "Please tell me about the features of the latest refrigerators. I would especially appreciate details about any features such as Wi-Fi and smart functions."

[1138] Discount information for simultaneous contract with SB Services

[1139] Example: When a user decides to purchase a refrigerator and receives discount information.

[1140] Example prompt: "Please create a message offering a discount when selecting the latest refrigerator model. Include discount information for simultaneous contract with SB Service."

[1141] Adjustment by the emotion engine

[1142] Example: When a user receives an event invitation while in an excited state.

[1143] Example prompt: "Create an event invitation message for when the user is excited. Use passionate language."

[1144] As described above, the system of the present invention works in cooperation with a server, terminal, user, generative AI, and emotion engine to effectively trigger events, suggest information on home appliances, and provide discount information. The addition of the emotion engine further personalizes the user experience and enables efficient information delivery.

[1145] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1146] Program processing flow

[1147] Event information acquisition and invitations

[1148] Step 1:

[1149] Server: Retrieves event information. In this step, detailed event information (event name, date and time, location, content, etc.) is retrieved from a database or external API. This data is the input, and the output is the retrieved event information.

[1150] Step 2:

[1151] Server: Generates an invitation message based on the acquired event information. The input is the acquired event information, and the output is an invitation message to be sent to the user. Specifically, it embeds the event information according to a template and generates the message.

[1152] Step 3:

[1153] Server: Uses user identification information (e.g., user ID, email address) to send a generated invitation message to each user's device. Input is user information and the generated invitation message, and output is the sent message.

[1154] Step 4:

[1155] Terminal: Receives invitation messages sent from the server and displays them to the user as push notifications. The input is the invitation message received on the terminal, and the output is the push notification displayed on the screen.

[1156] Step 5:

[1157] User: The user reviews the event invitation message displayed on their device and selects whether or not to attend the event. The input is the displayed invitation message, and the output is the user's selection.

[1158] Information suggestions for home appliances using generative AI

[1159] Step 1:

[1160] User: Enters questions into the terminal about home appliances they are considering purchasing. For example, they might enter a question like, "What are the features of the latest refrigerators?" The input is the user's question, and the output is the entry to the terminal.

[1161] Step 2:

[1162] Terminal: Sends user-entered questions to the server. Input is the user's question, and output is the query sent to the server.

[1163] Step 3:

[1164] Server: Receives user questions and sends them as queries to the generative AI. The input is the user's question, and the output is the query to the generative AI.

[1165] Step 4:

[1166] Generative AI: Analyzes queries and generates answers to user questions. For example, it might generate information such as, "The latest refrigerators can connect to Wi-Fi and allow temperature settings to be changed from a smartphone." The input is a query from the server, and the output is the answer generated by the AI.

[1167] Step 5:

[1168] Server: Receives responses from generative AI and formats them into user-facing suggestion messages. The input is the response from the generative AI, and the output is the formatted suggestion message.

[1169] Step 6:

[1170] Server: Sends a formatted suggestion message to the user's terminal. The input is the formatted suggestion message, and the output is the message sent to the user's terminal.

[1171] Step 7:

[1172] Terminal: Receives suggestion messages and displays them on the screen. Input is the message received from the server, and output is the suggestion message displayed on the terminal.

[1173] Step 8:

[1174] User: Confirm the suggestion message displayed on the terminal. The input is the suggestion message displayed on the terminal, and the output is the user's confirmation result.

[1175] Discount information for simultaneous contract with SB Services

[1176] Step 1:

[1177] User: Selects the product they intend to purchase on the terminal. For example, they might select the latest refrigerator. The input is the user's selection, and the output is the information about the selected product.

[1178] Step 2:

[1179] Terminal: Sends selected product information to the server. The input is the selected product information, and the output is the data sent to the server.

[1180] Step 3:

[1181] Server: Receives product information and retrieves relevant discount information from the database. The input is the selected product information, and the output is the retrieved discount information.

[1182] Step 4:

[1183] Server: Based on the acquired discount information, it generates a discount notification message for the user. For example, it might include content such as, "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service." The input is discount information, and the output is the generated discount notification message.

[1184] Step 5:

[1185] Server: Sends the generated discount offer message to the user's terminal. The input is the discount offer message, and the output is the message sent to the user's terminal.

[1186] Step 6:

[1187] Terminal: Receives discount offer messages and displays them on the screen. The input is the message received from the server, and the output is the discount offer displayed on the terminal.

[1188] Step 7:

[1189] User: Checks the discount offer message displayed on the device and decides to purchase. The input is the discount offer message displayed on the device, and the output is the user's purchase decision.

[1190] Adjustment by the emotion engine

[1191] Step 1:

[1192] Emotion Engine: To recognize the user's emotions, it analyzes the user's current emotions using data collected from sensors, cameras, microphones, etc., and machine learning models. The input is data collected from sensors, etc., and the output is the analysis result.

[1193] Step 2:

[1194] Emotion Engine: For event invitation messages, this adjusts the message content based on the user's emotions. When the user is excited, it uses more passionate language. The input is the user's emotion analysis result and the original invitation message, and the output is the adjusted invitation message.

[1195] Step 3:

[1196] Emotional Engine: In the case of consumer electronics product recommendations, the tone and level of detail of the recommendations are adjusted based on the user's emotions. For example, if the user is calm, more technical details are provided. The input is the user's emotion analysis results and the original recommendation information, and the output is the adjusted recommendation message.

[1197] Step 4:

[1198] Emotion Engine: In the case of discount offer messages, it adjusts how the message is presented based on the user's emotions. For example, if the user is confused, it provides a more concise and intuitive message. The input is the user's emotion analysis result and the original discount offer message, and the output is the adjusted discount offer message.

[1199] (Application Example 2)

[1200] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1201] Conventional online shopping systems often provide users with uniform information and promotions, lacking personalized suggestions that take into account individual users' interests and emotions. This can limit the user experience and potentially lower customer satisfaction. This invention aims to increase customer satisfaction and purchasing intent by providing information and promotions that take user emotions into consideration.

[1202] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1203] In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for sending event invitation messages, means for processing information for suggesting product information using a generative AI, means for generating and displaying suggestion information, means for acquiring and displaying discount information, and means including an emotion engine that identifies the user's emotions and adjusts the message content. This enables personalized information provision and promotion based on the user's individual emotional state.

[1204] "Event information" refers to detailed information (such as name, date, time, location, and content) about a specific event, sale, or promotion.

[1205] An "invitation message" refers to a message generated based on event information that includes content encouraging users to participate in the event.

[1206] "Generative AI" refers to artificial intelligence that automatically generates and provides specific information in response to user queries.

[1207] "Product information" includes detailed descriptions and recommendations about the product's features and attributes.

[1208] "Recommended information" refers to recommendations for specific products or services that are generated based on the user's search history and questions.

[1209] "Discount information" refers to information regarding price reductions or promotions for specific products.

[1210] An "emotion engine" refers to a system that uses machine learning models and sensor data to identify a user's emotions and adjust the content and tone of the messages presented based on those emotions.

[1211] A "user terminal" refers to a mobile device such as a smartphone that has the function of receiving messages from a server and displaying them to the user.

[1212] "Push notifications" refer to a notification method in which information is sent from a server in real time and immediately displayed on the user's device screen.

[1213] This invention relates to an online shopping system for providing personalized information and promotions that take user emotions into consideration. The system consists of a server, a user terminal, a generative AI, and an emotion engine.

[1214] Server Functions

[1215] The server has the following main functions:

[1216] 1. Retrieving event information: The server retrieves detailed information about the event (name, date and time, location, content, etc.) from the database and other sources.

[1217] 2. Generating invitation messages: Based on the acquired event information, an invitation message is generated for each user. The message will include details of the event.

[1218] 3. Sending the message: The generated invitation message is sent to the user's device using the user's identification information (such as email address or user ID).

[1219] 4. Product Information Suggestion: Based on user queries, the system collaborates with a generative AI to generate and organize product information and propose it to the user.

[1220] 5. Provision of discount information: Based on the product information of the item the user intends to purchase, relevant discount information will be retrieved from the database and provided to the user.

[1221] User terminal functions

[1222] The user terminal has the following functions:

[1223] 1. Receiving and displaying messages: Receive invitation messages, discount information, and product suggestion messages sent from the server, and provide them to the user as push notifications or on-screen displays.

[1224] 2. User query submission: The user enters a question about a product they are considering purchasing and sends that query to the server.

[1225] Functions of Generative AI

[1226] Generative AI generates information based on user queries:

[1227] 1. Query Analysis: Analyze user questions and collect and generate appropriate information.

[1228] 2. Answer generation: For the analyzed query, specific information is generated (e.g., for "What are the features of the latest refrigerators?", the answer is "The latest refrigerators are Wi-Fi enabled and the temperature settings can be changed from a smartphone").

[1229] Functions of the Emotion Engine

[1230] The emotion engine identifies the user's emotions and tailors the messages it delivers:

[1231] 1. Emotion Identification: Sensor data and machine learning models are used to determine the user's current emotional state.

[1232] 2. Message Adjustment: Adjust the tone and content of the message based on the determined emotion. For example, if the user is excited, use more energetic language.

[1233] Hardware and software to use

[1234] Smartphone: Used as a user terminal. It receives and displays messages.

[1235] EmotionEngine: Used as an emotion engine to analyze user emotions. It leverages existing models such as the Microsoft Azure Emotion API and Emotion SDK.

[1236] AIGenerator: Used as a generative AI to generate information in response to user queries. It utilizes OpenAI GPT-3, ChatGPT, and other technologies.

[1237] Specific example

[1238] If a user is considering purchasing a refrigerator, they might send a query via a smartphone app asking, "What are the features of the latest refrigerators?" The server uses generative AI to generate a response such as, "The latest refrigerators are Wi-Fi enabled and allow you to change the temperature settings from your smartphone." The emotion engine analyzes the user's emotions and, for example, if the user is excited, provides the user with a more tailored message, such as, "Wow! The latest refrigerators are Wi-Fi enabled and allow you to change the temperature settings from your smartphone."

[1239] Example of a prompt:

[1240] "What are the features of the latest refrigerators?"

[1241] "Do you have any information on discounts for the refrigerator I'm considering purchasing?"

[1242] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1243] Step 1:

[1244] The server retrieves event information from databases and other sources. The input is detailed information about the event (name, date and time, location, content, etc.), and by obtaining this information, it obtains the basic data to generate event invitation messages.

[1245] Step 2:

[1246] The server generates an invitation message for each user based on the acquired event information. The input is the event information acquired in step 1, and the output is the invitation message. The generated message includes details of the event.

[1247] Step 3:

[1248] The server sends the generated invitation message to the user's terminal. The input is the invitation message generated in step 2 and the user's identification information (user ID, email address, etc.), and the output is the message sent to the user's terminal.

[1249] Step 4:

[1250] The user terminal receives the invitation message sent from the server and provides it to the user as a push notification or screen display. The input is the invitation message sent from the server, and the output is the user's confirmation of the message.

[1251] Step 5:

[1252] The user enters questions about the product they are considering purchasing into the terminal. For example, they might enter a query such as, "What are the features of the latest refrigerator?" The input is the user's query, and the output is the submission of the query.

[1253] Step 6:

[1254] The user terminal sends the user's inputted question to the server. The input is the user's query, and the output is the query sent to the server.

[1255] Step 7:

[1256] The server sends the received user query to a generative AI, which then generates appropriate information. The input is the user's query, and the output is the answer obtained from the generative AI. Specifically, the generative AI analyzes the query and generates relevant product information.

[1257] Step 8:

[1258] The server formats the responses obtained from the generative AI and compiles them into a message to be provided. The input is the response from the generative AI, and the output is the formatted suggestion message.

[1259] Step 9:

[1260] The server sends the formatted suggestion message to the user terminal. The input is the formatted suggestion message, and the output is the message sent to the user terminal.

[1261] Step 10:

[1262] The user terminal receives the suggestion message and displays it on the screen. The input is the suggestion message sent from the server, and the output is the displayed message. The user then confirms the suggested information.

[1263] Step 11:

[1264] The server retrieves relevant discount information from the database based on the product information the user intends to purchase. The input is the product information to be purchased, and the output is the discount information.

[1265] Step 12:

[1266] The server generates discount offer messages for users based on the acquired discount information. The input is discount information, and the output is a discount offer message. For example, the message might say, "Get a 20,000 yen discount when you purchase this refrigerator in conjunction with a contract for a specific service."

[1267] Step 13:

[1268] The server sends the generated discount offer message to the user's terminal. The input is the discount offer message, and the output is the message sent to the user's terminal.

[1269] Step 14:

[1270] The user terminal receives a discount offer message and displays it on the screen. The input is the discount offer message sent from the server, and the output is the displayed message. The user then reviews the discount offer and decides to make a purchase.

[1271] Step 15:

[1272] The emotion engine identifies the user's emotions and adjusts the content and tone of the messages it delivers. The input is the user's emotion data, and the output is the adjusted message. Specifically, it uses sensor data and machine learning models to determine the user's emotional state and adapts the message based on the results.

[1273] Specific example

[1274] Example prompt: "What are the features of the latest refrigerators?"

[1275] If the emotion engine identifies the user as excited, the output message will be "Wow! The latest refrigerators are Wi-Fi enabled and you can change the temperature settings from your smartphone."

[1276] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1277] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1278] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1279] [Third Embodiment]

[1280] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1281] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1282] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1283] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1284] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1285] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1286] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1287] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1288] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1289] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1290] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1291] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1292] This invention is a system that can acquire event information, generate and send invitation messages to users, suggest features of home appliances using generative AI, and acquire and display discount information. The specific server, terminal, and user operations for implementing this invention are described below.

[1293] Event information acquisition and invitations

[1294] 1. Server: First, the server retrieves detailed event information (e.g., event name, date and time, location, content) from the database or other sources. This retrieved information pertains to a specific event, such as a "character event."

[1295] 2. Server: Based on the acquired event information, the server generates an invitation message to send to each user. This invitation message includes detailed information about the event.

[1296] 3. Server: The generated invitation message is sent to each user's device using the user's identification information (e.g., user ID, email address).

[1297] 4. Device: The user's device receives the invitation message sent from the server and displays it to the user in the form of a push notification or similar.

[1298] 5. User: The user checks the event invitation message displayed on their device and selects whether or not to participate.

[1299] Information suggestions for home appliances using generative AI

[1300] 1. User: The user enters questions about the home appliance they are considering purchasing through the terminal. For example, they might enter a question such as, "What are the features of the latest refrigerators?"

[1301] 2. Terminal: The user's terminal sends the entered question to the server.

[1302] 3. Server: The server receives the user's question and sends its content as a query to the generative AI.

[1303] 4. Generative AI: Generative AI analyzes submitted queries and generates information about the features of home appliances. For example, it can create specific answers such as, "The latest refrigerators can connect to Wi-Fi and the temperature settings can be changed from a smartphone."

[1304] 5. Server: The server receives information obtained from the generative AI and formats it as suggested information for the user.

[1305] 6. Server: The formatted suggestion information is sent to the user's terminal.

[1306] 7. Terminal: The user's terminal displays the suggestion information sent from the server, and the user confirms it.

[1307] Discount information for simultaneous contract with SB Services

[1308] 1. User: The user selects the product they intend to purchase through their device. For example, they might select a refrigerator.

[1309] 2. Terminal: The selected product information is sent from the terminal to the server.

[1310] 3. Server: The server receives product information and retrieves relevant discount information from the database.

[1311] 4. Server: Based on the acquired discount information, the server generates a discount notification message to present to the user. For example, it may include content such as, "Get a 20,000 yen discount when you purchase this refrigerator at the same time as signing up for SB service."

[1312] 5. Server: The generated discount offer message is sent to the user's terminal.

[1313] 6. Terminal: The user's terminal displays the discount notification message sent from the server, and the user confirms it.

[1314] 7. User: The user confirms the discount offer message and decides to purchase.

[1315] As described above, the system of the present invention operates in cooperation with a server, terminal, and user, effectively performing event triggering, suggesting information on home appliances using a generative AI, and providing discount information.

[1316] The following describes the processing flow.

[1317] Event information acquisition and invitations

[1318] Step 1:

[1319] Server: Retrieves detailed event information from databases and other sources. This includes event name, date and time, location, and content.

[1320] Step 2:

[1321] Server: Generates an invitation message to send to the user based on the acquired event information. The invitation message includes details of the event.

[1322] Step 3:

[1323] Server: Sends the generated invitation message to each user's terminal using their identification information (e.g., user ID, email address).

[1324] Step 4:

[1325] Device: The user's device receives the invitation message sent from the server and displays it to the user as a push notification.

[1326] Step 5:

[1327] User: The user checks the event invitation message displayed on their device and selects whether or not to participate in the event.

[1328] Information suggestions for home appliances using generative AI

[1329] Step 1:

[1330] User: The user enters questions about the home appliance they are considering purchasing into the terminal. Example: "What are the features of the latest refrigerators?"

[1331] Step 2:

[1332] Terminal: The user's terminal sends the question to the server.

[1333] Step 3:

[1334] Server: The server receives user questions, formats them appropriately, and sends them as queries to the generative AI.

[1335] Step 4:

[1336] Generative AI: Generative AI analyzes received queries and generates answers to user questions. Example: "The latest refrigerators can connect via Wi-Fi, and the temperature settings can be changed from a smartphone."

[1337] Step 5:

[1338] Server: Receives responses from the generative AI and formats them into suggestion messages for the user.

[1339] Step 6:

[1340] Server: Sends the formatted suggestion message to the user's terminal.

[1341] Step 7:

[1342] Terminal: The user's terminal receives the suggestion message and displays it on the screen.

[1343] Step 8:

[1344] User: The user checks the suggestion message displayed on the device.

[1345] Discount information for simultaneous contract with SB Services

[1346] Step 1:

[1347] User: The user selects the product they intend to purchase on their device. Example: A new refrigerator.

[1348] Step 2:

[1349] Terminal: Sends the selected product information to the server.

[1350] Step 3:

[1351] Server: Receives product information and retrieves relevant discount information from the database.

[1352] Step 4:

[1353] Server: Based on the acquired discount information, it generates a discount notification message for the user. Example: "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[1354] Step 5:

[1355] Server: Sends a discount notification message to the user's device.

[1356] Step 6:

[1357] Terminal: The user's terminal receives the discount notification message and displays it on the screen.

[1358] Step 7:

[1359] User: The user checks the discount offer message displayed on the device and decides to make a purchase.

[1360] The above is a detailed explanation of each processing step for carrying out the present invention.

[1361] (Example 1)

[1362] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1363] Modern consumers expect to quickly and efficiently obtain information on various events, product features, and even discounts when making purchases. However, many systems on the market only provide this information individually, and there is a lack of systems that offer integrated suggestions. As a result, users have to refer to multiple sources to obtain information, wasting time and effort. This invention aims to solve this problem by providing a system that provides event information acquisition, product suggestions generated by AI, and discount information in an integrated manner.

[1364] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1365] In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for sending event invitation messages, means for processing information to suggest the features of home appliances using a generative AI, means for receiving and analyzing user questions, means for sending questions to a generative AI and generating answers, means for formatting the generated answers, means for generating and displaying suggestion information, and means for acquiring and displaying discount information. This makes it possible for users to efficiently acquire event information, information on the features of home appliances, and discount information through a single system.

[1366] "Event information" refers to detailed information about the event, such as its name, date and time, location, and content.

[1367] "Means of acquisition" refers to the means of obtaining necessary information from databases or external APIs.

[1368] An "event invitation message" refers to a message that contains detailed information about an event and is sent to a user.

[1369] "Generation means" refers to the means of generating messages or information in a specific format based on data.

[1370] "Transmission means" refers to the means used to send generated messages and information to users or devices.

[1371] "Generative AI" refers to artificial intelligence systems that use natural language processing to generate appropriate outputs for specific inputs.

[1372] "Information for suggesting features" refers to information about the features and functions of home appliances that are suggested to users.

[1373] "Processing means" refers to the means used for analyzing data and generating information.

[1374] "User questions" refer to questions or requests that users ask the system regarding home appliances.

[1375] "Receiving means" refers to the means of receiving input or data from an external source.

[1376] "Means of analysis" refers to the means of understanding received data or questions and processing them appropriately.

[1377] "Means of generating answers" refers to methods for creating answers to user questions using generative AI.

[1378] "Formatting methods" refer to means of displaying generated information in an appropriate format for the user.

[1379] "Proposed information" refers to specific information about the products and services offered to users.

[1380] "Display means" refers to the means of providing generated information or messages to the user visually.

[1381] "Discount information" refers to information about discounts and benefits that apply when purchasing goods or services.

[1382] This invention is a system that integrates the acquisition of event information, the generation and sending of invitation messages to users, the suggestion of features for home appliances using generative AI, and the provision of discount information. The operation of each component is described below.

[1383] Event information acquisition and invitations

[1384] Get event information

[1385] Server: Event information is retrieved from a database or Web API. SQL queries are used to extract detailed information from the database, such as event name, date and time, location, and content. A concrete example is retrieving information about a new movie premiere from the database.

[1386] Generating an invitation message

[1387] Server: Based on the acquired event information, it generates an invitation message using a template engine (e.g., Mustache or Jinja). For example, a message like "You're invited to the XX event! Date: Month XX, Day XX, Location: XX" is generated.

[1388] Sending an invitation message

[1389] Server: The generated invitation message is sent to each user's device using the user's identification information (e.g., email address, user ID). The email is sent using the SMTP protocol.

[1390] Displaying the invitation message

[1391] Device: The user's device receives the sent invitation message and displays it via push notification or email app. For mobile devices, Firebase Cloud Messaging (FCM) can be used.

[1392] User actions

[1393] User: Review the invitation message and choose whether or not to participate. For example, they can indicate their participation using a button within the app or a reply email.

[1394] Information suggestions for home appliances using generative AI

[1395] User question input

[1396] User: Enter a question (prompt) about the home appliance you are considering purchasing from your device. For example, enter "What are the features of the latest refrigerators?"

[1397] Submit a question

[1398] Terminal: User questions are sent to the server. They are sent as POST requests using the REST API.

[1399] Sending queries to generative AI

[1400] Server: Sends received questions as queries to the generative AI. For example, the OpenAI API may be used.

[1401] Answer generation by generative AI

[1402] Generative AI: Analyzes submitted queries and generates information about the features of home appliances. For example, it might generate answers such as, "The latest refrigerators can connect via Wi-Fi, and the temperature settings can be changed from a smartphone."

[1403] Formatting user-facing proposals

[1404] Server: Based on the generated responses, it formats them as user-facing suggestion information. It can be converted to Markdown or HTML format.

[1405] Submitting proposal information

[1406] Server: The formatted suggestion information is sent to the user's terminal.

[1407] Display of proposed information

[1408] Device: The user's device receives the suggested information and displays it in the app's interface. For example, information might be displayed as "Features of the latest refrigerators."

[1409] Discount information for simultaneous contract with SB Services

[1410] Product Selection

[1411] User: Select the item you intend to purchase on your device. For example, select "refrigerator".

[1412] Sending Selection Information

[1413] Terminal: Selected product information is sent to the server. Communication is performed using a REST API.

[1414] Obtaining discount information

[1415] Server: Based on product information, retrieve relevant discount information from the database. Execute SQL queries.

[1416] Generating discount information

[1417] Server: Based on discount information, it generates discount offer messages. For example, a message such as "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service" is generated.

[1418] Sending discount information

[1419] Server: Sends the generated discount offer message to the user's terminal.

[1420] Display of discount information

[1421] Device: Displays the discount offer message that was sent. It appears as a pop-up or notification within the app.

[1422] User's purchase decision

[1423] User: Check the discount offer and decide to purchase. Clicking the purchase button within the app completes the purchase process.

[1424] This enables the construction of a detailed system that can centrally provide event information, information suggestions for home appliances generated by a generative AI, and discount information.

[1425] Example of a prompt

[1426] "Could you tell me about the features of the latest refrigerators?"

[1427] "Please tell me more about the event 'XX'."

[1428] "Please tell me about any discounts I could get if I purchase this refrigerator."

[1429] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1430] Event information acquisition and invitations

[1431] Step 1:

[1432] The server accesses a database or external API to retrieve detailed event information. It executes SQL queries or API requests to extract information such as the event name, date and time, location, and content.

[1433] (Input) Database query or API request

[1434] (Data processing) Analyze the query results and extract the necessary information.

[1435] (Output) Event details

[1436] As a concrete example, execute the query "SELECT FROM events WHERE type='Character Events'" and retrieve the results.

[1437] Step 2:

[1438] Based on the acquired event information, the server generates an invitation message for the user using a template engine (such as Mustache or Jinja).

[1439] (Input) Event details

[1440] (Data processing) Embed information into a template to generate a message.

[1441] (Output) Generated invitation message

[1442] As a concrete example, we will generate a message that says, "You are invited to the XX event! Date: Month XX, Day XX, Location: XX".

[1443] Step 3:

[1444] The server sends the generated invitation message based on the user's identification information (e.g., user ID, email address). The email is sent using the SMTP protocol.

[1445] (Input) Invitation message, user identification information

[1446] (Data processing) Create email structure using SMTP client and send.

[1447] (Output) Confirmation of sent messages

[1448] As a concrete example, an invitation email is sent to each user's email address.

[1449] Step 4:

[1450] The device receives the invitation message sent from the server and displays it to the user via push notification or email app. Firebase Cloud Messaging (FCM) or an email app is used.

[1451] (Input) Received invitation message

[1452] (Data processing) Display as notification or email.

[1453] (Output) Invitation message displayed on the terminal

[1454] As a concrete example, FCM is used to display a push notification on the device saying, "You're invited to the XX event!"

[1455] Step 5:

[1456] Users review the invitation message displayed on their device and choose whether or not to participate. They can do so using the "Join" button or a reply email.

[1457] (Enter) Invitation message

[1458] (Data processing) Recording user actions

[1459] (Output) Participation intention information

[1460] As a concrete example, you can confirm your participation by clicking the "Join" button in the invitation email.

[1461] Information suggestions for home appliances using generative AI

[1462] Step 1:

[1463] The user enters questions about the home appliance they are considering purchasing via their device, using the app's text input field.

[1464] (Input) User's question

[1465] (Data processing) Text analysis

[1466] (Output) Structured query

[1467] As a concrete example, enter "What are the features of the latest refrigerators?"

[1468] Step 2:

[1469] The terminal sends the entered question to the server. It sends a POST request using the REST API.

[1470] (Input) User's question

[1471] (Data processing) Send to the server via REST API

[1472] (Output) Request to the server

[1473] As a concrete example, the "question content" is included as the payload of the POST request and sent to the server.

[1474] Step 3:

[1475] The server receives the user's question and sends its content as a query to the generative AI. For example, it might call the OpenAI API.

[1476] (Input) User's question

[1477] (Data processing) Send the question to the generative AI.

[1478] (Output) Query to a generative AI

[1479] As a concrete example, we send a question to the OpenAI GPT-3 endpoint and obtain a response.

[1480] Step 4:

[1481] The generative AI analyzes the submitted query and generates information about the features of home appliances. It uses natural language processing to generate appropriate answers.

[1482] (Input) User's question

[1483] (Data processing) Answer generation based on natural language processing

[1484] (Output) Generated answer

[1485] As a concrete example, it generates specific answers such as, "The latest refrigerators can connect via Wi-Fi, allowing you to change the temperature settings from your smartphone."

[1486] Step 5:

[1487] The server receives the responses from the generative AI and formats them as user-friendly suggestions. It can also convert them to Markdown or HTML format.

[1488] (Input) Generated response

[1489] (Data processing) Formatting of answers (e.g., Markdown or HTML format)

[1490] (Output) Response as proposed information

[1491] As a concrete example, information can be formatted in the following way: "The features of the latest refrigerator are as follows: - WiFi connectivity - Temperature can be set from your smartphone."

[1492] Step 6:

[1493] The server sends the formatted suggestion information to the user's terminal. Communication then occurs again using the REST API.

[1494] (Input) Formatted proposal information

[1495] (Data processing) Sent via REST API

[1496] (Output) Response to terminal

[1497] As a concrete example, a response containing the proposed information is sent to the terminal.

[1498] Step 7:

[1499] The user's device displays the received suggestion information through the app's interface.

[1500] (Input) Proposal Information

[1501] (Data processing) Conversion to display format

[1502] (Output) Displayed within the app

[1503] As a concrete example, information such as "Features of the latest refrigerator" is displayed in a text view within the app.

[1504] Discount information for simultaneous contract with SB Services

[1505] Step 1:

[1506] Users select the items they intend to purchase through their device. They can choose from a product list within the app.

[1507] (Input) Selected product

[1508] (Data processing) Retrieval of product ID

[1509] (Output) Product ID

[1510] As a concrete example, select "refrigerator" from the product list.

[1511] Step 2:

[1512] The terminal sends the selected product information to the server. Communication is performed using a REST API.

[1513] (Input) Selected product information

[1514] (Data processing) Send to the server via REST API

[1515] (Output) Request to the server

[1516] As a concrete example, data containing the product ID of "refrigerator" is sent to the server.

[1517] Step 3:

[1518] The server receives product information and retrieves relevant discount information from the database. It then executes an SQL query.

[1519] (Input) Selected product information

[1520] (Data processing) Execution of database queries

[1521] (Output) Discount Information

[1522] As a concrete example, execute the query "SELECT FROM discounts WHERE product_id='refrigerator'" to retrieve discount information.

[1523] Step 4:

[1524] The server generates a discount notification message to present to the user based on the acquired discount information. A template engine is used.

[1525] (Input) Discount information

[1526] (Data processing) Message generation using a template engine

[1527] (Output) Discount notification message

[1528] As a concrete example, it generates messages such as, "If you purchase this refrigerator at the same time as signing up for SB Service, you will receive a 20,000 yen discount."

[1529] Step 5:

[1530] The server sends the generated discount offer message to the user's device. Communication is performed using a REST API.

[1531] (Input) Discount offer message

[1532] (Data processing) Sent via REST API

[1533] (Output) Response to terminal

[1534] As a concrete example, a discount offer message is sent as a response.

[1535] Step 6:

[1536] The device will display the discount offer message that was sent. It will appear as a pop-up or notification within the app.

[1537] (Input) Discount offer message

[1538] (Data processing) Conversion to display format

[1539] (Output) Display on user terminal

[1540] For example, data such as "Get a 20,000 yen discount when you buy this refrigerator" will pop up.

[1541] Step 7:

[1542] The user reviews the discount offer message and decides to purchase. The purchase is confirmed by clicking the purchase button in the app.

[1543] (Input) Discount offer message

[1544] (Data processing) Recording user actions

[1545] (Output) Purchase decision information

[1546] As a concrete example, tap the "Purchase" button to complete the purchase process.

[1547] As a result, through these detailed processing steps, the system of the present invention can provide event invitations, information suggestions for home appliances, and discount information in an integrated and efficient manner.

[1548] (Application Example 1)

[1549] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1550] While modern consumers have access to a wide variety of products and event information, the sheer volume of information makes it difficult for them to make informed decisions. Furthermore, the ability to quickly access detailed product information and discount offers can significantly boost purchasing behavior. In particular, there is a growing need to utilize generative AI to provide users with the information they seek in a timely manner. Current systems only provide event and discount information individually, lacking a unified and efficient means of delivery. This makes it difficult for consumers to make optimal choices, leading to decreased satisfaction.

[1551] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1552] In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for sending event invitation messages, means for processing information for suggesting product features using a generative AI, means for generating and displaying suggestion information, means for acquiring and displaying discount information, means for calling a generative AI that receives user questions and generates answer information, and means for sending push notifications to the user terminal. This makes it possible to centrally and timely provide event invitations, product information suggestions, and discount information notifications.

[1553] "Event information" refers to detailed information about an event that will be held at a specific date, time, and location.

[1554] "Generative AI" refers to a system that uses artificial intelligence technology to generate new information or answers from input data.

[1555] "Suggested information" refers to information about a product, such as its features and usage, that a generative AI provides based on the user's questions and purchase intentions.

[1556] "Discount information" refers to information about discounts and promotions offered for specific products or services.

[1557] A "user terminal" refers to a device that the user directly operates, and includes smartphones, tablets, and personal computers.

[1558] A "push notification" is a notification message sent in real time from a server to a user's device.

[1559] An "event invitation message" is a message containing detailed information to invite a user to a specific event.

[1560] "Processing means" refers to a combination of hardware and software for receiving and processing data.

[1561] A "generation method" is a combination of hardware and software used to generate new information or messages based on specific data.

[1562] "Transmission means" refers to the means of communication used to send information from a server to a user terminal.

[1563] A "means of invocation" refers to a means of issuing a trigger or instruction to execute a specific function or service when needed.

[1564] "Acquisition method" refers to a combination of hardware and software used to retrieve specific information from databases, external APIs, etc.

[1565] "Display means" refers to a function for visually displaying information on the screen of a user's terminal or similar device.

[1566] This invention is a system that acquires event information, generates and sends invitation messages to users, suggests product features using a generative AI, and acquires and displays discount information. The operations of the server, terminal, and user necessary to implement this invention are as follows.

[1567] Event information acquisition and invitations

[1568] The server first retrieves event information from a database or other sources. This event information includes the event name, date and time, location, and content. Next, the server generates an event invitation message to send to each user based on this retrieved information. The generated invitation message is sent to each user's device using the user's identification information (e.g., user ID or email address). The user's device displays the received invitation message as a push notification, allowing the user to confirm the invitation message.

[1569] Product information suggestions using generative AI

[1570] The user enters a question about a product they are considering purchasing through their device. For example, "What are the features of the latest refrigerator?" The user's device sends this question to the server. The server passes the received question to a generative AI, which analyzes the question and generates information about the product's features. The generated information is sent to the user's device via the server and displayed on the device.

[1571] Discount information

[1572] The user selects the items they intend to purchase through their device. The selected item information is sent from the device to the server, which retrieves relevant discount information from its database. Based on this discount information, the server generates a discount notification message to present to the user. The generated discount notification message is sent to the user's device, where the user can review it.

[1573] Hardware and software to be used

[1574] Server: The server-side uses a web framework such as Flask to perform data processing and message generation.

[1575] Generative AI models: We use generative AI models such as OpenAI's GPT-3.

[1576] User terminal: A device operated by the user, such as a smartphone, tablet, or personal computer.

[1577] Push notification service: Real-time notifications are provided using services such as Firebase and OneSignal.

[1578] Example of program processing

[1579] For example, if a user asks, "What features do the latest refrigerators have?", the generative AI will generate information such as, "The latest refrigerators can connect to Wi-Fi and allow you to change the temperature settings from your smartphone."

[1580] Examples of generated AI prompts:

[1581] User question: What features do the latest refrigerators have?

[1582] What are the features of the latest home appliances (such as refrigerators)?

[1583] Thus, the system of the present invention can efficiently and effectively notify users of event invitations, product information suggestions, and discount information through cooperation between a server, a terminal, and a generative AI model.

[1584] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1585] Step 1:

[1586] The server retrieves event information from a database or external API. The retrieved event information includes the event name, date and time, location, and content. Based on this data, the server performs the following processing.

[1587] Input: Event information obtained from a database or external API (event name, date and time, location, details)

[1588] Output: List of retrieved event information

[1589] Step 2:

[1590] Based on the event information acquired by the server, an event invitation message is generated to be sent to each user. The generated message includes detailed information about the event.

[1591] Input: Retrieved event information

[1592] Output: Event invitation message to send to each user

[1593] Step 3:

[1594] The server generates an event invitation message and sends it to each user's device using the user's identification information (e.g., user ID or email address).

[1595] Input: Event invitation message, user identification information

[1596] Output: Event invitation message sent to the user's terminal

[1597] Step 4:

[1598] The event invitation message received by the user's device from the server is displayed to the user as a push notification.

[1599] Input: Event invitation message received from the server

[1600] Output: Event invitation message displayed on the user's device's push notification screen.

[1601] Step 5:

[1602] The user enters questions about the product they are considering purchasing through a terminal. For example, a question like, "What are the features of the latest refrigerator?" The terminal then sends the entered questions to the server.

[1603] Input: A product-related question entered by the user.

[1604] Output: Question data sent to the server

[1605] Step 6:

[1606] The server passes the question received from the user to a generative AI. The generative AI analyzes the question and generates information about the product's features.

[1607] Input: User's question data

[1608] Output: Response data generated by the AI.

[1609] Step 7:

[1610] The server receives the response data obtained from the generative AI, formats it, and sends it to the user's terminal as suggested information for the user.

[1611] Input: Response data received from a generative AI.

[1612] Output: Formatted proposal information

[1613] Step 8:

[1614] The user's device displays the suggestion information sent from the server.

[1615] Input: Suggestion information received from the server

[1616] Output: Suggestion information displayed on the user's terminal screen

[1617] Step 9:

[1618] The user selects the items they intend to purchase through their device. The device then sends the selected item information to the server.

[1619] Input: Product information selected by the user

[1620] Output: Product information sent to the server

[1621] Step 10:

[1622] The server receives product information and retrieves relevant discount information from the database.

[1623] Input: Product information sent to the server

[1624] Output: Discount information retrieved from the database

[1625] Step 11:

[1626] Based on the discount information acquired by the server, a discount notification message is generated to be presented to the user.

[1627] Input: Retrieved discount information

[1628] Output: Generated discount offer message

[1629] Step 12:

[1630] The server generates a discount offer message and sends it to the user's device.

[1631] Input: Discount offer message

[1632] Output: Discount notification message sent to the user's terminal

[1633] Step 13:

[1634] The user's device displays the discount notification message received from the server.

[1635] Input: Discount notification message received from the server

[1636] Output: Discount notification message displayed on the user's terminal screen

[1637] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1638] This invention is a system that combines the acquisition of event information, generation and transmission of invitation messages, suggestion of home appliance features using generative AI, acquisition and display of discount information, and an emotion engine that recognizes user emotions and adjusts the presented content. The operation of the server, terminal, user, and emotion engine in an embodiment of this invention is described below.

[1639] Event information acquisition and invitations

[1640] 1. Server: Retrieves detailed event information (event name, date and time, location, content, etc.) from databases and other sources.

[1641] 2. Server: Based on the acquired event information, it generates an invitation message to send to the user. The generated invitation message includes detailed information about the event.

[1642] 3. Server: Uses user identification information (e.g., user ID, email address) to send the generated invitation message to each user's device.

[1643] 4. Device: The user's device receives the invitation message sent from the server and displays it to the user as a push notification.

[1644] 5. User: The user checks the event invitation message displayed on their device and selects whether or not to participate in the event.

[1645] Information suggestions for home appliances using generative AI

[1646] 1. User: The user enters questions about the home appliance they are considering purchasing into the terminal. For example, "What are the features of the latest refrigerators?"

[1647] 2. Terminal: The user's terminal sends the entered question to the server.

[1648] 3. Server: The server receives the user's question and sends it as a query to the generative AI.

[1649] 4. Generative AI: Generative AI analyzes queries and generates answers to user questions. For example, information such as, "The latest refrigerators can connect to Wi-Fi and the temperature settings can be changed from a smartphone."

[1650] 5. Server: Receives responses from the generative AI and formats them into suggestion messages for the user.

[1651] 6. Server: Sends the formatted suggestion message to the user's terminal.

[1652] 7. Terminal: The user's terminal receives the suggestion message and displays it on the screen.

[1653] 8. User: The user checks the suggestion message displayed on the device.

[1654] Discount information for simultaneous contract with SB Services

[1655] 1. User: The user selects the product they intend to purchase on the device. For example, they might select the latest refrigerator.

[1656] 2. Terminal: Sends the selected product information to the server.

[1657] 3. Server: Receives product information and retrieves relevant discount information from the database.

[1658] 4. Server: Based on the acquired discount information, it generates discount notification messages for users. For example, it may include content such as, "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[1659] 5. Server: Sends the generated discount offer message to the user's terminal.

[1660] 6. Terminal: The user's terminal receives the discount notification message and displays it on the screen.

[1661] 7. User: The user checks the discount offer message displayed on the device and decides to make a purchase.

[1662] Adjustment by the emotion engine

[1663] 1. Emotion Engine: Analyzes the user's current emotions using sensor data and machine learning models to recognize the user's emotions.

[1664] 2. Emotion Engine: In the case of event invitation messages, the message content is adjusted based on the user's emotions. For example, when the user is excited, more passionate language is used.

[1665] 3. Emotional Engine: In the case of suggestion information for home appliances, the tone and level of detail of the suggestions are adjusted based on the user's emotions. For example, if the user is calm, more technical details are provided.

[1666] 4. Emotion Engine: In the case of discount announcement messages, the way the message is presented is adjusted based on the user's emotions. For example, if the user is confused, a more concise and intuitive message is provided.

[1667] As described above, the system of the present invention works in cooperation with a server, terminal, user, generative AI, and emotion engine to effectively provide event triggers, home appliance information suggestions, and discount announcements. The addition of the emotion engine further personalizes the user experience and enables more efficient information delivery.

[1668] The following describes the processing flow.

[1669] Event information acquisition and invitations

[1670] Step 1:

[1671] Server: Retrieves detailed event information (event name, date and time, location, content, etc.) from databases and other sources.

[1672] Step 2:

[1673] Server: Generates an invitation message based on the acquired event information.

[1674] Step 3:

[1675] Server: Uses user identification information (such as user ID) to send an invitation message to the user's device.

[1676] Step 4:

[1677] Terminal: Receives invitation messages sent from the server and displays them to the user as push notifications.

[1678] Step 5:

[1679] User: Check the invitation message displayed on the device and choose whether or not to participate in the event.

[1680] Information suggestions for home appliances using generative AI

[1681] Step 1:

[1682] User: Enters questions about the home appliance they are considering purchasing into the terminal. Example: "What are the features of the latest refrigerators?"

[1683] Step 2:

[1684] Terminal: The user's terminal sends the entered question to the server.

[1685] Step 3:

[1686] Server: Receives user questions and sends them as queries to the generative AI.

[1687] Step 4:

[1688] Generative AI: Analyzes submitted queries and generates answers to user questions. For example, it might respond with information such as, "The latest refrigerators can connect via Wi-Fi, and the temperature settings can be changed from a smartphone."

[1689] Step 5:

[1690] Server: Formats the responses received from the generative AI into user-facing suggestion messages.

[1691] Step 6:

[1692] Server: Sends the formatted suggestion message to the user's terminal.

[1693] Step 7:

[1694] Terminal: Receives suggestion messages and displays them on the screen.

[1695] Step 8:

[1696] User: Check the displayed suggestion message.

[1697] Discount information for simultaneous contract with SB Services

[1698] Step 1:

[1699] User: Select the product you intend to purchase on your device. Example: A new refrigerator.

[1700] Step 2:

[1701] Terminal: Sends the selected product information to the server.

[1702] Step 3:

[1703] Server: Receives product information and retrieves relevant discount information from the database.

[1704] Step 4:

[1705] Server: Based on the acquired discount information, it generates a discount notification message for the user. Example: "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[1706] Step 5:

[1707] Server: Sends the generated discount offer message to the user's terminal.

[1708] Step 6:

[1709] Terminal: Receives discount notification messages and displays them on the screen.

[1710] Step 7:

[1711] User: Checks the displayed discount message and decides to purchase.

[1712] Adjustment by the emotion engine

[1713] Step 1:

[1714] Emotion Engine: Analyzes the user's current emotions using sensor data and machine learning models to recognize the user's feelings.

[1715] Step 2:

[1716] Emotion Engine: Adjusts the content of event invitation messages based on recognized emotions. For example, if the user is excited, it will use more passionate language.

[1717] Step 3:

[1718] Emotion Engine: Adjusts suggested information for home appliances based on recognized emotions. For example, if the user is calm, it will provide more technical details.

[1719] Step 4:

[1720] Emotion Engine: Based on recognized emotions, it adjusts how discount offer messages are presented. For example, if a user is confused, it provides a concise and intuitive message.

[1721] The above is a detailed processing flow when combining the emotion engine. This system allows for a more personalized user experience and more efficient information delivery.

[1722] (Example 2)

[1723] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1724] While systems exist that provide event information, product information, and discount information individually, few systems integrate this information and provide personalized information tailored to the user's emotions. There is a need to improve the user experience by providing optimal information according to the user's needs and emotions, but conventional systems have not adequately achieved this. This invention aims to solve this problem and provide users with more effective and personalized information.

[1725] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for transmitting event invitation messages, means for receiving questions about home appliances and querying a generative AI, means for processing information to propose the features of home appliances using the generative AI, means for generating and displaying the proposed information, means for acquiring and displaying discount information, and an emotion engine that recognizes the user's emotions and adjusts the message content based on those emotions. This enables the effective provision of event information, features of home appliances, and discount information to the user, as well as the provision of personalized information according to emotions.

[1726] "Event information" refers to detailed information about the event, such as its name, date and time, location, and content.

[1727] "Means of acquisition" refers to methods and devices for collecting necessary information from databases, external APIs, etc.

[1728] "Generative means" refers to methods or devices for creating messages or proposals tailored to specific purposes based on collected information.

[1729] "Transmission means" refers to methods and devices for delivering generated messages and information to the user's terminal via communication means.

[1730] "Questions about home appliances" refers to inquiries from users about specific information and features they want to know about home appliances.

[1731] "Generative AI" refers to artificial intelligence models and systems that generate appropriate answers and suggestions in response to user questions and requests.

[1732] "Suggested information" refers to advice and guides provided in the form of detailed information, features, and usage examples regarding home appliances.

[1733] "Display means" refers to devices such as displays and monitors used to visually present collected or generated information to the user.

[1734] "Discount information" refers to information about discounts and benefits that apply when purchasing specific products or services.

[1735] An "emotion engine" refers to a system or algorithm that recognizes a user's emotions and adjusts how information is presented based on those emotions.

[1736] "User terminal" refers to a device used directly by the user (e.g., smartphone, tablet, personal computer).

[1737] This invention is a system that combines the acquisition of event information, generation and transmission of invitation messages, suggestion of home appliance features using generative AI, acquisition and display of discount information, and an emotion engine that recognizes user emotions and adjusts the presented content. The operation of the server, terminal, user, and emotion engine in an embodiment of this invention is described below.

[1738] Event information acquisition and invitations

[1739] Server: Retrieves detailed event information (event name, date and time, location, content, etc.) from a database or external API. Based on the retrieved information, the server generates an invitation message to send to users and sends the message to each user's device using the user's identification information.

[1740] Terminal: Receives invitation messages sent from the server and displays them to the user as push notifications.

[1741] User: Check the event invitation message displayed on the device and select whether or not to participate in the event.

[1742] Information suggestions for home appliances using generative AI

[1743] User: Enter questions into the terminal about the home appliance you are considering purchasing. For example, you might enter a question like, "What are the features of the latest refrigerators?"

[1744] Terminal: Sends the questions entered by the user to the server.

[1745] Server: Receives user questions and sends them as queries to the generative AI. The server receives the answers from the generative AI, formats them as suggestion messages for the user, and sends them to the user's terminal.

[1746] Generative AI: Analyzes queries and generates answers to user questions. For example, it might generate information such as, "The latest refrigerators can connect to Wi-Fi and allow you to change the temperature setting from your smartphone."

[1747] Terminal: Receives suggestion messages and displays them on the screen.

[1748] User: Check the suggestion message displayed on the device.

[1749] Discount information for simultaneous contract with SB Services

[1750] User: Select the product you intend to purchase on your device. For example, select the latest refrigerator.

[1751] Terminal: Sends the selected product information to the server.

[1752] Server: Receives product information, retrieves relevant discount information from the database, and generates a discount notification message for the user. For example, it may include content such as, "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[1753] Terminal: Receives discount notification messages and displays them on the screen.

[1754] User: Checks the discount offer message displayed on the device and decides to purchase.

[1755] Adjustment by the emotion engine

[1756] Emotion Engine: To recognize the user's emotions, it analyzes the user's current emotions using data collected from sensors, cameras, microphones, etc., as well as machine learning models.

[1757] Emotion Engine: For event invitation messages, the message content is adjusted based on the user's emotions. For example, when the user is excited, more passionate language is used.

[1758] Emotional Engine: In the case of consumer electronics product recommendations, the tone and level of detail of the recommendations are adjusted based on the user's emotions. For example, if the user is calm, more technical details are provided.

[1759] Emotion Engine: In the case of discount offer messages, the way the message is presented is adjusted based on the user's emotions. For example, if the user is confused, a more concise and intuitive message is provided.

[1760] Specific example

[1761] Event information acquisition and invitations

[1762] Example: When a user receives an invitation message for an event called "Summer Concert 2023".

[1763] Example prompt: "Please create an invitation message based on the following event information: Event name: Summer Concert 2023, Date: August 15, 2023, Location: Tokyo Dome, Content: Live performance by popular artists"

[1764] Information suggestions for home appliances using generative AI

[1765] Example: When a user asks about the features of a new refrigerator.

[1766] Example prompt: "Please tell me about the features of the latest refrigerators. I would especially appreciate details about any features such as Wi-Fi and smart functions."

[1767] Discount information for simultaneous contract with SB Services

[1768] Example: When a user decides to purchase a refrigerator and receives discount information.

[1769] Example prompt: "Please create a message offering a discount when selecting the latest refrigerator model. Include discount information for simultaneous contract with SB Service."

[1770] Adjustment by the emotion engine

[1771] Example: When a user receives an event invitation while in an excited state.

[1772] Example prompt: "Create an event invitation message for when the user is excited. Use passionate language."

[1773] As described above, the system of the present invention works in cooperation with a server, terminal, user, generative AI, and emotion engine to effectively trigger events, suggest information on home appliances, and provide discount information. The addition of the emotion engine further personalizes the user experience and enables efficient information delivery.

[1774] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1775] Program processing flow

[1776] Event information acquisition and invitations

[1777] Step 1:

[1778] Server: Retrieves event information. In this step, detailed event information (event name, date and time, location, content, etc.) is retrieved from a database or external API. This data is the input, and the output is the retrieved event information.

[1779] Step 2:

[1780] Server: Generates an invitation message based on the acquired event information. The input is the acquired event information, and the output is an invitation message to be sent to the user. Specifically, it embeds the event information according to a template and generates the message.

[1781] Step 3:

[1782] Server: Uses user identification information (e.g., user ID, email address) to send a generated invitation message to each user's device. Input is user information and the generated invitation message, and output is the sent message.

[1783] Step 4:

[1784] Terminal: Receives invitation messages sent from the server and displays them to the user as push notifications. The input is the invitation message received on the terminal, and the output is the push notification displayed on the screen.

[1785] Step 5:

[1786] User: The user reviews the event invitation message displayed on their device and selects whether or not to attend the event. The input is the displayed invitation message, and the output is the user's selection.

[1787] Information suggestions for home appliances using generative AI

[1788] Step 1:

[1789] User: Enters questions into the terminal about home appliances they are considering purchasing. For example, they might enter a question like, "What are the features of the latest refrigerators?" The input is the user's question, and the output is the entry to the terminal.

[1790] Step 2:

[1791] Terminal: Sends user-entered questions to the server. Input is the user's question, and output is the query sent to the server.

[1792] Step 3:

[1793] Server: Receives user questions and sends them as queries to the generative AI. The input is the user's question, and the output is the query to the generative AI.

[1794] Step 4:

[1795] Generative AI: Analyzes queries and generates answers to user questions. For example, it might generate information such as, "The latest refrigerators can connect to Wi-Fi and allow temperature settings to be changed from a smartphone." The input is a query from the server, and the output is the answer generated by the AI.

[1796] Step 5:

[1797] Server: Receives responses from generative AI and formats them into user-facing suggestion messages. The input is the response from the generative AI, and the output is the formatted suggestion message.

[1798] Step 6:

[1799] Server: Sends a formatted suggestion message to the user's terminal. The input is the formatted suggestion message, and the output is the message sent to the user's terminal.

[1800] Step 7:

[1801] Terminal: Receives suggestion messages and displays them on the screen. Input is the message received from the server, and output is the suggestion message displayed on the terminal.

[1802] Step 8:

[1803] User: Confirm the suggestion message displayed on the terminal. The input is the suggestion message displayed on the terminal, and the output is the user's confirmation result.

[1804] Discount information for simultaneous contract with SB Services

[1805] Step 1:

[1806] User: Selects the product they intend to purchase on the terminal. For example, they might select the latest refrigerator. The input is the user's selection, and the output is the information about the selected product.

[1807] Step 2:

[1808] Terminal: Sends selected product information to the server. The input is the selected product information, and the output is the data sent to the server.

[1809] Step 3:

[1810] Server: Receives product information and retrieves relevant discount information from the database. The input is the selected product information, and the output is the retrieved discount information.

[1811] Step 4:

[1812] Server: Based on the acquired discount information, it generates a discount notification message for the user. For example, it might include content such as, "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service." The input is discount information, and the output is the generated discount notification message.

[1813] Step 5:

[1814] Server: Sends the generated discount offer message to the user's terminal. The input is the discount offer message, and the output is the message sent to the user's terminal.

[1815] Step 6:

[1816] Terminal: Receives discount offer messages and displays them on the screen. The input is the message received from the server, and the output is the discount offer displayed on the terminal.

[1817] Step 7:

[1818] User: Checks the discount offer message displayed on the device and decides to purchase. The input is the discount offer message displayed on the device, and the output is the user's purchase decision.

[1819] Adjustment by the emotion engine

[1820] Step 1:

[1821] Emotion Engine: To recognize the user's emotions, it analyzes the user's current emotions using data collected from sensors, cameras, microphones, etc., and machine learning models. The input is data collected from sensors, etc., and the output is the analysis result.

[1822] Step 2:

[1823] Emotion Engine: For event invitation messages, this adjusts the message content based on the user's emotions. When the user is excited, it uses more passionate language. The input is the user's emotion analysis result and the original invitation message, and the output is the adjusted invitation message.

[1824] Step 3:

[1825] Emotional Engine: In the case of consumer electronics product recommendations, the tone and level of detail of the recommendations are adjusted based on the user's emotions. For example, if the user is calm, more technical details are provided. The input is the user's emotion analysis results and the original recommendation information, and the output is the adjusted recommendation message.

[1826] Step 4:

[1827] Emotion Engine: In the case of discount offer messages, it adjusts how the message is presented based on the user's emotions. For example, if the user is confused, it provides a more concise and intuitive message. The input is the user's emotion analysis result and the original discount offer message, and the output is the adjusted discount offer message.

[1828] (Application Example 2)

[1829] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1830] Conventional online shopping systems often provide users with uniform information and promotions, lacking personalized suggestions that take into account individual users' interests and emotions. This can limit the user experience and potentially lower customer satisfaction. This invention aims to increase customer satisfaction and purchasing intent by providing information and promotions that take user emotions into consideration.

[1831] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1832] In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for sending event invitation messages, means for processing information for suggesting product information using a generative AI, means for generating and displaying suggestion information, means for acquiring and displaying discount information, and means including an emotion engine that identifies the user's emotions and adjusts the message content. This enables personalized information provision and promotion based on the user's individual emotional state.

[1833] "Event information" refers to detailed information (such as name, date, time, location, and content) about a specific event, sale, or promotion.

[1834] An "invitation message" refers to a message generated based on event information that includes content encouraging users to participate in the event.

[1835] "Generative AI" refers to artificial intelligence that automatically generates and provides specific information in response to user queries.

[1836] "Product information" includes detailed descriptions and recommendations about the product's features and attributes.

[1837] "Recommended information" refers to recommendations for specific products or services that are generated based on the user's search history and questions.

[1838] "Discount information" refers to information regarding price reductions or promotions for specific products.

[1839] An "emotion engine" refers to a system that uses machine learning models and sensor data to identify a user's emotions and adjust the content and tone of the messages presented based on those emotions.

[1840] A "user terminal" refers to a mobile device such as a smartphone that has the function of receiving messages from a server and displaying them to the user.

[1841] "Push notifications" refer to a notification method in which information is sent from a server in real time and immediately displayed on the user's device screen.

[1842] This invention relates to an online shopping system for providing personalized information and promotions that take user emotions into consideration. The system consists of a server, a user terminal, a generative AI, and an emotion engine.

[1843] Server Functions

[1844] The server has the following main functions:

[1845] 1. Retrieving event information: The server retrieves detailed information about the event (name, date and time, location, content, etc.) from the database and other sources.

[1846] 2. Generating invitation messages: Based on the acquired event information, an invitation message is generated for each user. The message will include details of the event.

[1847] 3. Sending the message: The generated invitation message is sent to the user's device using the user's identification information (such as email address or user ID).

[1848] 4. Product Information Suggestion: Based on user queries, the system collaborates with a generative AI to generate and organize product information and propose it to the user.

[1849] 5. Provision of discount information: Based on the product information of the item the user intends to purchase, relevant discount information will be retrieved from the database and provided to the user.

[1850] User terminal functions

[1851] The user terminal has the following functions:

[1852] 1. Receiving and displaying messages: Receive invitation messages, discount information, and product suggestion messages sent from the server, and provide them to the user as push notifications or on-screen displays.

[1853] 2. User query submission: The user enters a question about a product they are considering purchasing and sends that query to the server.

[1854] Functions of Generative AI

[1855] Generative AI generates information based on user queries:

[1856] 1. Query Analysis: Analyze user questions and collect and generate appropriate information.

[1857] 2. Answer generation: For the analyzed query, specific information is generated (e.g., for "What are the features of the latest refrigerators?", the answer is "The latest refrigerators are Wi-Fi enabled and the temperature settings can be changed from a smartphone").

[1858] Functions of the Emotion Engine

[1859] The emotion engine identifies the user's emotions and tailors the messages it delivers:

[1860] 1. Emotion Identification: Sensor data and machine learning models are used to determine the user's current emotional state.

[1861] 2. Message Adjustment: Adjust the tone and content of the message based on the determined emotion. For example, if the user is excited, use more energetic language.

[1862] Hardware and software to use

[1863] Smartphone: Used as a user terminal. It receives and displays messages.

[1864] EmotionEngine: Used as an emotion engine to analyze user emotions. It leverages existing models such as the Microsoft Azure Emotion API and Emotion SDK.

[1865] AIGenerator: Used as a generative AI to generate information in response to user queries. It utilizes OpenAI GPT-3, ChatGPT, and other technologies.

[1866] Specific example

[1867] If a user is considering purchasing a refrigerator, they might send a query via a smartphone app asking, "What are the features of the latest refrigerators?" The server uses generative AI to generate a response such as, "The latest refrigerators are Wi-Fi enabled and allow you to change the temperature settings from your smartphone." The emotion engine analyzes the user's emotions and, for example, if the user is excited, provides the user with a more tailored message, such as, "Wow! The latest refrigerators are Wi-Fi enabled and allow you to change the temperature settings from your smartphone."

[1868] Example of a prompt:

[1869] "What are the features of the latest refrigerators?"

[1870] "Do you have any information on discounts for the refrigerator I'm considering purchasing?"

[1871] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1872] Step 1:

[1873] The server retrieves event information from databases and other sources. The input is detailed information about the event (name, date and time, location, content, etc.), and by obtaining this information, it obtains the basic data to generate event invitation messages.

[1874] Step 2:

[1875] The server generates an invitation message for each user based on the acquired event information. The input is the event information acquired in step 1, and the output is the invitation message. The generated message includes details of the event.

[1876] Step 3:

[1877] The server sends the generated invitation message to the user's terminal. The input is the invitation message generated in step 2 and the user's identification information (user ID, email address, etc.), and the output is the message sent to the user's terminal.

[1878] Step 4:

[1879] The user terminal receives the invitation message sent from the server and provides it to the user as a push notification or screen display. The input is the invitation message sent from the server, and the output is the user's confirmation of the message.

[1880] Step 5:

[1881] The user enters questions about the product they are considering purchasing into the terminal. For example, they might enter a query such as, "What are the features of the latest refrigerator?" The input is the user's query, and the output is the submission of the query.

[1882] Step 6:

[1883] The user terminal sends the user's inputted question to the server. The input is the user's query, and the output is the query sent to the server.

[1884] Step 7:

[1885] The server sends the received user query to a generative AI, which then generates appropriate information. The input is the user's query, and the output is the answer obtained from the generative AI. Specifically, the generative AI analyzes the query and generates relevant product information.

[1886] Step 8:

[1887] The server formats the responses obtained from the generative AI and compiles them into a message to be provided. The input is the response from the generative AI, and the output is the formatted suggestion message.

[1888] Step 9:

[1889] The server sends the formatted suggestion message to the user terminal. The input is the formatted suggestion message, and the output is the message sent to the user terminal.

[1890] Step 10:

[1891] The user terminal receives the suggestion message and displays it on the screen. The input is the suggestion message sent from the server, and the output is the displayed message. The user then confirms the suggested information.

[1892] Step 11:

[1893] The server retrieves relevant discount information from the database based on the product information the user intends to purchase. The input is the product information to be purchased, and the output is the discount information.

[1894] Step 12:

[1895] The server generates discount offer messages for users based on the acquired discount information. The input is discount information, and the output is a discount offer message. For example, the message might say, "Get a 20,000 yen discount when you purchase this refrigerator in conjunction with a contract for a specific service."

[1896] Step 13:

[1897] The server sends the generated discount offer message to the user's terminal. The input is the discount offer message, and the output is the message sent to the user's terminal.

[1898] Step 14:

[1899] The user terminal receives a discount offer message and displays it on the screen. The input is the discount offer message sent from the server, and the output is the displayed message. The user then reviews the discount offer and decides to make a purchase.

[1900] Step 15:

[1901] The emotion engine identifies the user's emotions and adjusts the content and tone of the messages it delivers. The input is the user's emotion data, and the output is the adjusted message. Specifically, it uses sensor data and machine learning models to determine the user's emotional state and adapts the message based on the results.

[1902] Specific example

[1903] Example prompt: "What are the features of the latest refrigerators?"

[1904] If the emotion engine identifies the user as excited, the output message will be "Wow! The latest refrigerators are Wi-Fi enabled and you can change the temperature settings from your smartphone."

[1905] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1906] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1907] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1908] [Fourth Embodiment]

[1909] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1910] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1911] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1912] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1913] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1914] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1915] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1916] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1917] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1918] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1919] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1920] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1921] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1922] This invention is a system that can acquire event information, generate and send invitation messages to users, suggest features of home appliances using generative AI, and acquire and display discount information. The specific server, terminal, and user operations for implementing this invention are described below.

[1923] Event information acquisition and invitations

[1924] 1. Server: First, the server retrieves detailed event information (e.g., event name, date and time, location, content) from the database or other sources. This retrieved information pertains to a specific event, such as a "character event."

[1925] 2. Server: Based on the acquired event information, the server generates an invitation message to send to each user. This invitation message includes detailed information about the event.

[1926] 3. Server: The generated invitation message is sent to each user's device using the user's identification information (e.g., user ID, email address).

[1927] 4. Device: The user's device receives the invitation message sent from the server and displays it to the user in the form of a push notification or similar.

[1928] 5. User: The user checks the event invitation message displayed on their device and selects whether or not to participate.

[1929] Information suggestions for home appliances using generative AI

[1930] 1. User: The user enters questions about the home appliance they are considering purchasing through the terminal. For example, they might enter a question such as, "What are the features of the latest refrigerators?"

[1931] 2. Terminal: The user's terminal sends the entered question to the server.

[1932] 3. Server: The server receives the user's question and sends its content as a query to the generative AI.

[1933] 4. Generative AI: Generative AI analyzes submitted queries and generates information about the features of home appliances. For example, it can create specific answers such as, "The latest refrigerators can connect to Wi-Fi and the temperature settings can be changed from a smartphone."

[1934] 5. Server: The server receives information obtained from the generative AI and formats it as suggested information for the user.

[1935] 6. Server: The formatted suggestion information is sent to the user's terminal.

[1936] 7. Terminal: The user's terminal displays the suggestion information sent from the server, and the user confirms it.

[1937] Discount information for simultaneous contract with SB Services

[1938] 1. User: The user selects the product they intend to purchase through their device. For example, they might select a refrigerator.

[1939] 2. Terminal: The selected product information is sent from the terminal to the server.

[1940] 3. Server: The server receives product information and retrieves relevant discount information from the database.

[1941] 4. Server: Based on the acquired discount information, the server generates a discount notification message to present to the user. For example, it may include content such as, "Get a 20,000 yen discount when you purchase this refrigerator at the same time as signing up for SB service."

[1942] 5. Server: The generated discount offer message is sent to the user's terminal.

[1943] 6. Terminal: The user's terminal displays the discount notification message sent from the server, and the user confirms it.

[1944] 7. User: The user confirms the discount offer message and decides to purchase.

[1945] As described above, the system of the present invention operates in cooperation with a server, terminal, and user, effectively performing event triggering, suggesting information on home appliances using a generative AI, and providing discount information.

[1946] The following describes the processing flow.

[1947] Event information acquisition and invitations

[1948] Step 1:

[1949] Server: Retrieves detailed event information from databases and other sources. This includes event name, date and time, location, and content.

[1950] Step 2:

[1951] Server: Generates an invitation message to send to the user based on the acquired event information. The invitation message includes details of the event.

[1952] Step 3:

[1953] Server: Sends the generated invitation message to each user's terminal using their identification information (e.g., user ID, email address).

[1954] Step 4:

[1955] Device: The user's device receives the invitation message sent from the server and displays it to the user as a push notification.

[1956] Step 5:

[1957] User: The user checks the event invitation message displayed on their device and selects whether or not to participate in the event.

[1958] Information suggestions for home appliances using generative AI

[1959] Step 1:

[1960] User: The user enters questions about the home appliance they are considering purchasing into the terminal. Example: "What are the features of the latest refrigerators?"

[1961] Step 2:

[1962] Terminal: The user's terminal sends the question to the server.

[1963] Step 3:

[1964] Server: The server receives user questions, formats them appropriately, and sends them as queries to the generative AI.

[1965] Step 4:

[1966] Generative AI: Generative AI analyzes received queries and generates answers to user questions. Example: "The latest refrigerators can connect via Wi-Fi, and the temperature settings can be changed from a smartphone."

[1967] Step 5:

[1968] Server: Receives responses from the generative AI and formats them into suggestion messages for the user.

[1969] Step 6:

[1970] Server: Sends the formatted suggestion message to the user's terminal.

[1971] Step 7:

[1972] Terminal: The user's terminal receives the suggestion message and displays it on the screen.

[1973] Step 8:

[1974] User: The user checks the suggestion message displayed on the device.

[1975] Discount information for simultaneous contract with SB Services

[1976] Step 1:

[1977] User: The user selects the product they intend to purchase on their device. Example: A new refrigerator.

[1978] Step 2:

[1979] Terminal: Sends the selected product information to the server.

[1980] Step 3:

[1981] Server: Receives product information and retrieves relevant discount information from the database.

[1982] Step 4:

[1983] Server: Based on the acquired discount information, it generates a discount notification message for the user. Example: "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[1984] Step 5:

[1985] Server: Sends a discount notification message to the user's device.

[1986] Step 6:

[1987] Terminal: The user's terminal receives the discount notification message and displays it on the screen.

[1988] Step 7:

[1989] User: The user checks the discount offer message displayed on the device and decides to make a purchase.

[1990] The above is a detailed explanation of each processing step for carrying out the present invention.

[1991] (Example 1)

[1992] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1993] Modern consumers expect to quickly and efficiently obtain information on various events, product features, and even discounts when making purchases. However, many systems on the market only provide this information individually, and there is a lack of systems that offer integrated suggestions. As a result, users have to refer to multiple sources to obtain information, wasting time and effort. This invention aims to solve this problem by providing a system that provides event information acquisition, product suggestions generated by AI, and discount information in an integrated manner.

[1994] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1995] In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for sending event invitation messages, means for processing information to suggest the features of home appliances using a generative AI, means for receiving and analyzing user questions, means for sending questions to a generative AI and generating answers, means for formatting the generated answers, means for generating and displaying suggestion information, and means for acquiring and displaying discount information. This makes it possible for users to efficiently acquire event information, information on the features of home appliances, and discount information through a single system.

[1996] "Event information" refers to detailed information about the event, such as its name, date and time, location, and content.

[1997] "Means of acquisition" refers to the means of obtaining necessary information from databases or external APIs.

[1998] An "event invitation message" refers to a message that contains detailed information about an event and is sent to a user.

[1999] "Generation means" refers to the means of generating messages or information in a specific format based on data.

[2000] "Transmission means" refers to the means used to send generated messages and information to users or devices.

[2001] "Generative AI" refers to artificial intelligence systems that use natural language processing to generate appropriate outputs for specific inputs.

[2002] "Information for suggesting features" refers to information about the features and functions of home appliances that are suggested to users.

[2003] "Processing means" refers to the means used for analyzing data and generating information.

[2004] "User questions" refer to questions or requests that users ask the system regarding home appliances.

[2005] "Receiving means" refers to the means of receiving input or data from an external source.

[2006] "Means of analysis" refers to the means of understanding received data or questions and processing them appropriately.

[2007] "Means of generating answers" refers to methods for creating answers to user questions using generative AI.

[2008] "Formatting methods" refer to means of displaying generated information in an appropriate format for the user.

[2009] "Proposed information" refers to specific information about the products and services offered to users.

[2010] "Display means" refers to the means of providing generated information or messages to the user visually.

[2011] "Discount information" refers to information about discounts and benefits that apply when purchasing goods or services.

[2012] This invention is a system that integrates the acquisition of event information, the generation and sending of invitation messages to users, the suggestion of features for home appliances using generative AI, and the provision of discount information. The operation of each component is described below.

[2013] Event information acquisition and invitations

[2014] Get event information

[2015] Server: Event information is retrieved from a database or Web API. SQL queries are used to extract detailed information from the database, such as event name, date and time, location, and content. A concrete example is retrieving information about a new movie premiere from the database.

[2016] Generating an invitation message

[2017] Server: Based on the acquired event information, it generates an invitation message using a template engine (e.g., Mustache or Jinja). For example, a message like "You're invited to the XX event! Date: Month XX, Day XX, Location: XX" is generated.

[2018] Sending an invitation message

[2019] Server: The generated invitation message is sent to each user's device using the user's identification information (e.g., email address, user ID). The email is sent using the SMTP protocol.

[2020] Displaying the invitation message

[2021] Device: The user's device receives the sent invitation message and displays it via push notification or email app. For mobile devices, Firebase Cloud Messaging (FCM) can be used.

[2022] User actions

[2023] User: Review the invitation message and choose whether or not to participate. For example, they can indicate their participation using a button within the app or a reply email.

[2024] Information suggestions for home appliances using generative AI

[2025] User question input

[2026] User: Enter a question (prompt) about the home appliance you are considering purchasing from your device. For example, enter "What are the features of the latest refrigerators?"

[2027] Submit a question

[2028] Terminal: User questions are sent to the server. They are sent as POST requests using the REST API.

[2029] Sending queries to generative AI

[2030] Server: Sends received questions as queries to the generative AI. For example, the OpenAI API may be used.

[2031] Answer generation by generative AI

[2032] Generative AI: Analyzes submitted queries and generates information about the features of home appliances. For example, it might generate answers such as, "The latest refrigerators can connect via Wi-Fi, and the temperature settings can be changed from a smartphone."

[2033] Formatting user-facing proposals

[2034] Server: Based on the generated responses, it formats them as user-facing suggestion information. It can be converted to Markdown or HTML format.

[2035] Submitting proposal information

[2036] Server: The formatted suggestion information is sent to the user's terminal.

[2037] Display of proposed information

[2038] Device: The user's device receives the suggested information and displays it in the app's interface. For example, information might be displayed as "Features of the latest refrigerators."

[2039] Discount information for simultaneous contract with SB Services

[2040] Product Selection

[2041] User: Select the item you intend to purchase on your device. For example, select "refrigerator".

[2042] Sending Selection Information

[2043] Terminal: Selected product information is sent to the server. Communication is performed using a REST API.

[2044] Obtaining discount information

[2045] Server: Based on product information, retrieve relevant discount information from the database. Execute SQL queries.

[2046] Generating discount information

[2047] Server: Based on discount information, it generates discount offer messages. For example, a message such as "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service" is generated.

[2048] Sending discount information

[2049] Server: Sends the generated discount offer message to the user's terminal.

[2050] Display of discount information

[2051] Device: Displays the discount offer message that was sent. It appears as a pop-up or notification within the app.

[2052] User's purchase decision

[2053] User: Check the discount offer and decide to purchase. Clicking the purchase button within the app completes the purchase process.

[2054] This enables the construction of a detailed system that can centrally provide event information, information suggestions for home appliances generated by a generative AI, and discount information.

[2055] Example of a prompt

[2056] "Could you tell me about the features of the latest refrigerators?"

[2057] "Please tell me more about the event 'XX'."

[2058] "Please tell me about any discounts I could get if I purchase this refrigerator."

[2059] The flow of the specific processing in Example 1 will be explained using Figure 11.

[2060] Event information acquisition and invitations

[2061] Step 1:

[2062] The server accesses a database or external API to retrieve detailed event information. It executes SQL queries or API requests to extract information such as the event name, date and time, location, and content.

[2063] (Input) Database query or API request

[2064] (Data processing) Analyze the query results and extract the necessary information.

[2065] (Output) Event details

[2066] As a concrete example, execute the query "SELECT FROM events WHERE type='Character Events'" and retrieve the results.

[2067] Step 2:

[2068] Based on the acquired event information, the server generates an invitation message for the user using a template engine (such as Mustache or Jinja).

[2069] (Input) Event details

[2070] (Data processing) Embed information into a template to generate a message.

[2071] (Output) Generated invitation message

[2072] As a concrete example, we will generate a message that says, "You are invited to the XX event! Date: Month XX, Day XX, Location: XX".

[2073] Step 3:

[2074] The server sends the generated invitation message based on the user's identification information (e.g., user ID, email address). The email is sent using the SMTP protocol.

[2075] (Input) Invitation message, user identification information

[2076] (Data processing) Create email structure using SMTP client and send.

[2077] (Output) Confirmation of sent messages

[2078] As a concrete example, an invitation email is sent to each user's email address.

[2079] Step 4:

[2080] The device receives the invitation message sent from the server and displays it to the user via push notification or email app. Firebase Cloud Messaging (FCM) or an email app is used.

[2081] (Input) Received invitation message

[2082] (Data processing) Display as notification or email.

[2083] (Output) Invitation message displayed on the terminal

[2084] As a concrete example, FCM is used to display a push notification on the device saying, "You're invited to the XX event!"

[2085] Step 5:

[2086] Users review the invitation message displayed on their device and choose whether or not to participate. They can do so using the "Join" button or a reply email.

[2087] (Enter) Invitation message

[2088] (Data processing) Recording user actions

[2089] (Output) Participation intention information

[2090] As a concrete example, you can confirm your participation by clicking the "Join" button in the invitation email.

[2091] Information suggestions for home appliances using generative AI

[2092] Step 1:

[2093] The user enters questions about the home appliance they are considering purchasing via their device, using the app's text input field.

[2094] (Input) User's question

[2095] (Data processing) Text analysis

[2096] (Output) Structured query

[2097] As a concrete example, enter "What are the features of the latest refrigerators?"

[2098] Step 2:

[2099] The terminal sends the entered question to the server. It sends a POST request using the REST API.

[2100] (Input) User's question

[2101] (Data processing) Send to the server via REST API

[2102] (Output) Request to the server

[2103] As a concrete example, the "question content" is included as the payload of the POST request and sent to the server.

[2104] Step 3:

[2105] The server receives the user's question and sends its content as a query to the generative AI. For example, it might call the OpenAI API.

[2106] (Input) User's question

[2107] (Data processing) Send the question to the generative AI.

[2108] (Output) Query to a generative AI

[2109] As a concrete example, we send a question to the OpenAI GPT-3 endpoint and obtain a response.

[2110] Step 4:

[2111] The generative AI analyzes the submitted query and generates information about the features of home appliances. It uses natural language processing to generate appropriate answers.

[2112] (Input) User's question

[2113] (Data processing) Answer generation based on natural language processing

[2114] (Output) Generated answer

[2115] As a concrete example, it generates specific answers such as, "The latest refrigerators can connect via Wi-Fi, allowing you to change the temperature settings from your smartphone."

[2116] Step 5:

[2117] The server receives the responses from the generative AI and formats them as user-friendly suggestions. It can also convert them to Markdown or HTML format.

[2118] (Input) Generated response

[2119] (Data processing) Formatting of answers (e.g., Markdown or HTML format)

[2120] (Output) Response as proposed information

[2121] As a concrete example, information can be formatted in the following way: "The features of the latest refrigerator are as follows: - WiFi connectivity - Temperature can be set from your smartphone."

[2122] Step 6:

[2123] The server sends the formatted suggestion information to the user's terminal. Communication then occurs again using the REST API.

[2124] (Input) Formatted proposal information

[2125] (Data processing) Sent via REST API

[2126] (Output) Response to terminal

[2127] As a concrete example, a response containing the proposed information is sent to the terminal.

[2128] Step 7:

[2129] The user's device displays the received suggestion information through the app's interface.

[2130] (Input) Proposal Information

[2131] (Data processing) Conversion to display format

[2132] (Output) Displayed within the app

[2133] As a concrete example, information such as "Features of the latest refrigerator" is displayed in a text view within the app.

[2134] Discount information for simultaneous contract with SB Services

[2135] Step 1:

[2136] Users select the items they intend to purchase through their device. They can choose from a product list within the app.

[2137] (Input) Selected product

[2138] (Data processing) Retrieval of product ID

[2139] (Output) Product ID

[2140] As a concrete example, select "refrigerator" from the product list.

[2141] Step 2:

[2142] The terminal sends the selected product information to the server. Communication is performed using a REST API.

[2143] (Input) Selected product information

[2144] (Data processing) Send to the server via REST API

[2145] (Output) Request to the server

[2146] As a concrete example, data containing the product ID of "refrigerator" is sent to the server.

[2147] Step 3:

[2148] The server receives product information and retrieves relevant discount information from the database. It then executes an SQL query.

[2149] (Input) Selected product information

[2150] (Data processing) Execution of database queries

[2151] (Output) Discount Information

[2152] As a concrete example, execute the query "SELECT FROM discounts WHERE product_id='refrigerator'" to retrieve discount information.

[2153] Step 4:

[2154] The server generates a discount notification message to present to the user based on the acquired discount information. A template engine is used.

[2155] (Input) Discount information

[2156] (Data processing) Message generation using a template engine

[2157] (Output) Discount notification message

[2158] As a concrete example, it generates messages such as, "If you purchase this refrigerator at the same time as signing up for SB Service, you will receive a 20,000 yen discount."

[2159] Step 5:

[2160] The server sends the generated discount offer message to the user's device. Communication is performed using a REST API.

[2161] (Input) Discount offer message

[2162] (Data processing) Sent via REST API

[2163] (Output) Response to terminal

[2164] As a concrete example, a discount offer message is sent as a response.

[2165] Step 6:

[2166] The device will display the discount offer message that was sent. It will appear as a pop-up or notification within the app.

[2167] (Input) Discount offer message

[2168] (Data processing) Conversion to display format

[2169] (Output) Display on user terminal

[2170] For example, data such as "Get a 20,000 yen discount when you buy this refrigerator" will pop up.

[2171] Step 7:

[2172] The user reviews the discount offer message and decides to purchase. The purchase is confirmed by clicking the purchase button in the app.

[2173] (Input) Discount offer message

[2174] (Data processing) Recording user actions

[2175] (Output) Purchase decision information

[2176] As a concrete example, tap the "Purchase" button to complete the purchase process.

[2177] As a result, through these detailed processing steps, the system of the present invention can provide event invitations, information suggestions for home appliances, and discount information in an integrated and efficient manner.

[2178] (Application Example 1)

[2179] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2180] While modern consumers have access to a wide variety of products and event information, the sheer volume of information makes it difficult for them to make informed decisions. Furthermore, the ability to quickly access detailed product information and discount offers can significantly boost purchasing behavior. In particular, there is a growing need to utilize generative AI to provide users with the information they seek in a timely manner. Current systems only provide event and discount information individually, lacking a unified and efficient means of delivery. This makes it difficult for consumers to make optimal choices, leading to decreased satisfaction.

[2181] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[2182] In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for sending event invitation messages, means for processing information for suggesting product features using a generative AI, means for generating and displaying suggestion information, means for acquiring and displaying discount information, means for calling a generative AI that receives user questions and generates answer information, and means for sending push notifications to the user terminal. This makes it possible to centrally and timely provide event invitations, product information suggestions, and discount information notifications.

[2183] "Event information" refers to detailed information about an event that will be held at a specific date, time, and location.

[2184] "Generative AI" refers to a system that uses artificial intelligence technology to generate new information or answers from input data.

[2185] "Suggested information" refers to information about a product, such as its features and usage, that a generative AI provides based on the user's questions and purchase intentions.

[2186] "Discount information" refers to information about discounts and promotions offered for specific products or services.

[2187] A "user terminal" refers to a device that the user directly operates, and includes smartphones, tablets, and personal computers.

[2188] A "push notification" is a notification message sent in real time from a server to a user's device.

[2189] An "event invitation message" is a message containing detailed information to invite a user to a specific event.

[2190] "Processing means" refers to a combination of hardware and software for receiving and processing data.

[2191] A "generation method" is a combination of hardware and software used to generate new information or messages based on specific data.

[2192] "Transmission means" refers to the means of communication used to send information from a server to a user terminal.

[2193] A "means of invocation" refers to a means of issuing a trigger or instruction to execute a specific function or service when needed.

[2194] "Acquisition method" refers to a combination of hardware and software used to retrieve specific information from databases, external APIs, etc.

[2195] "Display means" refers to a function for visually displaying information on the screen of a user's terminal or similar device.

[2196] This invention is a system that acquires event information, generates and sends invitation messages to users, suggests product features using a generative AI, and acquires and displays discount information. The operations of the server, terminal, and user necessary to implement this invention are as follows.

[2197] Event information acquisition and invitations

[2198] The server first retrieves event information from a database or other sources. This event information includes the event name, date and time, location, and content. Next, the server generates an event invitation message to send to each user based on this retrieved information. The generated invitation message is sent to each user's device using the user's identification information (e.g., user ID or email address). The user's device displays the received invitation message as a push notification, allowing the user to confirm the invitation message.

[2199] Product information suggestions using generative AI

[2200] The user enters a question about a product they are considering purchasing through their device. For example, "What are the features of the latest refrigerator?" The user's device sends this question to the server. The server passes the received question to a generative AI, which analyzes the question and generates information about the product's features. The generated information is sent to the user's device via the server and displayed on the device.

[2201] Discount information

[2202] The user selects the items they intend to purchase through their device. The selected item information is sent from the device to the server, which retrieves relevant discount information from its database. Based on this discount information, the server generates a discount notification message to present to the user. The generated discount notification message is sent to the user's device, where the user can review it.

[2203] Hardware and software to be used

[2204] Server: The server-side uses a web framework such as Flask to perform data processing and message generation.

[2205] Generative AI models: We use generative AI models such as OpenAI's GPT-3.

[2206] User terminal: A device operated by the user, such as a smartphone, tablet, or personal computer.

[2207] Push notification service: Real-time notifications are provided using services such as Firebase and OneSignal.

[2208] Example of program processing

[2209] For example, if a user asks, "What features do the latest refrigerators have?", the generative AI will generate information such as, "The latest refrigerators can connect to Wi-Fi and allow you to change the temperature settings from your smartphone."

[2210] Examples of generated AI prompts:

[2211] User question: What features do the latest refrigerators have?

[2212] What are the features of the latest home appliances (such as refrigerators)?

[2213] Thus, the system of the present invention can efficiently and effectively notify users of event invitations, product information suggestions, and discount information through cooperation between a server, a terminal, and a generative AI model.

[2214] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[2215] Step 1:

[2216] The server retrieves event information from a database or external API. The retrieved event information includes the event name, date and time, location, and content. Based on this data, the server performs the following processing.

[2217] Input: Event information obtained from a database or external API (event name, date and time, location, details)

[2218] Output: List of retrieved event information

[2219] Step 2:

[2220] Based on the event information acquired by the server, an event invitation message is generated to be sent to each user. The generated message includes detailed information about the event.

[2221] Input: Retrieved event information

[2222] Output: Event invitation message to send to each user

[2223] Step 3:

[2224] The server generates an event invitation message and sends it to each user's device using the user's identification information (e.g., user ID or email address).

[2225] Input: Event invitation message, user identification information

[2226] Output: Event invitation message sent to the user's terminal

[2227] Step 4:

[2228] The event invitation message received by the user's device from the server is displayed to the user as a push notification.

[2229] Input: Event invitation message received from the server

[2230] Output: Event invitation message displayed on the user's device's push notification screen.

[2231] Step 5:

[2232] The user enters questions about the product they are considering purchasing through a terminal. For example, a question like, "What are the features of the latest refrigerator?" The terminal then sends the entered questions to the server.

[2233] Input: A product-related question entered by the user.

[2234] Output: Question data sent to the server

[2235] Step 6:

[2236] The server passes the question received from the user to a generative AI. The generative AI analyzes the question and generates information about the product's features.

[2237] Input: User's question data

[2238] Output: Response data generated by the AI.

[2239] Step 7:

[2240] The server receives the response data obtained from the generative AI, formats it, and sends it to the user's terminal as suggested information for the user.

[2241] Input: Response data received from a generative AI.

[2242] Output: Formatted proposal information

[2243] Step 8:

[2244] The user's device displays the suggestion information sent from the server.

[2245] Input: Suggestion information received from the server

[2246] Output: Suggestion information displayed on the user's terminal screen

[2247] Step 9:

[2248] The user selects the items they intend to purchase through their device. The device then sends the selected item information to the server.

[2249] Input: Product information selected by the user

[2250] Output: Product information sent to the server

[2251] Step 10:

[2252] The server receives product information and retrieves relevant discount information from the database.

[2253] Input: Product information sent to the server

[2254] Output: Discount information retrieved from the database

[2255] Step 11:

[2256] Based on the discount information acquired by the server, a discount notification message is generated to be presented to the user.

[2257] Input: Retrieved discount information

[2258] Output: Generated discount offer message

[2259] Step 12:

[2260] The server generates a discount offer message and sends it to the user's device.

[2261] Input: Discount offer message

[2262] Output: Discount notification message sent to the user's terminal

[2263] Step 13:

[2264] The user's device displays the discount notification message received from the server.

[2265] Input: Discount notification message received from the server

[2266] Output: Discount notification message displayed on the user's terminal screen

[2267] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[2268] This invention is a system that combines the acquisition of event information, generation and transmission of invitation messages, suggestion of home appliance features using generative AI, acquisition and display of discount information, and an emotion engine that recognizes user emotions and adjusts the presented content. The operation of the server, terminal, user, and emotion engine in an embodiment of this invention is described below.

[2269] Event information acquisition and invitations

[2270] 1. Server: Retrieves detailed event information (event name, date and time, location, content, etc.) from databases and other sources.

[2271] 2. Server: Based on the acquired event information, it generates an invitation message to send to the user. The generated invitation message includes detailed information about the event.

[2272] 3. Server: Uses user identification information (e.g., user ID, email address) to send the generated invitation message to each user's device.

[2273] 4. Device: The user's device receives the invitation message sent from the server and displays it to the user as a push notification.

[2274] 5. User: The user checks the event invitation message displayed on their device and selects whether or not to participate in the event.

[2275] Information suggestions for home appliances using generative AI

[2276] 1. User: The user enters questions about the home appliance they are considering purchasing into the terminal. For example, "What are the features of the latest refrigerators?"

[2277] 2. Terminal: The user's terminal sends the entered question to the server.

[2278] 3. Server: The server receives the user's question and sends it as a query to the generative AI.

[2279] 4. Generative AI: Generative AI analyzes queries and generates answers to user questions. For example, information such as, "The latest refrigerators can connect to Wi-Fi and the temperature settings can be changed from a smartphone."

[2280] 5. Server: Receives responses from the generative AI and formats them into suggestion messages for the user.

[2281] 6. Server: Sends the formatted suggestion message to the user's terminal.

[2282] 7. Terminal: The user's terminal receives the suggestion message and displays it on the screen.

[2283] 8. User: The user checks the suggestion message displayed on the device.

[2284] Discount information for simultaneous contract with SB Services

[2285] 1. User: The user selects the product they intend to purchase on the device. For example, they might select the latest refrigerator.

[2286] 2. Terminal: Sends the selected product information to the server.

[2287] 3. Server: Receives product information and retrieves relevant discount information from the database.

[2288] 4. Server: Based on the acquired discount information, it generates discount notification messages for users. For example, it may include content such as, "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[2289] 5. Server: Sends the generated discount offer message to the user's terminal.

[2290] 6. Terminal: The user's terminal receives the discount notification message and displays it on the screen.

[2291] 7. User: The user checks the discount offer message displayed on the device and decides to make a purchase.

[2292] Adjustment by the emotion engine

[2293] 1. Emotion Engine: Analyzes the user's current emotions using sensor data and machine learning models to recognize the user's emotions.

[2294] 2. Emotion Engine: In the case of event invitation messages, the message content is adjusted based on the user's emotions. For example, when the user is excited, more passionate language is used.

[2295] 3. Emotional Engine: In the case of suggestion information for home appliances, the tone and level of detail of the suggestions are adjusted based on the user's emotions. For example, if the user is calm, more technical details are provided.

[2296] 4. Emotion Engine: In the case of discount announcement messages, the way the message is presented is adjusted based on the user's emotions. For example, if the user is confused, a more concise and intuitive message is provided.

[2297] As described above, the system of the present invention works in cooperation with a server, terminal, user, generative AI, and emotion engine to effectively provide event triggers, home appliance information suggestions, and discount announcements. The addition of the emotion engine further personalizes the user experience and enables more efficient information delivery.

[2298] The following describes the processing flow.

[2299] Event information acquisition and invitations

[2300] Step 1:

[2301] Server: Retrieves detailed event information (event name, date and time, location, content, etc.) from databases and other sources.

[2302] Step 2:

[2303] Server: Generates an invitation message based on the acquired event information.

[2304] Step 3:

[2305] Server: Uses user identification information (such as user ID) to send an invitation message to the user's device.

[2306] Step 4:

[2307] Terminal: Receives invitation messages sent from the server and displays them to the user as push notifications.

[2308] Step 5:

[2309] User: Check the invitation message displayed on the device and choose whether or not to participate in the event.

[2310] Information suggestions for home appliances using generative AI

[2311] Step 1:

[2312] User: Enters questions about the home appliance they are considering purchasing into the terminal. Example: "What are the features of the latest refrigerators?"

[2313] Step 2:

[2314] Terminal: The user's terminal sends the entered question to the server.

[2315] Step 3:

[2316] Server: Receives user questions and sends them as queries to the generative AI.

[2317] Step 4:

[2318] Generative AI: Analyzes submitted queries and generates answers to user questions. For example, it might respond with information such as, "The latest refrigerators can connect via Wi-Fi, and the temperature settings can be changed from a smartphone."

[2319] Step 5:

[2320] Server: Formats the responses received from the generative AI into user-facing suggestion messages.

[2321] Step 6:

[2322] Server: Sends the formatted suggestion message to the user's terminal.

[2323] Step 7:

[2324] Terminal: Receives suggestion messages and displays them on the screen.

[2325] Step 8:

[2326] User: Check the displayed suggestion message.

[2327] Discount information for simultaneous contract with SB Services

[2328] Step 1:

[2329] User: Select the product you intend to purchase on your device. Example: A new refrigerator.

[2330] Step 2:

[2331] Terminal: Sends the selected product information to the server.

[2332] Step 3:

[2333] Server: Receives product information and retrieves relevant discount information from the database.

[2334] Step 4:

[2335] Server: Based on the acquired discount information, it generates a discount notification message for the user. Example: "Get a 20,000 yen discount when you purchase this refrigerator with a simultaneous contract for SB service."

[2336] Step 5:

[2337] Server: Sends the generated discount offer message to the user's terminal.

[2338] Step 6:

[2339] Terminal: Receives discount notification messages and displays them on the screen.

[2340] Step 7:

[2341] User: Checks the displayed discount message and decides to purchase.

[2342] Adjustment by the emotion engine

[2343] Step 1:

[2344] Emotion Engine: Analyzes the user's current emotions using sensor data and machine learning models to recognize the user's feelings.

[2345] Step 2:

[2346] Emotion Engine: Adjusts the content of event invitation messages based on recognized emotions. For example, if the user is excited, it will use more passionate language.

[2347] Step 3:

[2348] Emotion Engine: Adjusts suggested information for home appliances based on recognized emotions. For example, if the user is calm, it will provide more technical details.

[2349] Step 4:

[2350] Emotion Engine: Based on recognized emotions, it adjusts how discount offer messages are presented. For example, if a user is confused, it provides a concise and intuitive message.

[2351] The above is a detailed processing flow when combining the emotion engine. This system allows for a more personalized user experience and more efficient information delivery.

[2352] (Example 2)

[2353] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2354] While systems exist that provide event information, product information, and discount information individually, few systems integrate this information and provide personalized information tailored to the user's emotions. There is a need to improve the user experience by providing optimal information according to the user's needs and emotions, but conventional systems have not adequately achieved this. This invention aims to solve this problem and provide users with more effective and personalized information.

[2355] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for acquiring event information, means for generating event invitation messages, means for transmitting event invitation messages, means for receiving questions about home appliances and querying a generative AI, means for processing information to propose the features of home appliances using the generative AI, means for generating and displaying the proposed information, means for acquiring and displaying discount information, and an emotion engine that recognizes the user's emotions and adjusts the message content...

Claims

1. Means of obtaining event information, A means for generating event invitation messages, The means of sending event invitation messages, Using generative AI, information is processed to propose the characteristics of home appliances, Proposal information is generated and displayed, The discount information is obtained and displayed, A system that includes this.

2. The system according to claim 1, which displays an event invitation message as a push notification on the user's terminal.

3. The system according to claim 1, comprising means for receiving user questions regarding home appliances and querying a generative AI.

Images