System

Abstract

A system is provided.SOLUTION: A system comprising: means for a user to access a web platform and enter necessary information to create a user account; means for receiving authentication information for the user account and generating and transmitting an authentication token; means for receiving user input, analyzing using a natural language processing engine, and generating and transmitting an appropriate response; means for managing conversation time, providing extension options, calculating fees, and requesting processing from a payment processing system; and means for displaying a feedback input form after completion of a conversation and storing feedback information in a database.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Traditional methods of contacting celebrities, such as social media and online salons, impose a significant psychological and financial burden, making it difficult for many users to enjoy casual, intimate conversations. In addition, time constraints make it difficult for celebrities to respond to large numbers of fans. Furthermore, existing methods for bridging this gap often fail to provide a satisfactory experience for users. There is a need to solve this problem and provide a way for anyone to easily have intimate conversations with celebrity avatars. [Means for solving the problem]

[0005] To solve the above-mentioned problems, the present invention provides a means for users to access a web platform, easily create a user account, and log in. It also includes a means for receiving user account authentication information and generating and transmitting an authentication token. Users can search for and select celebrity avatar information and enjoy realistic conversations with the selected avatar. The server analyzes the user's input using a natural language processing engine, generates and transmits an appropriate response, manages conversation time, provides extension options, calculates fees, and requests payment processing. Furthermore, it includes a means for displaying a feedback input form after the conversation ends and storing the information in a database. In this way, it is possible to provide a system that reduces financial and psychological burdens and easily realizes intimate conversations between users and celebrity avatars.

[0006] A "user account" is data including personal authentication information for a user to use the web platform.

[0007] An "authentication token" is digital data that is generated by a server and sent to a user's terminal to verify the validity of a user account.

[0008] An "avatar" is a character that is a virtual representative of a user or a particular person in a digital environment.

[0009] A "natural language processing engine" is software that analyzes a user's text input and generates an appropriate response based on it.

[0010] The "extension option" is an option that allows the user to extend the conversation time by paying an additional fee.

[0011] "Charge calculation" is the process of calculating the fees to be collected from users for the services and extension options provided.

[0012] "Payment Processing System" means a system for processing a user's payment information and transferring the appropriate fee to the service provider.

[0013] A "feedback input form" is a web form that allows users to enter their ratings and comments about a service.

[0014] A "database" is a collection of information that is organized so that collected data can be efficiently stored and managed. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] The present invention relates to a web platform that allows users to casually enjoy conversations with celebrity avatars. The system of the present invention provides a process for users to access the web platform, create a user account, log in, select a celebrity avatar, start a conversation, manage time, and provide feedback.

[0037] When a user accesses the web platform, they are first shown a registration screen to create a user account. The user enters information such as their name, email address, and password, and clicks the submit button. The device sends this information to the server, which receives it, verifies its validity, and stores it in a database. Once registration is complete, the server sends a success message to the user, which is displayed on the device.

[0038] Next, the user enters their email address and password on the login screen and clicks the login button. The device sends this information to the server, which verifies the validity of the information, generates an authentication token, and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[0039] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, or search for an avatar by entering the name of a specific celebrity in the search bar. The device sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the retrieved avatar list and search results on the screen.

[0040] When a user selects a specific avatar and clicks the "Start Conversation" button, the terminal sends this selection information to the server, which then creates a conversation session and sends an initial response to the user's terminal, thereby starting the conversation.

[0041] Users can enter questions or messages into the chat box and send them to advance the conversation. The device sends the user's input to the server, which then analyzes the input using a natural language processing engine, generates an appropriate response, and sends it to the device. The device then displays the generated response to the user and waits for the next input.

[0042] As the conversation progresses and the end time approaches, an extension option is displayed. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends the extension request and payment information to the server, which calculates the fee and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal, and the conversation time is extended.

[0043] After the conversation ends, a feedback input form will appear, and the user can enter their rating and comments about the service and click the submit button. The device will then send the feedback information to the server, which will then store it in a database. This will allow data to be accumulated that will be useful for future service improvements.

[0044] As a concrete example, consider a case where a user wants to talk to an avatar of a famous actor. The user accesses a web platform, creates an account, and logs in. Next, the user enters the actor's name in the search bar and selects the corresponding avatar. After starting the conversation, the user types, "Tell me about new movies." The server parses this message and generates and sends a response, "Recently, new movies are..." An extension option is displayed just before the conversation ends, and if the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is stored on the server.

[0045] As described above, the system of the present invention provides a series of functions that allow users to easily enjoy conversations with celebrity avatars, realizing a fulfilling experience while reducing financial and psychological burdens.

[0046] The processing flow will be explained below.

[0047] Step 1:

[0048] A user accesses the web platform and clicks the "Sign Up" button.

[0049] Step 2:

[0050] The device will display a user registration screen and prompt you to enter your name, email address, password, etc.

[0051] Step 3:

[0052] The user enters the required information and clicks the "Submit" button.

[0053] Step 4:

[0054] The terminal transmits the input information to the server.

[0055] Step 5:

[0056] The server receives the input information, validates it, and if validation passes, stores the information in a database.

[0057] Step 6:

[0058] The server generates a registration success message and sends it to the user's terminal.

[0059] Step 7:

[0060] The device will display a registration complete message.

[0061] Step 8:

[0062] The user enters their email address and password on the login screen and clicks the "Login" button.

[0063] Step 9:

[0064] The terminal sends the entered login information to the server.

[0065] Step 10:

[0066] The server validates the login information and generates an authentication token.

[0067] Step 11:

[0068] The server sends the authentication token to the user's device.

[0069] Step 12:

[0070] The device receives the authentication token and displays the main dashboard screen.

[0071] Step 13:

[0072] The user clicks the "Avatar List" button to display a list of celebrity avatars.

[0073] Step 14:

[0074] The device sends an avatar list display request to the server.

[0075] Step 15:

[0076] The server retrieves all avatar information from the database and sends it to the user's device.

[0077] Step 16:

[0078] The device will display a list of avatars.

[0079] Step 17:

[0080] A user enters the name of a particular celebrity in the search bar and clicks the "Search" button.

[0081] Step 18:

[0082] The device sends a search query to the server.

[0083] Step 19:

[0084] The server searches the database based on the search query and retrieves the corresponding avatar information.

[0085] Step 20:

[0086] The server transmits the acquired avatar information to the user's terminal.

[0087] Step 21:

[0088] Your device will display the search results.

[0089] Step 22:

[0090] The user selects a specific avatar and clicks the "Start Talking" button.

[0091] Step 23:

[0092] The terminal sends a conversation start request to the server along with information about the selected avatar.

[0093] Step 24:

[0094] The server creates a conversation session and sends an initial response to the user's terminal.

[0095] Step 25:

[0096] The terminal displays an initial response and waits for user input.

[0097] Step 26:

[0098] The user enters a question or message in the chat box and sends it.

[0099] Step 27:

[0100] The terminal sends the user's message to the server.

[0101] Step 28:

[0102] The server uses a natural language processing engine to analyze the user's message and generate an appropriate response.

[0103] Step 29:

[0104] The server generates a response and sends it to the user's terminal.

[0105] Step 30:

[0106] The terminal displays the response message and waits for further user input.

[0107] Step 31:

[0108] When the conversation is about to end, the device will display extension options and prices.

[0109] Step 32:

[0110] The user selects the extension time and clicks the "Purchase Extension" button.

[0111] Step 33:

[0112] The terminal sends the extension request and payment information to the server.

[0113] Step 34:

[0114] The server calculates the fee and requests the payment processing system to process it.

[0115] Step 35:

[0116] The server sends a success message to the user's terminal.

[0117] Step 36:

[0118] The terminal displays a message indicating that the extension is complete, and the conversation time is extended.

[0119] Step 37:

[0120] After the conversation ends, the device displays a feedback input form.

[0121] Step 38:

[0122] The user enters a rating and comment for the service and clicks the "Submit" button.

[0123] Step 39:

[0124] The terminal sends feedback information to the server.

[0125] Step 40:

[0126] The server stores the feedback information in a database.

[0127] The above are the specific processing steps in the system of the present invention.

[0128] Example 1

[0129] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0130] Previous web platforms had the problem of making it difficult for users to enjoy real-time conversations with celebrities. The process from starting to ending a conversation was often cumbersome, which compromised the user experience. Furthermore, features like feedback collection and conversation extensions were lacking, making it impossible to fully meet user needs.

[0131] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0132] In this invention, the server includes means for receiving authentication information of a user account and generating and transmitting an authentication token, means for searching and selecting avatar information, means for analyzing a user's input using a natural language processing engine and generating and transmitting an appropriate response, means for generating a conversation session and transmitting an initial response to the user's terminal, means for managing conversation time, providing an extension option, calculating fees, and requesting processing from a payment processing system, and means for displaying a feedback input form after the conversation ends and storing the feedback information in a database. This allows users to easily enjoy conversations with celebrity avatars, improving the real-time conversation experience.

[0133] "User" means an individual or entity that uses the web platform, creates an account, logs in and interacts with an avatar.

[0134] The "web platform" refers to a software system accessible over the Internet that allows users to create interactive experiences.

[0135] A "User Account" is an individual identification on the Platform created based on information such as a User's unique name, email address, and password.

[0136] An "authentication token" is a security token that is generated by the server after the user enters correct authentication information and sent to the user's terminal.

[0137] An "avatar" is a simulated person or character with which a user interacts on a web platform.

[0138] A "natural language processing engine" is a software engine that analyzes natural language input from a user and generates an appropriate response.

[0139] A "conversation session" is a unit for managing a series of conversation processes generated by the server in order for a user to have a conversation with an avatar.

[0140] An "initial response" is the first message that the server sends to the user's terminal at the start of a conversation session.

[0141] The "extension option" is information about additional time and price that can be selected if the user wishes to extend the interaction time.

[0142] "Payment Processing System" means an external or internal payment platform for processing fees when a user selects the extension option.

[0143] The "feedback input form" is a form in which the user can input their evaluation or comments on the service after the conversation has ended.

[0144] A "database" is a structured data storage system for storing user information, avatar information, feedback, etc.

[0145] The present invention relates to a web platform that allows users to casually engage in conversations with celebrity avatars. The main elements of the platform are user account registration and authentication, avatar selection, conversation initiation and progression, conversation extension options, and feedback collection.

[0146] Registration Process

[0147] The user accesses the web platform and enters the required information, such as name, email address, and password. The device sends this information to the server as an HTTP POST request. The server verifies the validity of the entered information and stores it in a database (e.g., MySQL). Once registration is complete, the server sends a message to the device saying "Registration completed," which the device displays to the user.

[0148] Login Process

[0149] The user enters their email address and password on the login screen, and the device sends this to the server. The server retrieves user information from the database based on the received information, and if it matches, generates a JWT (JSON Web Token) and sends it to the device. The device uses this token to display the main dashboard screen.

[0150] Avatar Selection

[0151] Users can click the "Avatar List" button on the main dashboard or enter the name of a specific celebrity in the search bar. The device then sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device, which then displays it to the user.

[0152] Initiating and conducting a conversation

[0153] When a user selects a specific avatar and clicks the "Start Conversation" button, the device sends the selection information to the server. The server creates a new conversation session and generates an initial message based on a natural language processing engine (such as GPT-4). This initial message is sent to the device, which displays it to the user. When the user enters a question or message and the device sends it, the server passes it to the natural language processing engine for analysis and generates an appropriate response. The generated response is sent to the device and displayed to the user.

[0154] Extending the conversation

[0155] As the conversation approaches its end time, the server sends an extension option to the terminal. The terminal displays an extension suggestion and fee information to the user. If the user wishes to extend the conversation and enters payment information, the terminal sends this to the server. The server processes the payment using a payment system such as Stripe, and if successful, sends a message to the terminal indicating that the extension has been completed. The terminal notifies the user, and the conversation is extended.

[0156] Enter your feedback

[0157] After the conversation ends, the user enters their rating and comments in the feedback input form. The device sends this information to the server, which stores it in a database. This feedback information is used to improve the service.

[0158] Specific examples

[0159] For example, if a user wants to have a conversation with an avatar of a famous actor, the user accesses the web platform, creates an account, and logs in. Then, the user enters the actor's name in the search bar and selects the actor's avatar. After the conversation begins, the user types, "Tell me about new movies." The server analyzes this message and generates a response, "Recently, new movies...," and sends it to the device.

[0160] Prompt Sentence Examples

[0161] Generate a response when a user asks, "Hello, famous actor. What movies have you been in recently?"

[0162] This system aims to improve the user experience by providing a function that allows users to easily enjoy real-time conversations with celebrity avatars. By using this platform, users can achieve a fulfilling conversational experience with minimal out-of-pocket costs.

[0163] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0164] Step 1:

[0165] A user accesses the web platform and enters their name, email address, and password on the account creation page. The device collects this input information and sends it to the server as an HTTP POST request. The server validates the received information, ensuring that it is a correctly formatted email address and that the password meets the required security standards, for example by using a validation library (e.g., Joi). The server then stores the information in a database (e.g., MySQL), and generates a success message and sends it to the device. The device displays the success message to the user. The input data are the name, email address, and password, and the output is the success message.

[0166] Step 2:

[0167] The user enters their email address and password on the login screen and clicks the login button. The device sends the entered login information to the server. The server receives this information, searches for the corresponding user information in the database, and confirms that it matches. If authentication is successful, the server generates a JWT (JSON Web Token) and sends it to the device. The device receives this token and displays the main dashboard screen to the user. The input data is the email address and password, and the output is the authentication token and the main dashboard screen.

[0168] Step 3:

[0169] The user clicks the "Avatar List" button on the main dashboard or enters the name of a specific celebrity in the search bar. The device sends the user's request to the server as an HTTP GET request. The server retrieves the corresponding avatar information from the database and sends it in JSON format to the device. The device analyzes the retrieved avatar information and displays a list of images and names. The input data is an avatar selection request, and the output is a list of avatar information.

[0170] Step 4:

[0171] The user selects a specific avatar and clicks the "Start Conversation" button. The device sends the selection information to the server. The server creates a new conversation session and generates an initial message using a natural language processing engine (e.g., a generative AI model). The server sends this initial message to the device, which displays it to the user. The input data is the avatar selection information, and the output is the initial message.

[0172] Step 5:

[0173] The user enters a message in the chat box and clicks the send button. The terminal sends this input to the server. The server passes the received input to a natural language processing engine for analysis and generates an appropriate response. The generated response is sent by the server to the terminal. The terminal displays the response to the user. The input data is the user's message and the output is the generated response.

[0174] Step 6:

[0175] As the conversation approaches its end time, the server sends an extension option to the terminal. The terminal displays the extension option and fee information to the user. When the user selects the extension time and price and enters payment information, the terminal sends this information to the server. The server calculates the fee and processes the payment using a payment processing system (e.g., an external payment platform). If the payment is successful, the server generates an extension completion message and sends it to the terminal. The terminal notifies the user of this. The input data is the extension request and payment information, and the output is the extension completion message.

[0176] Step 7:

[0177] After the conversation ends, the user enters their rating and comments in the feedback input form. The device sends the feedback information to the server, which stores it in a database and uses it to improve the service. The input data is the feedback information, and the output is a feedback save confirmation message.

[0178] Through the above series of steps, users can enjoy real-time conversations with celebrity avatars, providing a highly satisfying interactive experience.

[0179] (Application example 1)

[0180] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0181] In interactive virtual stores, when users interact with celebrity avatars in real time to learn about products and make purchases, conventional systems lack the quality and realism of responses. This limits the user experience and reduces shopping satisfaction. It also makes it difficult to extend conversations, process payments, and efficiently collect feedback.

[0182] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0183] In this invention, the server includes: means for a user to access the web platform and create a user account by inputting necessary information; means for receiving authentication information for the user account and generating and transmitting an authentication token; means for searching and selecting celebrity avatar information; means for receiving the user's input, analyzing it using a natural language processing engine, and generating and transmitting an appropriate response; means for managing the conversation time, offering an extension option, calculating fees, and requesting processing from a payment processing system; means for displaying a feedback input form after the conversation ends and saving the feedback information in a database; and means for requesting product explanations and purchasing advice from the celebrity avatar in the virtual store and receiving a response. This allows the user to receive detailed product explanations and purchasing advice from the celebrity avatar in real time in the virtual store, thereby improving shopping satisfaction.

[0184] A "web platform" is an online system that users can access via the Internet and use various services and functions.

[0185] "User Account" means a collection of information that identifies an individual user on the Web Platform and grants access rights to use the Services.

[0186] An "authentication token" is a temporary identifier generated to verify a user's identity and authorize them to operate within a system.

[0187] A "celebrity avatar" is a digital representation of a real-life celebrity that can interact with users.

[0188] A "natural language processing engine" is a technology or software that enables a computer to understand, analyze, and generate responses to human language.

[0189] "Conversation time management" is a function for monitoring the duration of a conversation between a user and a celebrity avatar and extending it as necessary.

[0190] The "extension option" is a choice to extend the set time if the user wishes to continue the conversation.

[0191] "Charge calculation" is the process of calculating the charges incurred for the use of a service.

[0192] A "payment processing system" is a system for accepting and processing payments from users.

[0193] The "feedback input form" is a screen element that allows users to input ratings and comments on the service.

[0194] A "virtual store" is a virtual shopping environment where products can be displayed, explained, and purchased online.

[0195] "Product description" is information that explains the product's features, usage, price, etc. to the user.

[0196] "Purchase advice" refers to providing information and advice that is useful to users when purchasing products.

[0197] The present invention relates to a system that allows users to receive product explanations and purchasing advice from celebrity avatars in a virtual store. The system of the present invention provides a series of processes for users to access a web platform, create a user account, log in, select a celebrity avatar, start a conversation, select extension options and payment processing, and finally provide feedback.

[0198] First, when a user accesses the web platform, a registration screen for creating a user account is displayed. The user enters information such as name, email address, and password and clicks the submit button. The server receives this input information, verifies its validity, and saves it in a database.

[0199] Next, the user enters their email address and password on the login screen and clicks the login button. The server receives this information, generates an authentication token, and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[0200] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, and then search for avatars by entering the name of a specific celebrity in the search bar. The server retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the retrieved avatar list and search results on the screen.

[0201] When a user selects a specific avatar and clicks the "Start Conversation" button, the server creates a conversation session and starts the conversation by sending an initial response to the user's device, such as "Nice to meet you! Is there anything you'd like to ask me?"

[0202] Users can enter questions or messages into the chat box and send them to advance the conversation. The device sends the user's input to the server, which then analyzes the input using a natural language processing engine (e.g., GPT-3), generates an appropriate response, and sends it to the device. The device then displays the generated response to the user and waits for the next input.

[0203] As the conversation progresses and the end time approaches, an extension option will appear on the terminal. If the user wishes to extend the conversation, they will select the extension time and price and enter payment information. The server receives the extension request and payment information, calculates the fee, and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal, and the conversation time is extended.

[0204] After the conversation ends, a feedback input form will appear on the device, and the user can enter their rating and comments about the service and click the submit button. The server will receive the feedback information and store it in a database. This will allow the server to accumulate data that will be useful for future service improvements.

[0205] As a concrete example, consider a case where a user wants to talk to an avatar of a famous actor. The user accesses a web platform, creates an account, and logs in. Next, the user enters the actor's name in the search bar and selects the corresponding avatar. After starting the conversation, the user types, "Tell me about new movies." The server analyzes this message and generates and sends the response, "Actor Avatar: The latest new movies are...." Just before the conversation ends, an extension option is displayed, and if the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is saved on the server.

[0206] Example prompt sentence:

[0207] 1. Go to the web platform and click on the "Create an Account" button.

[0208] 2. Enter the required information (name, email address, password) and click the Send button.

[0209] 3. Once you have completed the registration, click the "Login" button and enter your email address and password to log in.

[0210] 4. From the main dashboard, click the "Avatar List" button to view the list of avatars.

[0211] 5. Select your actor's avatar and click the "Start Talking" button.

[0212] 6. Type "Tell me about new movies" in the message box and send.

[0213] 7. You will see a response such as "Actor Avatar: In the latest new movie..."

[0214] This system allows users to receive detailed product descriptions and purchasing advice in real time from celebrity avatars within a virtual store, improving their shopping satisfaction.

[0215] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0216] Step 1:

[0217] A user accesses the web platform, enters the required information on the account creation screen, and submits it. The user enters a username, email address, and password. The submitted data is sent to the server. The server verifies the validity of the received data, and if the verification is successful, stores it in a database. It then sends a message to the user's device indicating that account creation has been completed.

[0218] Input: Username, Email Address, Password

[0219] Output: Account creation complete message

[0220] Step 2:

[0221] The user enters their email address and password on the login screen and submits it. The user's authentication information is sent to the server. The server compares it with information in the database, and if authentication is successful, generates an authentication token and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[0222] Input: User's email address, password

[0223] Output: Auth token, main dashboard

[0224] Step 3:

[0225] The user clicks the "Avatar List" button on the main dashboard to display a list of avatars. The server retrieves avatar information from the database and sends it to the device. The user checks the displayed avatar information.

[0226] Input: User avatar list request

[0227] Output: List of displayed avatars

[0228] Step 4:

[0229] A user enters the avatar of a particular celebrity into the search bar and clicks the search execution button. The device sends the input information to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The corresponding avatar information is then displayed on the device.

[0230] Input: User search input (famous person's name)

[0231] Output: Avatar information for the displayed search results

[0232] Step 5:

[0233] The user selects a specific avatar and clicks the "Start Conversation" button. The device sends a session initiation request to the server, which creates a conversation session. An initial response is generated and sent to the user's device. The device displays "Nice to meet you! Is there anything you'd like to ask me?"

[0234] Input: User's avatar selection information

[0235] Output: Initial response message

[0236] Step 6:

[0237] The user enters a question or message into the chat box and sends it. The device sends the user's input to the server, which then analyzes the message using a natural language processing engine (e.g., GPT-3). An appropriate response is generated and sent to the device. The generated response message is displayed on the device. Responses such as "Actor Avatar: In recent new movies..." are provided.

[0238] Input: User's message

[0239] Output: The generated response message

[0240] Step 7:

[0241] As the conversation nears the end, an extension option appears on the terminal. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends this information to the server, which calculates the fee and requests processing from the payment processing system. If successful, an extension completion message is sent to the terminal and the conversation time is extended.

[0242] Input: Extended time, payment information

[0243] Output: Extension complete message

[0244] Step 8:

[0245] After the conversation ends, a feedback input form is displayed on the device. The user enters their rating and comments and submits them. The device then sends the feedback information to the server, which stores it in a database. User feedback is accumulated as data that will help improve the service.

[0246] Input: User feedback

[0247] Output: Feedback save completion notification

[0248] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0249] The present invention relates to a web platform that allows users to casually enjoy conversations with celebrity avatars, and in particular incorporates an emotion engine that recognizes the user's emotions and generates responses accordingly. The system of the present invention provides a process for users to access the web platform, create a user account, log in, select a celebrity avatar, start a conversation, manage time, and provide feedback.

[0250] When a user accesses the web platform, they are first shown a registration screen to create a user account. The user enters information such as their name, email address, and password, and clicks the submit button. The device sends this information to the server, which receives it, verifies its validity, and stores it in a database. Once registration is complete, the server sends a success message to the user, which is displayed on the device.

[0251] Next, the user enters their email address and password on the login screen and clicks the login button. The device sends this information to the server, which verifies the validity of the information, generates an authentication token, and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[0252] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, or search for an avatar by entering the name of a specific celebrity in the search bar. The device sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the retrieved avatar list and search results on the screen.

[0253] When a user selects a specific avatar and clicks the "Start Conversation" button, the terminal sends this selection information to the server, which then creates a conversation session and sends an initial response to the user's terminal, thereby starting the conversation.

[0254] Users advance the conversation by entering questions or messages into the chat box and sending them. The device sends the user's input to the server, which analyzes the input using a natural language processing engine and an emotion engine. The natural language processing engine analyzes the content of the entered text and generates an appropriate response. The emotion engine analyzes the emotion contained in the user's message and adjusts the response generated by the natural language processing engine based on the results. For example, if the user is expressing negative emotion, the server will recognize this and generate a more comforting or encouraging response. The generated response is sent from the server to the user's device and displayed.

[0255] As the conversation progresses and the end time approaches, an extension option is displayed. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends the extension request and payment information to the server, which calculates the fee and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal, and the conversation time is extended.

[0256] After the conversation ends, a feedback input form is displayed, and the user enters their rating and comments about the service and clicks the send button. The device then sends the feedback information to the server, which stores it in a database. This feedback information also includes the user's emotional data analyzed by the emotion engine and is used to improve the service.

[0257] As a concrete example, consider a case where a user wants to talk to an avatar of a famous actor. The user accesses a web platform, creates an account, and logs in. Next, they enter the actor's name in the search bar and select the corresponding avatar. After starting a conversation, the user types, "I'm feeling stressed at work these days." The server analyzes this message, and the emotion engine recognizes that the user is expressing negative emotions. Based on this, the natural language processing engine adjusts the response, generating and sending a comforting message such as, "That's tough to be stressed out. Maybe it would help to find a way to decompress." Just before the conversation ends, an extension option is displayed, and if the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is stored on the server.

[0258] As described above, the system of the present invention provides a function that allows users to easily enjoy conversations with celebrity avatars, and furthermore, by using an emotion engine to generate responses that correspond to the user's emotions, it provides a more satisfying experience for the user.

[0259] The processing flow will be explained below.

[0260] Step 1:

[0261] A user accesses the web platform and clicks the "Sign Up" button.

[0262] Step 2:

[0263] The device will display a user registration screen and prompt you to enter your name, email address, password, etc.

[0264] Step 3:

[0265] The user enters the required information and clicks the "Submit" button.

[0266] Step 4:

[0267] The terminal transmits the input information to the server.

[0268] Step 5:

[0269] The server receives the input information, validates it, and if validation passes, stores the information in a database.

[0270] Step 6:

[0271] The server generates a registration success message and sends it to the user's terminal.

[0272] Step 7:

[0273] The device will display a registration complete message.

[0274] Step 8:

[0275] The user enters their email address and password on the login screen and clicks the "Login" button.

[0276] Step 9:

[0277] The terminal sends the entered login information to the server.

[0278] Step 10:

[0279] The server validates the login information and generates an authentication token.

[0280] Step 11:

[0281] The server sends the authentication token to the user's device.

[0282] Step 12:

[0283] The device receives the authentication token and displays the main dashboard screen.

[0284] Step 13:

[0285] The user clicks the "Avatar List" button to display a list of celebrity avatars.

[0286] Step 14:

[0287] The device sends an avatar list display request to the server.

[0288] Step 15:

[0289] The server retrieves all avatar information from the database and sends it to the user's device.

[0290] Step 16:

[0291] The device will display a list of avatars.

[0292] Step 17:

[0293] A user enters the name of a particular celebrity in the search bar and clicks the "Search" button.

[0294] Step 18:

[0295] The device sends a search query to the server.

[0296] Step 19:

[0297] The server searches the database based on the search query and retrieves the corresponding avatar information.

[0298] Step 20:

[0299] The server transmits the acquired avatar information to the user's terminal.

[0300] Step 21:

[0301] Your device will display the search results.

[0302] Step 22:

[0303] The user selects a specific avatar and clicks the "Start Talking" button.

[0304] Step 23:

[0305] The terminal sends a conversation start request to the server along with information about the selected avatar.

[0306] Step 24:

[0307] The server creates a conversation session and sends an initial response to the user's terminal.

[0308] Step 25:

[0309] The terminal displays an initial response and waits for user input.

[0310] Step 26:

[0311] The user enters a question or message in the chat box and sends it.

[0312] Step 27:

[0313] The terminal sends the user's message to the server.

[0314] Step 28:

[0315] The server analyzes the user's message using a natural language processing engine and an emotion engine.

[0316] Step 29:

[0317] The server generates an appropriate response based on the analysis results, particularly adjusting the response according to the user's emotions.

[0318] Step 30:

[0319] The server generates a response and sends it to the user's terminal.

[0320] Step 31:

[0321] The terminal displays the response message and waits for further user input.

[0322] Step 32:

[0323] When the conversation is about to end, the device will display extension options and prices.

[0324] Step 33:

[0325] The user selects the extension time and clicks the "Purchase Extension" button.

[0326] Step 34:

[0327] The terminal sends the extension request and payment information to the server.

[0328] Step 35:

[0329] The server calculates the fee and requests the payment processing system to process it.

[0330] Step 36:

[0331] The server sends a success message to the user's terminal.

[0332] Step 37:

[0333] The terminal displays a message indicating that the extension is complete, and the conversation time is extended.

[0334] Step 38:

[0335] After the conversation ends, the device displays a feedback input form.

[0336] Step 39:

[0337] The user enters a rating and comment for the service and clicks the "Submit" button.

[0338] Step 40:

[0339] The terminal sends feedback information to the server.

[0340] Step 41:

[0341] The server stores the feedback information and the analysis results of the emotion engine in a database.

[0342] The above are the specific processing steps in the system of the present invention.

[0343] Example 2

[0344] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0345] Conventional web platforms have limitations in allowing users to enjoy natural conversations with celebrity avatars, making it difficult to fully understand the user's emotions and generate appropriate responses. Furthermore, the complicated procedures for extending conversation sessions and processing payments hinder users' smooth use of the service. Furthermore, there is a lack of a way to effectively utilize the feedback collected after the conversation ends. Therefore, a new system is needed that improves the quality of the user experience while providing smooth operation and appropriate responses based on emotions.

[0346] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0347] In this invention, the server includes: a means for a user to access the web platform and create a user account by entering necessary information; a means for receiving authentication information for the user account and generating and transmitting an authentication token; a means for searching and selecting celebrity avatar information; a means for receiving the user's input, analyzing it using a natural language processing engine and an emotion engine, generating and transmitting an appropriate response; a means for managing the conversation time, offering an extension option, calculating fees, and requesting processing from a payment processing system; and a means for displaying a feedback input form after the conversation ends and storing the feedback information and emotion data in a database. This enables a smooth extension of the conversation session and payment processing while understanding the user's emotions and providing appropriate responses accordingly. Furthermore, the collected feedback and emotion data can be effectively utilized.

[0348] "User" refers to any person who accesses the web platform and uses the services provided therein.

[0349] "Web platform" refers to the system that enables access to information and services provided on the Internet and the performance of various activities.

[0350] "User account" refers to a set of information that individually identifies a user and manages access rights and service usage.

[0351] An "authentication token" refers to unique data generated based on a user's authentication information and used to manage the user's session.

[0352] An "avatar" is a virtual person or character that runs on a computer and that a user can select and interact with.

[0353] A "natural language processing engine" is a software module for understanding and interpreting natural language, and is used to analyze user input and generate appropriate responses.

[0354] An "emotion engine" is a software module that recognizes and analyzes emotions contained in user input, and works in conjunction with a natural language processing engine to generate responses.

[0355] A "conversation session" refers to a session in which a series of conversations take place between a user and an avatar, and the time from start to finish is managed.

[0356] The "extension option" is a service provided near the end of a conversation session, allowing the user to extend the conversation time by paying an additional fee.

[0357] "Payment processing system" refers to a system for receiving payment information from users and completing payments securely.

[0358] The "feedback input form" is an interface that allows users to input their evaluations and comments about the service.

[0359] A "database" refers to a digital storage system for efficiently storing, retrieving, updating, and deleting information.

[0360] "Feedback Information" refers to data on ratings and comments provided by users through the feedback input form.

[0361] "Emotion data" refers to emotional information analyzed by the emotion engine from user input.

[0362] The present invention relates to a web platform that allows users to casually enjoy conversations with celebrity avatars, and in particular incorporates an emotion engine that recognizes the user's emotions and generates responses accordingly. The system of the present invention provides a single process for users to access the web platform, create a user account, log in, select a celebrity avatar, start a conversation, manage the conversation time, select extension options, make a payment, collect feedback, and save the information in a database.

[0363] Hardware used

[0364] Server: A high-performance computer (e.g., a virtual server on a cloud platform)

[0365] Terminal: User's personal computer (PC), smartphone, or other device

[0366] Software used

[0367] Web framework: Django

[0368] Database: PostgreSQL

[0369] Natural Language Processing Engine: GPT Model

[0370] Sentiment Engine: Sentiment Analysis API

[0371] Payment Processing System: Payment API

[0372] Processing flow

[0373] First, a user accesses the web platform and creates a user account by entering information such as name, email address, and password. The device sends this information to the server, which then validates it using the Django framework and stores it in the PostgreSQL database. Once registration is complete, the server generates a success message and sends it to the user's device.

[0374] Next, the user enters their email address and password on the login screen and clicks the login button. The device sends this information to the server, which verifies its validity and then generates an authentication token, which is sent to the user's device. The device receives the token and displays the main dashboard screen.

[0375] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, or search for an avatar by entering the name of a celebrity in the search bar. The device sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the avatar list or search results on the screen.

[0376] When a user selects a specific avatar and clicks the "Start Conversation" button, the device sends this selection information to the server. The server creates a new conversation session and sends an initial response to the user's device. The user advances the conversation by entering questions or messages in the chat box and sending them. The device sends the user's input to the server, which analyzes it using a natural language processing engine and an emotion engine. The natural language processing engine analyzes the entered text and generates an appropriate response. The emotion engine analyzes the emotion contained in the user's message and adjusts the response generated by the natural language processing engine based on the results. For example, if the user is expressing negative emotions, the server recognizes this and generates a more comforting or encouraging response. The generated response is sent from the server to the user's device and displayed.

[0377] When the conversation is in progress and the end time is approaching, an extension option is displayed. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends the extension request and payment information to the server, which calculates the fee and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal and the conversation time is extended.

[0378] After the conversation ends, a feedback input form is displayed, and the user enters their rating or comment on the service and clicks the send button. The device then sends the feedback information to the server, which stores it in a database. This feedback information also includes the user's emotional data analyzed by the emotion engine and is used to improve the service.

[0379] Specific examples

[0380] For example, consider a case where a user wants to talk to an avatar of a famous celebrity. The user accesses the web platform, creates an account, and logs in. Next, they enter the celebrity's name in the search bar and select the corresponding avatar. After starting a conversation, the user types, "I'm feeling stressed at work these days." The server analyzes this message, and the emotion engine recognizes that the user is expressing negative emotions. Based on this, the natural language processing engine adjusts the response, generating and sending a comforting message such as, "That's tough to be stressed out. Maybe it would help to find a way to relax." Before the conversation ends, an option to extend the conversation is displayed. If the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is stored on the server.

[0381] Prompt Sentence Examples

[0382] "Just visit our web platform and start chatting with the avatars of famous celebrities. Just enter their name in the search bar, select their avatar and enjoy the conversation."

[0383] "Speak to a celebrity avatar to discuss work stress. The emotion engine identifies your emotions and provides appropriate responses."

[0384] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0385] Step 1: Divide the processing flow of this system's program into processing steps

[0386] Step 1: Create a user account

[0387] Step 2: User Login and Authentication

[0388] Step 3: Avatar selection and search

[0389] Step 4: Initiating and conducting a conversation session

[0390] Step 5: Extend the conversation and settle

[0391] Step 6: Gather feedback

[0392] Step 2: Explain each processing step in detail

[0393] Step 1: Create a user account

[0394] Input: The user enters their name, email address, and password.

[0395] Operation: The terminal sends the entered user information to the server, which validates the information and stores it in a database.

[0396] Output: The server sends a registration success message to the terminal, which displays it to the user.

[0397] Step 2: User Login and Authentication

[0398] Input: The user enters their email address and password on the login screen.

[0399] How it works: The device sends the entered login information to the server, which generates an authentication token and sends it to the device.

[0400] Output: The device receives the authentication token and displays the main dashboard.

[0401] Step 3: Avatar selection and search

[0402] Input: Users click the "Avatar List" button on the main dashboard or type the name of a specific celebrity into the search bar.

[0403] How it works: The device sends a user request to the server, which retrieves the relevant avatar information from the database and sends it to the device.

[0404] Output: The device displays the list of avatars and search results to the user.

[0405] Step 4: Initiating and conducting a conversation session

[0406] Input: The user selects a specific avatar and clicks the "Start Talking" button.

[0407] Operation: The device sends the selection information to the server. The server creates a conversation session and sends an initial response to the device. The user enters a question or message in the chat box and sends it. The device sends the message to the server, which analyzes it using its natural language processing engine and emotion engine and generates a response.

[0408] Output: The server generates a response and sends it to the terminal, which displays it to the user.

[0409] Step 5: Extend the conversation and settle

[0410] Input: The user selects the extension option that appears when the conversation is about to end. Enters payment information.

[0411] Operation: The terminal sends an extension request and payment information to the server, which calculates the fee and processes it in the payment processing system.

[0412] Output: The server sends an extension completion message to the terminal, which displays it and extends the conversation time.

[0413] Step 6: Gather feedback

[0414] Input: After the conversation ends, the user enters their rating or comment in the feedback input form and submits it.

[0415] Operation: The device sends feedback information to the server, which stores the feedback information and emotion data in a database.

[0416] Output: The server sends a save complete message to the terminal, which displays it to the user.

[0417] (Application example 2)

[0418] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0419] Conventional web platforms lack the ability to properly recognize a user's emotions and generate appropriate responses when users converse with celebrity avatars. Furthermore, there is a lack of a way for users to enjoy natural conversations with celebrity avatars while moving around in the real world. Therefore, there is a need to provide an interactive conversation experience that increases user satisfaction and can be used in the real world.

[0420] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for a user to access a web platform and create a user account by entering required information; means for receiving authentication information for the user account and generating and transmitting an authentication token; means for searching and selecting celebrity avatar information; means for receiving the user's input, analyzing it using a natural language processing engine, and generating and transmitting an appropriate response; means for managing the conversation time, offering extension options, calculating fees, and requesting processing from a payment processing system; means for displaying a feedback input form after the conversation ends and saving the feedback information in a database; means for tracking the user's gaze using an application installed in the smart glasses and realizing natural conversation using voice recognition technology; and means for analyzing the user's voice input using an emotion engine and generating and transmitting a response according to the user's emotion. This allows the user to enjoy interactive conversations with celebrity avatars even while moving around in the real world, thereby increasing user satisfaction.

[0421] "User Account" means an account for personal identification created by a User to access the Web Platform.

[0422] An "authentication token" is a digital token that is generated based on a user's authentication information and is used to grant access authorization.

[0423] "Celebrity avatar information" is digital data that represents a specific celebrity as a virtual character.

[0424] A "natural language processing engine" is a technology that analyzes natural language text entered by a user and generates an appropriate response.

[0425] An "emotion engine" is a technology that analyzes the emotions contained in user input and adjusts responses according to those emotions.

[0426] "Management of conversation time" is a function for measuring the conversation time between the user and the avatar and managing whether to extend the conversation as necessary.

[0427] An "extension option" is a choice that provides additional time if the user wishes to continue the conversation.

[0428] A "payment processing system" is a system that calculates service fees and processes payments from users.

[0429] The "feedback input form" is a screen where users can input and provide their evaluations and comments on the service.

[0430] "Smart glasses" are devices that users can wear to utilize functions such as eye tracking and voice recognition.

[0431] "Eye tracking" is a technology that detects the movement of a user's eyes and performs operations accordingly.

[0432] "Speech recognition technology" is a technology that converts a user's voice into text and analyzes its meaning.

[0433] This invention is a system that allows users to casually enjoy conversations with celebrity avatars. In particular, it incorporates an emotion engine and a natural language processing engine to recognize the user's emotions and generate responses accordingly, and can be used while moving around in the real world using smart glasses.

[0434] The system is structured as follows: First, a user accesses the web platform and enters the necessary information to create a user account. This data is sent to the server, where the validity of the registration information is confirmed and then stored in the database. Once the account is created, the server generates and sends an authentication token to the user.

[0435] Next, the user wears the smart glasses, logs in, and uses an authentication token to access the main dashboard. The user can search for and select a celebrity avatar. The selected avatar is sent to the server, which then creates a conversation session and sends an initial response to the user's device.

[0436] When a user starts a conversation, the device (smart glasses) receives the user's voice input and converts it into text using speech recognition technology. The server then analyzes the received text using a natural language processing engine and generates an appropriate response. At the same time, the emotion engine analyzes the user's emotions and adjusts the response. The generated response is sent from the server to the user's device (smart glasses) and displayed to the user.

[0437] For example, if a user says, "I've been feeling stressed at work lately," the smart glasses convert this speech into text and send it to the server. The server uses an emotion engine to recognize negative emotions and generate a response based on that. The response generated is, "It's tough being stressed. Maybe it would be good to find a way to decompress," and is displayed to the user.

[0438] When the conversation time is about to end, the server presents the user with an option to extend the conversation. If the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. This fee calculation and settlement process are also performed by the server and handled by the settlement system.

[0439] After the conversation is over, the server presents the user with a feedback form, where the user can enter and submit their rating and comments about the service. This feedback information is stored in a database and used to improve the service.

[0440] The main hardware used is smart glasses, voice recognition software (e.g., Google Cloud Speech-to-Text), and emotion recognition engines (e.g., Affectiva), which allow users to enjoy interactive conversations with celebrity avatars while moving around in the real world.

[0441] An example of a prompt to input to a generative AI model is as follows:

[0442] "In response to a user's message, 'I've been feeling stressed at work lately,' use an emotion recognition engine to detect negative emotions and generate a comforting or encouraging message."

[0443] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0444] Step 1:

[0445] A user accesses the web platform and enters the required information to create a user account. The user enters their name, email address, and password, and clicks the submit button. The entered information is sent from the device to the server. The server verifies its validity, stores it in the database, and sends a registration success message to the user's device.

[0446] Step 2:

[0447] The user enters their email address and password on the login screen and clicks the login button. The entered information is sent from the device to the server. The server verifies the authentication information and, if correct, generates an authentication token and sends it to the user's device. The device stores the received authentication token and displays the main dashboard.

[0448] Step 3:

[0449] The user clicks the "Avatar List" button on the main dashboard and selects from the displayed avatars. The selected avatar information is sent from the device to the server, and the server creates a conversation session and sends an initial response to the user's device, which displays this response.

[0450] Step 4:

[0451] A user wears smart glasses and speaks to an avatar. The smart glasses convert the voice input into text. The text data is sent from the device to a server. The server uses a natural language processing engine to analyze the text and generate an appropriate response. At the same time, an emotion engine analyzes the user's emotions and adjusts the response. The generated response is sent from the server to the user's device, which then displays it to the user.

[0452] Step 5:

[0453] When the conversation time is nearing the end, the terminal presents the user with an option to extend the conversation. If the user wishes to extend the conversation, the terminal inputs the extension time and payment information. The input information is sent from the terminal to the server, which calculates the fee and requests processing from the payment processing system. Once the payment is completed, the server sends an extension completion message to the terminal, and the conversation time is extended.

[0454] Step 6:

[0455] After the conversation ends, the device displays a feedback input form. The user enters their rating or comment on the service and clicks the send button. The feedback information is sent from the device to the server, which stores it in a database. The user's emotional data, analyzed by the emotion engine, is also included in the feedback information and used to improve the service.

[0456] In this way, users can enjoy natural conversations with celebrity avatars while moving around in the real world using smart glasses. In addition, the emotion engine and natural language processing engine generate responses based on the user's emotions, increasing user satisfaction.

[0457] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0458] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0459] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0460] [Second embodiment]

[0461] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0462] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0463] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0464] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0465] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0466] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0467] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0468] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0469] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0470] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0471] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0472] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0473] The present invention relates to a web platform that allows users to casually enjoy conversations with celebrity avatars. The system of the present invention provides a process for users to access the web platform, create a user account, log in, select a celebrity avatar, start a conversation, manage time, and provide feedback.

[0474] When a user accesses the web platform, they are first shown a registration screen to create a user account. The user enters information such as their name, email address, and password, and clicks the submit button. The device sends this information to the server, which receives it, verifies its validity, and stores it in a database. Once registration is complete, the server sends a success message to the user, which is displayed on the device.

[0475] Next, the user enters their email address and password on the login screen and clicks the login button. The device sends this information to the server, which verifies the validity of the information, generates an authentication token, and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[0476] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, or search for an avatar by entering the name of a specific celebrity in the search bar. The device sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the retrieved avatar list and search results on the screen.

[0477] When a user selects a specific avatar and clicks the "Start Conversation" button, the terminal sends this selection information to the server, which then creates a conversation session and sends an initial response to the user's terminal, thereby starting the conversation.

[0478] Users can enter questions or messages into the chat box and send them to advance the conversation. The device sends the user's input to the server, which then analyzes the input using a natural language processing engine, generates an appropriate response, and sends it to the device. The device then displays the generated response to the user and waits for the next input.

[0479] As the conversation progresses and the end time approaches, an extension option is displayed. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends the extension request and payment information to the server, which calculates the fee and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal, and the conversation time is extended.

[0480] After the conversation ends, a feedback input form will appear, and the user can enter their rating and comments about the service and click the submit button. The device will then send the feedback information to the server, which will then store it in a database. This will allow data to be accumulated that will be useful for future service improvements.

[0481] As a concrete example, consider a case where a user wants to talk to an avatar of a famous actor. The user accesses a web platform, creates an account, and logs in. Next, the user enters the actor's name in the search bar and selects the corresponding avatar. After starting the conversation, the user types, "Tell me about new movies." The server parses this message and generates and sends a response, "Recently, new movies are..." An extension option is displayed just before the conversation ends, and if the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is stored on the server.

[0482] As described above, the system of the present invention provides a series of functions that allow users to easily enjoy conversations with celebrity avatars, realizing a fulfilling experience while reducing financial and psychological burdens.

[0483] The processing flow will be explained below.

[0484] Step 1:

[0485] A user accesses the web platform and clicks the "Sign Up" button.

[0486] Step 2:

[0487] The device will display a user registration screen and prompt you to enter your name, email address, password, etc.

[0488] Step 3:

[0489] The user enters the required information and clicks the "Submit" button.

[0490] Step 4:

[0491] The terminal transmits the input information to the server.

[0492] Step 5:

[0493] The server receives the input information, validates it, and if validation passes, stores the information in a database.

[0494] Step 6:

[0495] The server generates a registration success message and sends it to the user's terminal.

[0496] Step 7:

[0497] The device will display a registration complete message.

[0498] Step 8:

[0499] The user enters their email address and password on the login screen and clicks the "Login" button.

[0500] Step 9:

[0501] The terminal sends the entered login information to the server.

[0502] Step 10:

[0503] The server validates the login information and generates an authentication token.

[0504] Step 11:

[0505] The server sends the authentication token to the user's device.

[0506] Step 12:

[0507] The device receives the authentication token and displays the main dashboard screen.

[0508] Step 13:

[0509] The user clicks the "Avatar List" button to display a list of celebrity avatars.

[0510] Step 14:

[0511] The device sends an avatar list display request to the server.

[0512] Step 15:

[0513] The server retrieves all avatar information from the database and sends it to the user's device.

[0514] Step 16:

[0515] The device will display a list of avatars.

[0516] Step 17:

[0517] A user enters the name of a particular celebrity in the search bar and clicks the "Search" button.

[0518] Step 18:

[0519] The device sends a search query to the server.

[0520] Step 19:

[0521] The server searches the database based on the search query and retrieves the corresponding avatar information.

[0522] Step 20:

[0523] The server transmits the acquired avatar information to the user's terminal.

[0524] Step 21:

[0525] Your device will display the search results.

[0526] Step 22:

[0527] The user selects a specific avatar and clicks the "Start Talking" button.

[0528] Step 23:

[0529] The terminal sends a conversation start request to the server along with information about the selected avatar.

[0530] Step 24:

[0531] The server creates a conversation session and sends an initial response to the user's terminal.

[0532] Step 25:

[0533] The terminal displays an initial response and waits for user input.

[0534] Step 26:

[0535] The user enters a question or message in the chat box and sends it.

[0536] Step 27:

[0537] The terminal sends the user's message to the server.

[0538] Step 28:

[0539] The server uses a natural language processing engine to analyze the user's message and generate an appropriate response.

[0540] Step 29:

[0541] The server generates a response and sends it to the user's terminal.

[0542] Step 30:

[0543] The terminal displays the response message and waits for further user input.

[0544] Step 31:

[0545] When the conversation is about to end, the device will display extension options and prices.

[0546] Step 32:

[0547] The user selects the extension time and clicks the "Purchase Extension" button.

[0548] Step 33:

[0549] The terminal sends the extension request and payment information to the server.

[0550] Step 34:

[0551] The server calculates the fee and requests the payment processing system to process it.

[0552] Step 35:

[0553] The server sends a success message to the user's terminal.

[0554] Step 36:

[0555] The terminal displays a message indicating that the extension is complete, and the conversation time is extended.

[0556] Step 37:

[0557] After the conversation ends, the device displays a feedback input form.

[0558] Step 38:

[0559] The user enters a rating and comment for the service and clicks the "Submit" button.

[0560] Step 39:

[0561] The terminal sends feedback information to the server.

[0562] Step 40:

[0563] The server stores the feedback information in a database.

[0564] The above are the specific processing steps in the system of the present invention.

[0565] Example 1

[0566] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0567] Previous web platforms had the problem of making it difficult for users to enjoy real-time conversations with celebrities. The process from starting to ending a conversation was often cumbersome, which compromised the user experience. Furthermore, features like feedback collection and conversation extensions were lacking, making it impossible to fully meet user needs.

[0568] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0569] In this invention, the server includes means for receiving authentication information of a user account and generating and transmitting an authentication token, means for searching and selecting avatar information, means for analyzing a user's input using a natural language processing engine and generating and transmitting an appropriate response, means for generating a conversation session and transmitting an initial response to the user's terminal, means for managing conversation time, providing an extension option, calculating fees, and requesting processing from a payment processing system, and means for displaying a feedback input form after the conversation ends and storing the feedback information in a database. This allows users to easily enjoy conversations with celebrity avatars, improving the real-time conversation experience.

[0570] "User" means an individual or entity that uses the web platform, creates an account, logs in and interacts with an avatar.

[0571] The "web platform" refers to a software system accessible over the Internet that allows users to create interactive experiences.

[0572] A "User Account" is an individual identification on the Platform created based on information such as a User's unique name, email address, and password.

[0573] An "authentication token" is a security token that is generated by the server after the user enters correct authentication information and sent to the user's terminal.

[0574] An "avatar" is a simulated person or character with which a user interacts on a web platform.

[0575] A "natural language processing engine" is a software engine that analyzes natural language input from a user and generates an appropriate response.

[0576] A "conversation session" is a unit for managing a series of conversation processes generated by the server in order for a user to have a conversation with an avatar.

[0577] An "initial response" is the first message that the server sends to the user's terminal at the start of a conversation session.

[0578] The "extension option" is information about additional time and price that can be selected if the user wishes to extend the interaction time.

[0579] "Payment Processing System" means an external or internal payment platform for processing fees when a user selects the extension option.

[0580] The "feedback input form" is a form in which the user can input their evaluation or comments on the service after the conversation has ended.

[0581] A "database" is a structured data storage system for storing user information, avatar information, feedback, etc.

[0582] The present invention relates to a web platform that allows users to casually engage in conversations with celebrity avatars. The main elements of the platform are user account registration and authentication, avatar selection, conversation initiation and progression, conversation extension options, and feedback collection.

[0583] Registration Process

[0584] The user accesses the web platform and enters the required information, such as name, email address, and password. The device sends this information to the server as an HTTP POST request. The server verifies the validity of the entered information and stores it in a database (e.g., MySQL). Once registration is complete, the server sends a message to the device saying "Registration completed," which the device displays to the user.

[0585] Login Process

[0586] The user enters their email address and password on the login screen, and the device sends this to the server. The server retrieves user information from the database based on the received information, and if it matches, generates a JWT (JSON Web Token) and sends it to the device. The device uses this token to display the main dashboard screen.

[0587] Avatar Selection

[0588] Users can click the "Avatar List" button on the main dashboard or enter the name of a specific celebrity in the search bar. The device then sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device, which then displays it to the user.

[0589] Initiating and conducting a conversation

[0590] When a user selects a specific avatar and clicks the "Start Conversation" button, the device sends the selection information to the server. The server creates a new conversation session and generates an initial message based on a natural language processing engine (such as GPT-4). This initial message is sent to the device, which displays it to the user. When the user enters a question or message and the device sends it, the server passes it to the natural language processing engine for analysis and generates an appropriate response. The generated response is sent to the device and displayed to the user.

[0591] Extending the conversation

[0592] As the conversation approaches its end time, the server sends an extension option to the terminal. The terminal displays an extension suggestion and fee information to the user. If the user wishes to extend the conversation and enters payment information, the terminal sends this to the server. The server processes the payment using a payment system such as Stripe, and if successful, sends a message to the terminal indicating that the extension has been completed. The terminal notifies the user, and the conversation is extended.

[0593] Enter your feedback

[0594] After the conversation ends, the user enters their rating and comments in the feedback input form. The device sends this information to the server, which stores it in a database. This feedback information is used to improve the service.

[0595] Specific examples

[0596] For example, if a user wants to have a conversation with an avatar of a famous actor, the user accesses the web platform, creates an account, and logs in. Then, the user enters the actor's name in the search bar and selects the actor's avatar. After the conversation begins, the user types, "Tell me about new movies." The server analyzes this message and generates a response, "Recently, new movies...," and sends it to the device.

[0597] Prompt Sentence Examples

[0598] Generate a response when a user asks, "Hello, famous actor. What movies have you been in recently?"

[0599] This system aims to improve the user experience by providing a function that allows users to easily enjoy real-time conversations with celebrity avatars. By using this platform, users can achieve a fulfilling conversational experience with minimal out-of-pocket costs.

[0600] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0601] Step 1:

[0602] A user accesses the web platform and enters their name, email address, and password on the account creation page. The device collects this input information and sends it to the server as an HTTP POST request. The server validates the received information, ensuring that it is a correctly formatted email address and that the password meets the required security standards, for example by using a validation library (e.g., Joi). The server then stores the information in a database (e.g., MySQL), and generates a success message and sends it to the device. The device displays the success message to the user. The input data are the name, email address, and password, and the output is the success message.

[0603] Step 2:

[0604] The user enters their email address and password on the login screen and clicks the login button. The device sends the entered login information to the server. The server receives this information, searches for the corresponding user information in the database, and confirms that it matches. If authentication is successful, the server generates a JWT (JSON Web Token) and sends it to the device. The device receives this token and displays the main dashboard screen to the user. The input data is the email address and password, and the output is the authentication token and the main dashboard screen.

[0605] Step 3:

[0606] The user clicks the "Avatar List" button on the main dashboard or enters the name of a specific celebrity in the search bar. The device sends the user's request to the server as an HTTP GET request. The server retrieves the corresponding avatar information from the database and sends it in JSON format to the device. The device analyzes the retrieved avatar information and displays a list of images and names. The input data is an avatar selection request, and the output is a list of avatar information.

[0607] Step 4:

[0608] The user selects a specific avatar and clicks the "Start Conversation" button. The device sends the selection information to the server. The server creates a new conversation session and generates an initial message using a natural language processing engine (e.g., a generative AI model). The server sends this initial message to the device, which displays it to the user. The input data is the avatar selection information, and the output is the initial message.

[0609] Step 5:

[0610] The user enters a message in the chat box and clicks the send button. The terminal sends this input to the server. The server passes the received input to a natural language processing engine for analysis and generates an appropriate response. The generated response is sent by the server to the terminal. The terminal displays the response to the user. The input data is the user's message and the output is the generated response.

[0611] Step 6:

[0612] As the conversation approaches its end time, the server sends an extension option to the terminal. The terminal displays the extension option and fee information to the user. When the user selects the extension time and price and enters payment information, the terminal sends this information to the server. The server calculates the fee and processes the payment using a payment processing system (e.g., an external payment platform). If the payment is successful, the server generates an extension completion message and sends it to the terminal. The terminal notifies the user of this. The input data is the extension request and payment information, and the output is the extension completion message.

[0613] Step 7:

[0614] After the conversation ends, the user enters their rating and comments in the feedback input form. The device sends the feedback information to the server, which stores it in a database and uses it to improve the service. The input data is the feedback information, and the output is a feedback save confirmation message.

[0615] Through the above series of steps, users can enjoy real-time conversations with celebrity avatars, providing a highly satisfying interactive experience.

[0616] (Application example 1)

[0617] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0618] In interactive virtual stores, when users interact with celebrity avatars in real time to learn about products and make purchases, conventional systems lack the quality and realism of responses. This limits the user experience and reduces shopping satisfaction. It also makes it difficult to extend conversations, process payments, and efficiently collect feedback.

[0619] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0620] In this invention, the server includes: means for a user to access the web platform and create a user account by inputting necessary information; means for receiving authentication information for the user account and generating and transmitting an authentication token; means for searching and selecting celebrity avatar information; means for receiving the user's input, analyzing it using a natural language processing engine, and generating and transmitting an appropriate response; means for managing the conversation time, offering an extension option, calculating fees, and requesting processing from a payment processing system; means for displaying a feedback input form after the conversation ends and saving the feedback information in a database; and means for requesting product explanations and purchasing advice from the celebrity avatar in the virtual store and receiving a response. This allows the user to receive detailed product explanations and purchasing advice from the celebrity avatar in real time in the virtual store, thereby improving shopping satisfaction.

[0621] A "web platform" is an online system that users can access via the Internet and use various services and functions.

[0622] "User Account" means a collection of information that identifies an individual user on the Web Platform and grants access rights to use the Services.

[0623] An "authentication token" is a temporary identifier generated to verify a user's identity and authorize them to operate within a system.

[0624] A "celebrity avatar" is a digital representation of a real-life celebrity that can interact with users.

[0625] A "natural language processing engine" is a technology or software that enables a computer to understand, analyze, and generate responses to human language.

[0626] "Conversation time management" is a function for monitoring the duration of a conversation between a user and a celebrity avatar and extending it as necessary.

[0627] The "extension option" is a choice to extend the set time if the user wishes to continue the conversation.

[0628] "Charge calculation" is the process of calculating the charges incurred for the use of a service.

[0629] A "payment processing system" is a system for accepting and processing payments from users.

[0630] The "feedback input form" is a screen element that allows users to input ratings and comments on the service.

[0631] A "virtual store" is a virtual shopping environment where products can be displayed, explained, and purchased online.

[0632] "Product description" is information that explains the product's features, usage, price, etc. to the user.

[0633] "Purchase advice" refers to providing information and advice that is useful to users when purchasing products.

[0634] The present invention relates to a system that allows users to receive product explanations and purchasing advice from celebrity avatars in a virtual store. The system of the present invention provides a series of processes for users to access a web platform, create a user account, log in, select a celebrity avatar, start a conversation, select extension options and payment processing, and finally provide feedback.

[0635] First, when a user accesses the web platform, a registration screen for creating a user account is displayed. The user enters information such as name, email address, and password and clicks the submit button. The server receives this input information, verifies its validity, and saves it in a database.

[0636] Next, the user enters their email address and password on the login screen and clicks the login button. The server receives this information, generates an authentication token, and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[0637] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, and then search for avatars by entering the name of a specific celebrity in the search bar. The server retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the retrieved avatar list and search results on the screen.

[0638] When a user selects a specific avatar and clicks the "Start Conversation" button, the server creates a conversation session and starts the conversation by sending an initial response to the user's device, such as "Nice to meet you! Is there anything you'd like to ask me?"

[0639] Users can enter questions or messages into the chat box and send them to advance the conversation. The device sends the user's input to the server, which then analyzes the input using a natural language processing engine (e.g., GPT-3), generates an appropriate response, and sends it to the device. The device then displays the generated response to the user and waits for the next input.

[0640] As the conversation progresses and the end time approaches, an extension option will appear on the terminal. If the user wishes to extend the conversation, they will select the extension time and price and enter payment information. The server receives the extension request and payment information, calculates the fee, and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal, and the conversation time is extended.

[0641] After the conversation ends, a feedback input form will appear on the device, and the user can enter their rating and comments about the service and click the submit button. The server will receive the feedback information and store it in a database. This will allow the server to accumulate data that will be useful for future service improvements.

[0642] As a concrete example, consider a case where a user wants to talk to an avatar of a famous actor. The user accesses a web platform, creates an account, and logs in. Next, the user enters the actor's name in the search bar and selects the corresponding avatar. After starting the conversation, the user types, "Tell me about new movies." The server analyzes this message and generates and sends the response, "Actor Avatar: The latest new movies are...." Just before the conversation ends, an extension option is displayed, and if the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is saved on the server.

[0643] Example prompt sentence:

[0644] 1. Go to the web platform and click on the "Create an Account" button.

[0645] 2. Enter the required information (name, email address, password) and click the Send button.

[0646] 3. Once you have completed the registration, click the "Login" button and enter your email address and password to log in.

[0647] 4. From the main dashboard, click the "Avatar List" button to view the list of avatars.

[0648] 5. Select your actor's avatar and click the "Start Talking" button.

[0649] 6. Type "Tell me about new movies" in the message box and send.

[0650] 7. You will see a response such as "Actor Avatar: In the latest new movie..."

[0651] This system allows users to receive detailed product descriptions and purchasing advice in real time from celebrity avatars within a virtual store, improving their shopping satisfaction.

[0652] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0653] Step 1:

[0654] A user accesses the web platform, enters the required information on the account creation screen, and submits it. The user enters a username, email address, and password. The submitted data is sent to the server. The server verifies the validity of the received data, and if the verification is successful, stores it in a database. It then sends a message to the user's device indicating that account creation has been completed.

[0655] Input: Username, Email Address, Password

[0656] Output: Account creation complete message

[0657] Step 2:

[0658] The user enters their email address and password on the login screen and submits it. The user's authentication information is sent to the server. The server compares it with information in the database, and if authentication is successful, generates an authentication token and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[0659] Input: User's email address, password

[0660] Output: Auth token, main dashboard

[0661] Step 3:

[0662] The user clicks the "Avatar List" button on the main dashboard to display a list of avatars. The server retrieves avatar information from the database and sends it to the device. The user checks the displayed avatar information.

[0663] Input: User avatar list request

[0664] Output: List of displayed avatars

[0665] Step 4:

[0666] A user enters the avatar of a particular celebrity into the search bar and clicks the search execution button. The device sends the input information to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The corresponding avatar information is then displayed on the device.

[0667] Input: User search input (famous person's name)

[0668] Output: Avatar information for the displayed search results

[0669] Step 5:

[0670] The user selects a specific avatar and clicks the "Start Conversation" button. The device sends a session initiation request to the server, which creates a conversation session. An initial response is generated and sent to the user's device. The device displays "Nice to meet you! Is there anything you'd like to ask me?"

[0671] Input: User's avatar selection information

[0672] Output: Initial response message

[0673] Step 6:

[0674] The user enters a question or message into the chat box and sends it. The device sends the user's input to the server, which then analyzes the message using a natural language processing engine (e.g., GPT-3). An appropriate response is generated and sent to the device. The generated response message is displayed on the device. Responses such as "Actor Avatar: In recent new movies..." are provided.

[0675] Input: User's message

[0676] Output: The generated response message

[0677] Step 7:

[0678] As the conversation nears the end, an extension option appears on the terminal. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends this information to the server, which calculates the fee and requests processing from the payment processing system. If successful, an extension completion message is sent to the terminal and the conversation time is extended.

[0679] Input: Extended time, payment information

[0680] Output: Extension complete message

[0681] Step 8:

[0682] After the conversation ends, a feedback input form is displayed on the device. The user enters their rating and comments and submits them. The device then sends the feedback information to the server, which stores it in a database. User feedback is accumulated as data that will help improve the service.

[0683] Input: User feedback

[0684] Output: Feedback save completion notification

[0685] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0686] The present invention relates to a web platform that allows users to casually enjoy conversations with celebrity avatars, and in particular incorporates an emotion engine that recognizes the user's emotions and generates responses accordingly. The system of the present invention provides a process for users to access the web platform, create a user account, log in, select a celebrity avatar, start a conversation, manage time, and provide feedback.

[0687] When a user accesses the web platform, they are first shown a registration screen to create a user account. The user enters information such as their name, email address, and password, and clicks the submit button. The device sends this information to the server, which receives it, verifies its validity, and stores it in a database. Once registration is complete, the server sends a success message to the user, which is displayed on the device.

[0688] Next, the user enters their email address and password on the login screen and clicks the login button. The device sends this information to the server, which verifies the validity of the information, generates an authentication token, and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[0689] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, or search for an avatar by entering the name of a specific celebrity in the search bar. The device sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the retrieved avatar list and search results on the screen.

[0690] When a user selects a specific avatar and clicks the "Start Conversation" button, the terminal sends this selection information to the server, which then creates a conversation session and sends an initial response to the user's terminal, thereby starting the conversation.

[0691] Users advance the conversation by entering questions or messages into the chat box and sending them. The device sends the user's input to the server, which analyzes the input using a natural language processing engine and an emotion engine. The natural language processing engine analyzes the content of the entered text and generates an appropriate response. The emotion engine analyzes the emotion contained in the user's message and adjusts the response generated by the natural language processing engine based on the results. For example, if the user is expressing negative emotion, the server will recognize this and generate a more comforting or encouraging response. The generated response is sent from the server to the user's device and displayed.

[0692] As the conversation progresses and the end time approaches, an extension option is displayed. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends the extension request and payment information to the server, which calculates the fee and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal, and the conversation time is extended.

[0693] After the conversation ends, a feedback input form is displayed, and the user enters their rating and comments about the service and clicks the send button. The device then sends the feedback information to the server, which stores it in a database. This feedback information also includes the user's emotional data analyzed by the emotion engine and is used to improve the service.

[0694] As a concrete example, consider a case where a user wants to talk to an avatar of a famous actor. The user accesses a web platform, creates an account, and logs in. Next, they enter the actor's name in the search bar and select the corresponding avatar. After starting a conversation, the user types, "I'm feeling stressed at work these days." The server analyzes this message, and the emotion engine recognizes that the user is expressing negative emotions. Based on this, the natural language processing engine adjusts the response, generating and sending a comforting message such as, "That's tough to be stressed out. Maybe it would help to find a way to decompress." Just before the conversation ends, an extension option is displayed, and if the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is stored on the server.

[0695] As described above, the system of the present invention provides a function that allows users to easily enjoy conversations with celebrity avatars, and furthermore, by using an emotion engine to generate responses that correspond to the user's emotions, it provides a more satisfying experience for the user.

[0696] The processing flow will be explained below.

[0697] Step 1:

[0698] A user accesses the web platform and clicks the "Sign Up" button.

[0699] Step 2:

[0700] The device will display a user registration screen and prompt you to enter your name, email address, password, etc.

[0701] Step 3:

[0702] The user enters the required information and clicks the "Submit" button.

[0703] Step 4:

[0704] The terminal transmits the input information to the server.

[0705] Step 5:

[0706] The server receives the input information, validates it, and if validation passes, stores the information in a database.

[0707] Step 6:

[0708] The server generates a registration success message and sends it to the user's terminal.

[0709] Step 7:

[0710] The device will display a registration complete message.

[0711] Step 8:

[0712] The user enters their email address and password on the login screen and clicks the "Login" button.

[0713] Step 9:

[0714] The terminal sends the entered login information to the server.

[0715] Step 10:

[0716] The server validates the login information and generates an authentication token.

[0717] Step 11:

[0718] The server sends the authentication token to the user's device.

[0719] Step 12:

[0720] The device receives the authentication token and displays the main dashboard screen.

[0721] Step 13:

[0722] The user clicks the "Avatar List" button to display a list of celebrity avatars.

[0723] Step 14:

[0724] The device sends an avatar list display request to the server.

[0725] Step 15:

[0726] The server retrieves all avatar information from the database and sends it to the user's device.

[0727] Step 16:

[0728] The device will display a list of avatars.

[0729] Step 17:

[0730] A user enters the name of a particular celebrity in the search bar and clicks the "Search" button.

[0731] Step 18:

[0732] The device sends a search query to the server.

[0733] Step 19:

[0734] The server searches the database based on the search query and retrieves the corresponding avatar information.

[0735] Step 20:

[0736] The server transmits the acquired avatar information to the user's terminal.

[0737] Step 21:

[0738] Your device will display the search results.

[0739] Step 22:

[0740] The user selects a specific avatar and clicks the "Start Talking" button.

[0741] Step 23:

[0742] The terminal sends a conversation start request to the server along with information about the selected avatar.

[0743] Step 24:

[0744] The server creates a conversation session and sends an initial response to the user's terminal.

[0745] Step 25:

[0746] The terminal displays an initial response and waits for user input.

[0747] Step 26:

[0748] The user enters a question or message in the chat box and sends it.

[0749] Step 27:

[0750] The terminal sends the user's message to the server.

[0751] Step 28:

[0752] The server analyzes the user's message using a natural language processing engine and an emotion engine.

[0753] Step 29:

[0754] The server generates an appropriate response based on the analysis results, particularly adjusting the response according to the user's emotions.

[0755] Step 30:

[0756] The server generates a response and sends it to the user's terminal.

[0757] Step 31:

[0758] The terminal displays the response message and waits for further user input.

[0759] Step 32:

[0760] When the conversation is about to end, the device will display extension options and prices.

[0761] Step 33:

[0762] The user selects the extension time and clicks the "Purchase Extension" button.

[0763] Step 34:

[0764] The terminal sends the extension request and payment information to the server.

[0765] Step 35:

[0766] The server calculates the fee and requests the payment processing system to process it.

[0767] Step 36:

[0768] The server sends a success message to the user's terminal.

[0769] Step 37:

[0770] The terminal displays a message indicating that the extension is complete, and the conversation time is extended.

[0771] Step 38:

[0772] After the conversation ends, the device displays a feedback input form.

[0773] Step 39:

[0774] The user enters a rating and comment for the service and clicks the "Submit" button.

[0775] Step 40:

[0776] The terminal sends feedback information to the server.

[0777] Step 41:

[0778] The server stores the feedback information and the analysis results of the emotion engine in a database.

[0779] The above are the specific processing steps in the system of the present invention.

[0780] Example 2

[0781] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0782] Conventional web platforms have limitations in allowing users to enjoy natural conversations with celebrity avatars, making it difficult to fully understand the user's emotions and generate appropriate responses. Furthermore, the complicated procedures for extending conversation sessions and processing payments hinder users' smooth use of the service. Furthermore, there is a lack of a way to effectively utilize the feedback collected after the conversation ends. Therefore, a new system is needed that improves the quality of the user experience while providing smooth operation and appropriate responses based on emotions.

[0783] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0784] In this invention, the server includes: a means for a user to access the web platform and create a user account by entering necessary information; a means for receiving authentication information for the user account and generating and transmitting an authentication token; a means for searching and selecting celebrity avatar information; a means for receiving the user's input, analyzing it using a natural language processing engine and an emotion engine, generating and transmitting an appropriate response; a means for managing the conversation time, offering an extension option, calculating fees, and requesting processing from a payment processing system; and a means for displaying a feedback input form after the conversation ends and storing the feedback information and emotion data in a database. This enables a smooth extension of the conversation session and payment processing while understanding the user's emotions and providing appropriate responses accordingly. Furthermore, the collected feedback and emotion data can be effectively utilized.

[0785] "User" refers to any person who accesses the web platform and uses the services provided therein.

[0786] "Web platform" refers to the system that enables access to information and services provided on the Internet and the performance of various activities.

[0787] "User account" refers to a set of information that individually identifies a user and manages access rights and service usage.

[0788] An "authentication token" refers to unique data generated based on a user's authentication information and used to manage the user's session.

[0789] An "avatar" is a virtual person or character that runs on a computer and that a user can select and interact with.

[0790] A "natural language processing engine" is a software module for understanding and interpreting natural language, and is used to analyze user input and generate appropriate responses.

[0791] An "emotion engine" is a software module that recognizes and analyzes emotions contained in user input, and works in conjunction with a natural language processing engine to generate responses.

[0792] A "conversation session" refers to a session in which a series of conversations take place between a user and an avatar, and the time from start to finish is managed.

[0793] The "extension option" is a service provided near the end of a conversation session, allowing the user to extend the conversation time by paying an additional fee.

[0794] "Payment processing system" refers to a system for receiving payment information from users and completing payments securely.

[0795] The "feedback input form" is an interface that allows users to input their evaluations and comments about the service.

[0796] A "database" refers to a digital storage system for efficiently storing, retrieving, updating, and deleting information.

[0797] "Feedback Information" refers to data on ratings and comments provided by users through the feedback input form.

[0798] "Emotion data" refers to emotional information analyzed by the emotion engine from user input.

[0799] The present invention relates to a web platform that allows users to casually enjoy conversations with celebrity avatars, and in particular incorporates an emotion engine that recognizes the user's emotions and generates responses accordingly. The system of the present invention provides a single process for users to access the web platform, create a user account, log in, select a celebrity avatar, start a conversation, manage the conversation time, select extension options, make a payment, collect feedback, and save the information in a database.

[0800] Hardware used

[0801] Server: A high-performance computer (e.g., a virtual server on a cloud platform)

[0802] Terminal: User's personal computer (PC), smartphone, or other device

[0803] Software used

[0804] Web framework: Django

[0805] Database: PostgreSQL

[0806] Natural Language Processing Engine: GPT Model

[0807] Sentiment Engine: Sentiment Analysis API

[0808] Payment Processing System: Payment API

[0809] Processing flow

[0810] First, a user accesses the web platform and creates a user account by entering information such as name, email address, and password. The device sends this information to the server, which then validates it using the Django framework and stores it in the PostgreSQL database. Once registration is complete, the server generates a success message and sends it to the user's device.

[0811] Next, the user enters their email address and password on the login screen and clicks the login button. The device sends this information to the server, which verifies its validity and then generates an authentication token, which is sent to the user's device. The device receives the token and displays the main dashboard screen.

[0812] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, or search for an avatar by entering the name of a celebrity in the search bar. The device sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the avatar list or search results on the screen.

[0813] When a user selects a specific avatar and clicks the "Start Conversation" button, the device sends this selection information to the server. The server creates a new conversation session and sends an initial response to the user's device. The user advances the conversation by entering questions or messages in the chat box and sending them. The device sends the user's input to the server, which analyzes it using a natural language processing engine and an emotion engine. The natural language processing engine analyzes the entered text and generates an appropriate response. The emotion engine analyzes the emotion contained in the user's message and adjusts the response generated by the natural language processing engine based on the results. For example, if the user is expressing negative emotions, the server recognizes this and generates a more comforting or encouraging response. The generated response is sent from the server to the user's device and displayed.

[0814] When the conversation is in progress and the end time is approaching, an extension option is displayed. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends the extension request and payment information to the server, which calculates the fee and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal and the conversation time is extended.

[0815] After the conversation ends, a feedback input form is displayed, and the user enters their rating or comment on the service and clicks the send button. The device then sends the feedback information to the server, which stores it in a database. This feedback information also includes the user's emotional data analyzed by the emotion engine and is used to improve the service.

[0816] Specific examples

[0817] For example, consider a case where a user wants to talk to an avatar of a famous celebrity. The user accesses the web platform, creates an account, and logs in. Next, they enter the celebrity's name in the search bar and select the corresponding avatar. After starting a conversation, the user types, "I'm feeling stressed at work these days." The server analyzes this message, and the emotion engine recognizes that the user is expressing negative emotions. Based on this, the natural language processing engine adjusts the response, generating and sending a comforting message such as, "That's tough to be stressed out. Maybe it would help to find a way to relax." Before the conversation ends, an option to extend the conversation is displayed. If the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is stored on the server.

[0818] Prompt Sentence Examples

[0819] "Just visit our web platform and start chatting with the avatars of famous celebrities. Just enter their name in the search bar, select their avatar and enjoy the conversation."

[0820] "Speak to a celebrity avatar to discuss work stress. The emotion engine identifies your emotions and provides appropriate responses."

[0821] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0822] Step 1: Divide the processing flow of this system's program into processing steps

[0823] Step 1: Create a user account

[0824] Step 2: User Login and Authentication

[0825] Step 3: Avatar selection and search

[0826] Step 4: Initiating and conducting a conversation session

[0827] Step 5: Extend the conversation and settle

[0828] Step 6: Gather feedback

[0829] Step 2: Explain each processing step in detail

[0830] Step 1: Create a user account

[0831] Input: The user enters their name, email address, and password.

[0832] Operation: The terminal sends the entered user information to the server, which validates the information and stores it in a database.

[0833] Output: The server sends a registration success message to the terminal, which displays it to the user.

[0834] Step 2: User Login and Authentication

[0835] Input: The user enters their email address and password on the login screen.

[0836] How it works: The device sends the entered login information to the server, which generates an authentication token and sends it to the device.

[0837] Output: The device receives the authentication token and displays the main dashboard.

[0838] Step 3: Avatar selection and search

[0839] Input: Users click the "Avatar List" button on the main dashboard or type the name of a specific celebrity into the search bar.

[0840] How it works: The device sends a user request to the server, which retrieves the relevant avatar information from the database and sends it to the device.

[0841] Output: The device displays the list of avatars and search results to the user.

[0842] Step 4: Initiating and conducting a conversation session

[0843] Input: The user selects a specific avatar and clicks the "Start Talking" button.

[0844] Operation: The device sends the selection information to the server. The server creates a conversation session and sends an initial response to the device. The user enters a question or message in the chat box and sends it. The device sends the message to the server, which analyzes it using its natural language processing engine and emotion engine and generates a response.

[0845] Output: The server generates a response and sends it to the terminal, which displays it to the user.

[0846] Step 5: Extend the conversation and settle

[0847] Input: The user selects the extension option that appears when the conversation is about to end. Enters payment information.

[0848] Operation: The terminal sends an extension request and payment information to the server, which calculates the fee and processes it in the payment processing system.

[0849] Output: The server sends an extension completion message to the terminal, which displays it and extends the conversation time.

[0850] Step 6: Gather feedback

[0851] Input: After the conversation ends, the user enters their rating or comment in the feedback input form and submits it.

[0852] Operation: The device sends feedback information to the server, which stores the feedback information and emotion data in a database.

[0853] Output: The server sends a save complete message to the terminal, which displays it to the user.

[0854] (Application example 2)

[0855] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0856] Conventional web platforms lack the ability to properly recognize a user's emotions and generate appropriate responses when users converse with celebrity avatars. Furthermore, there is a lack of a way for users to enjoy natural conversations with celebrity avatars while moving around in the real world. Therefore, there is a need to provide an interactive conversation experience that increases user satisfaction and can be used in the real world.

[0857] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for a user to access a web platform and create a user account by entering required information; means for receiving authentication information for the user account and generating and transmitting an authentication token; means for searching and selecting celebrity avatar information; means for receiving the user's input, analyzing it using a natural language processing engine, and generating and transmitting an appropriate response; means for managing the conversation time, offering extension options, calculating fees, and requesting processing from a payment processing system; means for displaying a feedback input form after the conversation ends and saving the feedback information in a database; means for tracking the user's gaze using an application installed in the smart glasses and realizing natural conversation using voice recognition technology; and means for analyzing the user's voice input using an emotion engine and generating and transmitting a response according to the user's emotion. This allows the user to enjoy interactive conversations with celebrity avatars even while moving around in the real world, thereby increasing user satisfaction.

[0858] "User Account" means an account for personal identification created by a User to access the Web Platform.

[0859] An "authentication token" is a digital token that is generated based on a user's authentication information and is used to grant access authorization.

[0860] "Celebrity avatar information" is digital data that represents a specific celebrity as a virtual character.

[0861] A "natural language processing engine" is a technology that analyzes natural language text entered by a user and generates an appropriate response.

[0862] An "emotion engine" is a technology that analyzes the emotions contained in user input and adjusts responses according to those emotions.

[0863] "Management of conversation time" is a function for measuring the conversation time between the user and the avatar and managing whether to extend the conversation as necessary.

[0864] An "extension option" is a choice that provides additional time if the user wishes to continue the conversation.

[0865] A "payment processing system" is a system that calculates service fees and processes payments from users.

[0866] The "feedback input form" is a screen where users can input and provide their evaluations and comments on the service.

[0867] "Smart glasses" are devices that users can wear to utilize functions such as eye tracking and voice recognition.

[0868] "Eye tracking" is a technology that detects the movement of a user's eyes and performs operations accordingly.

[0869] "Speech recognition technology" is a technology that converts a user's voice into text and analyzes its meaning.

[0870] This invention is a system that allows users to casually enjoy conversations with celebrity avatars. In particular, it incorporates an emotion engine and a natural language processing engine to recognize the user's emotions and generate responses accordingly, and can be used while moving around in the real world using smart glasses.

[0871] The system is structured as follows: First, a user accesses the web platform and enters the necessary information to create a user account. This data is sent to the server, where the validity of the registration information is confirmed and then stored in the database. Once the account is created, the server generates and sends an authentication token to the user.

[0872] Next, the user wears the smart glasses, logs in, and uses an authentication token to access the main dashboard. The user can search for and select a celebrity avatar. The selected avatar is sent to the server, which then creates a conversation session and sends an initial response to the user's device.

[0873] When a user starts a conversation, the device (smart glasses) receives the user's voice input and converts it into text using speech recognition technology. The server then analyzes the received text using a natural language processing engine and generates an appropriate response. At the same time, the emotion engine analyzes the user's emotions and adjusts the response. The generated response is sent from the server to the user's device (smart glasses) and displayed to the user.

[0874] For example, if a user says, "I've been feeling stressed at work lately," the smart glasses convert this speech into text and send it to the server. The server uses an emotion engine to recognize negative emotions and generate a response based on that. The response generated is, "It's tough being stressed. Maybe it would be good to find a way to decompress," and is displayed to the user.

[0875] When the conversation time is about to end, the server presents the user with an option to extend the conversation. If the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. This fee calculation and settlement process are also performed by the server and handled by the settlement system.

[0876] After the conversation is over, the server presents the user with a feedback form, where the user can enter and submit their rating and comments about the service. This feedback information is stored in a database and used to improve the service.

[0877] The main hardware used is smart glasses, voice recognition software (e.g., Google Cloud Speech-to-Text), and emotion recognition engines (e.g., Affectiva), which allow users to enjoy interactive conversations with celebrity avatars while moving around in the real world.

[0878] An example of a prompt to input to a generative AI model is as follows:

[0879] "In response to a user's message, 'I've been feeling stressed at work lately,' use an emotion recognition engine to detect negative emotions and generate a comforting or encouraging message."

[0880] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0881] Step 1:

[0882] A user accesses the web platform and enters the required information to create a user account. The user enters their name, email address, and password, and clicks the submit button. The entered information is sent from the device to the server. The server verifies its validity, stores it in the database, and sends a registration success message to the user's device.

[0883] Step 2:

[0884] The user enters their email address and password on the login screen and clicks the login button. The entered information is sent from the device to the server. The server verifies the authentication information and, if correct, generates an authentication token and sends it to the user's device. The device stores the received authentication token and displays the main dashboard.

[0885] Step 3:

[0886] The user clicks the "Avatar List" button on the main dashboard and selects from the displayed avatars. The selected avatar information is sent from the device to the server, and the server creates a conversation session and sends an initial response to the user's device, which displays this response.

[0887] Step 4:

[0888] A user wears smart glasses and speaks to an avatar. The smart glasses convert the voice input into text. The text data is sent from the device to a server. The server uses a natural language processing engine to analyze the text and generate an appropriate response. At the same time, an emotion engine analyzes the user's emotions and adjusts the response. The generated response is sent from the server to the user's device, which then displays it to the user.

[0889] Step 5:

[0890] When the conversation time is nearing the end, the terminal presents the user with an option to extend the conversation. If the user wishes to extend the conversation, the terminal inputs the extension time and payment information. The input information is sent from the terminal to the server, which calculates the fee and requests processing from the payment processing system. Once the payment is completed, the server sends an extension completion message to the terminal, and the conversation time is extended.

[0891] Step 6:

[0892] After the conversation ends, the device displays a feedback input form. The user enters their rating or comment on the service and clicks the send button. The feedback information is sent from the device to the server, which stores it in a database. The user's emotional data, analyzed by the emotion engine, is also included in the feedback information and used to improve the service.

[0893] In this way, users can enjoy natural conversations with celebrity avatars while moving around in the real world using smart glasses. In addition, the emotion engine and natural language processing engine generate responses based on the user's emotions, increasing user satisfaction.

[0894] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0895] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0896] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0897] [Third embodiment]

[0898] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0899] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0900] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0901] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0902] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0903] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0904] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0905] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0906] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0907] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0908] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0909] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0910] The present invention relates to a web platform that allows users to casually enjoy conversations with celebrity avatars. The system of the present invention provides a process for users to access the web platform, create a user account, log in, select a celebrity avatar, start a conversation, manage time, and provide feedback.

[0911] When a user accesses the web platform, they are first shown a registration screen to create a user account. The user enters information such as their name, email address, and password, and clicks the submit button. The device sends this information to the server, which receives it, verifies its validity, and stores it in a database. Once registration is complete, the server sends a success message to the user, which is displayed on the device.

[0912] Next, the user enters their email address and password on the login screen and clicks the login button. The device sends this information to the server, which verifies the validity of the information, generates an authentication token, and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[0913] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, or search for an avatar by entering the name of a specific celebrity in the search bar. The device sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the retrieved avatar list and search results on the screen.

[0914] When a user selects a specific avatar and clicks the "Start Conversation" button, the terminal sends this selection information to the server, which then creates a conversation session and sends an initial response to the user's terminal, thereby starting the conversation.

[0915] Users can enter questions or messages into the chat box and send them to advance the conversation. The device sends the user's input to the server, which then analyzes the input using a natural language processing engine, generates an appropriate response, and sends it to the device. The device then displays the generated response to the user and waits for the next input.

[0916] As the conversation progresses and the end time approaches, an extension option is displayed. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends the extension request and payment information to the server, which calculates the fee and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal, and the conversation time is extended.

[0917] After the conversation ends, a feedback input form will appear, and the user can enter their rating and comments about the service and click the submit button. The device will then send the feedback information to the server, which will then store it in a database. This will allow data to be accumulated that will be useful for future service improvements.

[0918] As a concrete example, consider a case where a user wants to talk to an avatar of a famous actor. The user accesses a web platform, creates an account, and logs in. Next, the user enters the actor's name in the search bar and selects the corresponding avatar. After starting the conversation, the user types, "Tell me about new movies." The server parses this message and generates and sends a response, "Recently, new movies are..." An extension option is displayed just before the conversation ends, and if the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is stored on the server.

[0919] As described above, the system of the present invention provides a series of functions that allow users to easily enjoy conversations with celebrity avatars, realizing a fulfilling experience while reducing financial and psychological burdens.

[0920] The processing flow will be explained below.

[0921] Step 1:

[0922] A user accesses the web platform and clicks the "Sign Up" button.

[0923] Step 2:

[0924] The device will display a user registration screen and prompt you to enter your name, email address, password, etc.

[0925] Step 3:

[0926] The user enters the required information and clicks the "Submit" button.

[0927] Step 4:

[0928] The terminal transmits the input information to the server.

[0929] Step 5:

[0930] The server receives the input information, validates it, and if validation passes, stores the information in a database.

[0931] Step 6:

[0932] The server generates a registration success message and sends it to the user's terminal.

[0933] Step 7:

[0934] The device will display a registration complete message.

[0935] Step 8:

[0936] The user enters their email address and password on the login screen and clicks the "Login" button.

[0937] Step 9:

[0938] The terminal sends the entered login information to the server.

[0939] Step 10:

[0940] The server validates the login information and generates an authentication token.

[0941] Step 11:

[0942] The server sends the authentication token to the user's device.

[0943] Step 12:

[0944] The device receives the authentication token and displays the main dashboard screen.

[0945] Step 13:

[0946] The user clicks the "Avatar List" button to display a list of celebrity avatars.

[0947] Step 14:

[0948] The device sends an avatar list display request to the server.

[0949] Step 15:

[0950] The server retrieves all avatar information from the database and sends it to the user's device.

[0951] Step 16:

[0952] The device will display a list of avatars.

[0953] Step 17:

[0954] A user enters the name of a particular celebrity in the search bar and clicks the "Search" button.

[0955] Step 18:

[0956] The device sends a search query to the server.

[0957] Step 19:

[0958] The server searches the database based on the search query and retrieves the corresponding avatar information.

[0959] Step 20:

[0960] The server transmits the acquired avatar information to the user's terminal.

[0961] Step 21:

[0962] Your device will display the search results.

[0963] Step 22:

[0964] The user selects a specific avatar and clicks the "Start Talking" button.

[0965] Step 23:

[0966] The terminal sends a conversation start request to the server along with information about the selected avatar.

[0967] Step 24:

[0968] The server creates a conversation session and sends an initial response to the user's terminal.

[0969] Step 25:

[0970] The terminal displays an initial response and waits for user input.

[0971] Step 26:

[0972] The user enters a question or message in the chat box and sends it.

[0973] Step 27:

[0974] The terminal sends the user's message to the server.

[0975] Step 28:

[0976] The server uses a natural language processing engine to analyze the user's message and generate an appropriate response.

[0977] Step 29:

[0978] The server generates a response and sends it to the user's terminal.

[0979] Step 30:

[0980] The terminal displays the response message and waits for further user input.

[0981] Step 31:

[0982] When the conversation is about to end, the device will display extension options and prices.

[0983] Step 32:

[0984] The user selects the extension time and clicks the "Purchase Extension" button.

[0985] Step 33:

[0986] The terminal sends the extension request and payment information to the server.

[0987] Step 34:

[0988] The server calculates the fee and requests the payment processing system to process it.

[0989] Step 35:

[0990] The server sends a success message to the user's terminal.

[0991] Step 36:

[0992] The terminal displays a message indicating that the extension is complete, and the conversation time is extended.

[0993] Step 37:

[0994] After the conversation ends, the device displays a feedback input form.

[0995] Step 38:

[0996] The user enters a rating and comment for the service and clicks the "Submit" button.

[0997] Step 39:

[0998] The terminal sends feedback information to the server.

[0999] Step 40:

[1000] The server stores the feedback information in a database.

[1001] The above are the specific processing steps in the system of the present invention.

[1002] Example 1

[1003] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1004] Previous web platforms had the problem of making it difficult for users to enjoy real-time conversations with celebrities. The process from starting to ending a conversation was often cumbersome, which compromised the user experience. Furthermore, features like feedback collection and conversation extensions were lacking, making it impossible to fully meet user needs.

[1005] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1006] In this invention, the server includes means for receiving authentication information of a user account and generating and transmitting an authentication token, means for searching and selecting avatar information, means for analyzing a user's input using a natural language processing engine and generating and transmitting an appropriate response, means for generating a conversation session and transmitting an initial response to the user's terminal, means for managing conversation time, providing an extension option, calculating fees, and requesting processing from a payment processing system, and means for displaying a feedback input form after the conversation ends and storing the feedback information in a database. This allows users to easily enjoy conversations with celebrity avatars, improving the real-time conversation experience.

[1007] "User" means an individual or entity that uses the web platform, creates an account, logs in and interacts with an avatar.

[1008] The "web platform" refers to a software system accessible over the Internet that allows users to create interactive experiences.

[1009] A "User Account" is an individual identification on the Platform created based on information such as a User's unique name, email address, and password.

[1010] An "authentication token" is a security token that is generated by the server after the user enters correct authentication information and sent to the user's terminal.

[1011] An "avatar" is a simulated person or character with which a user interacts on a web platform.

[1012] A "natural language processing engine" is a software engine that analyzes natural language input from a user and generates an appropriate response.

[1013] A "conversation session" is a unit for managing a series of conversation processes generated by the server in order for a user to have a conversation with an avatar.

[1014] An "initial response" is the first message that the server sends to the user's terminal at the start of a conversation session.

[1015] The "extension option" is information about additional time and price that can be selected if the user wishes to extend the interaction time.

[1016] "Payment Processing System" means an external or internal payment platform for processing fees when a user selects the extension option.

[1017] The "feedback input form" is a form in which the user can input their evaluation or comments on the service after the conversation has ended.

[1018] A "database" is a structured data storage system for storing user information, avatar information, feedback, etc.

[1019] The present invention relates to a web platform that allows users to casually engage in conversations with celebrity avatars. The main elements of the platform are user account registration and authentication, avatar selection, conversation initiation and progression, conversation extension options, and feedback collection.

[1020] Registration Process

[1021] The user accesses the web platform and enters the required information, such as name, email address, and password. The device sends this information to the server as an HTTP POST request. The server verifies the validity of the entered information and stores it in a database (e.g., MySQL). Once registration is complete, the server sends a message to the device saying "Registration completed," which the device displays to the user.

[1022] Login Process

[1023] The user enters their email address and password on the login screen, and the device sends this to the server. The server retrieves user information from the database based on the received information, and if it matches, generates a JWT (JSON Web Token) and sends it to the device. The device uses this token to display the main dashboard screen.

[1024] Avatar Selection

[1025] Users can click the "Avatar List" button on the main dashboard or enter the name of a specific celebrity in the search bar. The device then sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device, which then displays it to the user.

[1026] Initiating and conducting a conversation

[1027] When a user selects a specific avatar and clicks the "Start Conversation" button, the device sends the selection information to the server. The server creates a new conversation session and generates an initial message based on a natural language processing engine (such as GPT-4). This initial message is sent to the device, which displays it to the user. When the user enters a question or message and the device sends it, the server passes it to the natural language processing engine for analysis and generates an appropriate response. The generated response is sent to the device and displayed to the user.

[1028] Extending the conversation

[1029] As the conversation approaches its end time, the server sends an extension option to the terminal. The terminal displays an extension suggestion and fee information to the user. If the user wishes to extend the conversation and enters payment information, the terminal sends this to the server. The server processes the payment using a payment system such as Stripe, and if successful, sends a message to the terminal indicating that the extension has been completed. The terminal notifies the user, and the conversation is extended.

[1030] Enter your feedback

[1031] After the conversation ends, the user enters their rating and comments in the feedback input form. The device sends this information to the server, which stores it in a database. This feedback information is used to improve the service.

[1032] Specific examples

[1033] For example, if a user wants to have a conversation with an avatar of a famous actor, the user accesses the web platform, creates an account, and logs in. Then, the user enters the actor's name in the search bar and selects the actor's avatar. After the conversation begins, the user types, "Tell me about new movies." The server analyzes this message and generates a response, "Recently, new movies...," and sends it to the device.

[1034] Prompt Sentence Examples

[1035] Generate a response when a user asks, "Hello, famous actor. What movies have you been in recently?"

[1036] This system aims to improve the user experience by providing a function that allows users to easily enjoy real-time conversations with celebrity avatars. By using this platform, users can achieve a fulfilling conversational experience with minimal out-of-pocket costs.

[1037] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1038] Step 1:

[1039] A user accesses the web platform and enters their name, email address, and password on the account creation page. The device collects this input information and sends it to the server as an HTTP POST request. The server validates the received information, ensuring that it is a correctly formatted email address and that the password meets the required security standards, for example by using a validation library (e.g., Joi). The server then stores the information in a database (e.g., MySQL), and generates a success message and sends it to the device. The device displays the success message to the user. The input data are the name, email address, and password, and the output is the success message.

[1040] Step 2:

[1041] The user enters their email address and password on the login screen and clicks the login button. The device sends the entered login information to the server. The server receives this information, searches for the corresponding user information in the database, and confirms that it matches. If authentication is successful, the server generates a JWT (JSON Web Token) and sends it to the device. The device receives this token and displays the main dashboard screen to the user. The input data is the email address and password, and the output is the authentication token and the main dashboard screen.

[1042] Step 3:

[1043] The user clicks the "Avatar List" button on the main dashboard or enters the name of a specific celebrity in the search bar. The device sends the user's request to the server as an HTTP GET request. The server retrieves the corresponding avatar information from the database and sends it in JSON format to the device. The device analyzes the retrieved avatar information and displays a list of images and names. The input data is an avatar selection request, and the output is a list of avatar information.

[1044] Step 4:

[1045] The user selects a specific avatar and clicks the "Start Conversation" button. The device sends the selection information to the server. The server creates a new conversation session and generates an initial message using a natural language processing engine (e.g., a generative AI model). The server sends this initial message to the device, which displays it to the user. The input data is the avatar selection information, and the output is the initial message.

[1046] Step 5:

[1047] The user enters a message in the chat box and clicks the send button. The terminal sends this input to the server. The server passes the received input to a natural language processing engine for analysis and generates an appropriate response. The generated response is sent by the server to the terminal. The terminal displays the response to the user. The input data is the user's message and the output is the generated response.

[1048] Step 6:

[1049] As the conversation approaches its end time, the server sends an extension option to the terminal. The terminal displays the extension option and fee information to the user. When the user selects the extension time and price and enters payment information, the terminal sends this information to the server. The server calculates the fee and processes the payment using a payment processing system (e.g., an external payment platform). If the payment is successful, the server generates an extension completion message and sends it to the terminal. The terminal notifies the user of this. The input data is the extension request and payment information, and the output is the extension completion message.

[1050] Step 7:

[1051] After the conversation ends, the user enters their rating and comments in the feedback input form. The device sends the feedback information to the server, which stores it in a database and uses it to improve the service. The input data is the feedback information, and the output is a feedback save confirmation message.

[1052] Through the above series of steps, users can enjoy real-time conversations with celebrity avatars, providing a highly satisfying interactive experience.

[1053] (Application example 1)

[1054] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1055] In interactive virtual stores, when users interact with celebrity avatars in real time to learn about products and make purchases, conventional systems lack the quality and realism of responses. This limits the user experience and reduces shopping satisfaction. It also makes it difficult to extend conversations, process payments, and efficiently collect feedback.

[1056] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1057] In this invention, the server includes: means for a user to access the web platform and create a user account by inputting necessary information; means for receiving authentication information for the user account and generating and transmitting an authentication token; means for searching and selecting celebrity avatar information; means for receiving the user's input, analyzing it using a natural language processing engine, and generating and transmitting an appropriate response; means for managing the conversation time, offering an extension option, calculating fees, and requesting processing from a payment processing system; means for displaying a feedback input form after the conversation ends and saving the feedback information in a database; and means for requesting product explanations and purchasing advice from the celebrity avatar in the virtual store and receiving a response. This allows the user to receive detailed product explanations and purchasing advice from the celebrity avatar in real time in the virtual store, thereby improving shopping satisfaction.

[1058] A "web platform" is an online system that users can access via the Internet and use various services and functions.

[1059] "User Account" means a collection of information that identifies an individual user on the Web Platform and grants access rights to use the Services.

[1060] An "authentication token" is a temporary identifier generated to verify a user's identity and authorize them to operate within a system.

[1061] A "celebrity avatar" is a digital representation of a real-life celebrity that can interact with users.

[1062] A "natural language processing engine" is a technology or software that enables a computer to understand, analyze, and generate responses to human language.

[1063] "Conversation time management" is a function for monitoring the duration of a conversation between a user and a celebrity avatar and extending it as necessary.

[1064] The "extension option" is a choice to extend the set time if the user wishes to continue the conversation.

[1065] "Charge calculation" is the process of calculating the charges incurred for the use of a service.

[1066] A "payment processing system" is a system for accepting and processing payments from users.

[1067] The "feedback input form" is a screen element that allows users to input ratings and comments on the service.

[1068] A "virtual store" is a virtual shopping environment where products can be displayed, explained, and purchased online.

[1069] "Product description" is information that explains the product's features, usage, price, etc. to the user.

[1070] "Purchase advice" refers to providing information and advice that is useful to users when purchasing products.

[1071] The present invention relates to a system that allows users to receive product explanations and purchasing advice from celebrity avatars in a virtual store. The system of the present invention provides a series of processes for users to access a web platform, create a user account, log in, select a celebrity avatar, start a conversation, select extension options and payment processing, and finally provide feedback.

[1072] First, when a user accesses the web platform, a registration screen for creating a user account is displayed. The user enters information such as name, email address, and password and clicks the submit button. The server receives this input information, verifies its validity, and saves it in a database.

[1073] Next, the user enters their email address and password on the login screen and clicks the login button. The server receives this information, generates an authentication token, and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[1074] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, and then search for avatars by entering the name of a specific celebrity in the search bar. The server retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the retrieved avatar list and search results on the screen.

[1075] When a user selects a specific avatar and clicks the "Start Conversation" button, the server creates a conversation session and starts the conversation by sending an initial response to the user's device, such as "Nice to meet you! Is there anything you'd like to ask me?"

[1076] Users can enter questions or messages into the chat box and send them to advance the conversation. The device sends the user's input to the server, which then analyzes the input using a natural language processing engine (e.g., GPT-3), generates an appropriate response, and sends it to the device. The device then displays the generated response to the user and waits for the next input.

[1077] As the conversation progresses and the end time approaches, an extension option will appear on the terminal. If the user wishes to extend the conversation, they will select the extension time and price and enter payment information. The server receives the extension request and payment information, calculates the fee, and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal, and the conversation time is extended.

[1078] After the conversation ends, a feedback input form will appear on the device, and the user can enter their rating and comments about the service and click the submit button. The server will receive the feedback information and store it in a database. This will allow the server to accumulate data that will be useful for future service improvements.

[1079] As a concrete example, consider a case where a user wants to talk to an avatar of a famous actor. The user accesses a web platform, creates an account, and logs in. Next, the user enters the actor's name in the search bar and selects the corresponding avatar. After starting the conversation, the user types, "Tell me about new movies." The server analyzes this message and generates and sends the response, "Actor Avatar: The latest new movies are...." Just before the conversation ends, an extension option is displayed, and if the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is saved on the server.

[1080] Example prompt sentence:

[1081] 1. Go to the web platform and click on the "Create an Account" button.

[1082] 2. Enter the required information (name, email address, password) and click the Send button.

[1083] 3. Once you have completed the registration, click the "Login" button and enter your email address and password to log in.

[1084] 4. From the main dashboard, click the "Avatar List" button to view the list of avatars.

[1085] 5. Select your actor's avatar and click the "Start Talking" button.

[1086] 6. Type "Tell me about new movies" in the message box and send.

[1087] 7. You will see a response such as "Actor Avatar: In the latest new movie..."

[1088] This system allows users to receive detailed product descriptions and purchasing advice in real time from celebrity avatars within a virtual store, improving their shopping satisfaction.

[1089] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1090] Step 1:

[1091] A user accesses the web platform, enters the required information on the account creation screen, and submits it. The user enters a username, email address, and password. The submitted data is sent to the server. The server verifies the validity of the received data, and if the verification is successful, stores it in a database. It then sends a message to the user's device indicating that account creation has been completed.

[1092] Input: Username, Email Address, Password

[1093] Output: Account creation complete message

[1094] Step 2:

[1095] The user enters their email address and password on the login screen and submits it. The user's authentication information is sent to the server. The server compares it with information in the database, and if authentication is successful, generates an authentication token and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[1096] Input: User's email address, password

[1097] Output: Auth token, main dashboard

[1098] Step 3:

[1099] The user clicks the "Avatar List" button on the main dashboard to display a list of avatars. The server retrieves avatar information from the database and sends it to the device. The user checks the displayed avatar information.

[1100] Input: User avatar list request

[1101] Output: List of displayed avatars

[1102] Step 4:

[1103] A user enters the avatar of a particular celebrity into the search bar and clicks the search execution button. The device sends the input information to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The corresponding avatar information is then displayed on the device.

[1104] Input: User search input (famous person's name)

[1105] Output: Avatar information for the displayed search results

[1106] Step 5:

[1107] The user selects a specific avatar and clicks the "Start Conversation" button. The device sends a session initiation request to the server, which creates a conversation session. An initial response is generated and sent to the user's device. The device displays "Nice to meet you! Is there anything you'd like to ask me?"

[1108] Input: User's avatar selection information

[1109] Output: Initial response message

[1110] Step 6:

[1111] The user enters a question or message into the chat box and sends it. The device sends the user's input to the server, which then analyzes the message using a natural language processing engine (e.g., GPT-3). An appropriate response is generated and sent to the device. The generated response message is displayed on the device. Responses such as "Actor Avatar: In recent new movies..." are provided.

[1112] Input: User's message

[1113] Output: The generated response message

[1114] Step 7:

[1115] As the conversation nears the end, an extension option appears on the terminal. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends this information to the server, which calculates the fee and requests processing from the payment processing system. If successful, an extension completion message is sent to the terminal and the conversation time is extended.

[1116] Input: Extended time, payment information

[1117] Output: Extension complete message

[1118] Step 8:

[1119] After the conversation ends, a feedback input form is displayed on the device. The user enters their rating and comments and submits them. The device then sends the feedback information to the server, which stores it in a database. User feedback is accumulated as data that will help improve the service.

[1120] Input: User feedback

[1121] Output: Feedback save completion notification

[1122] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1123] The present invention relates to a web platform that allows users to casually enjoy conversations with celebrity avatars, and in particular incorporates an emotion engine that recognizes the user's emotions and generates responses accordingly. The system of the present invention provides a process for users to access the web platform, create a user account, log in, select a celebrity avatar, start a conversation, manage time, and provide feedback.

[1124] When a user accesses the web platform, they are first shown a registration screen to create a user account. The user enters information such as their name, email address, and password, and clicks the submit button. The device sends this information to the server, which receives it, verifies its validity, and stores it in a database. Once registration is complete, the server sends a success message to the user, which is displayed on the device.

[1125] Next, the user enters their email address and password on the login screen and clicks the login button. The device sends this information to the server, which verifies the validity of the information, generates an authentication token, and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[1126] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, or search for an avatar by entering the name of a specific celebrity in the search bar. The device sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the retrieved avatar list and search results on the screen.

[1127] When a user selects a specific avatar and clicks the "Start Conversation" button, the terminal sends this selection information to the server, which then creates a conversation session and sends an initial response to the user's terminal, thereby starting the conversation.

[1128] Users advance the conversation by entering questions or messages into the chat box and sending them. The device sends the user's input to the server, which analyzes the input using a natural language processing engine and an emotion engine. The natural language processing engine analyzes the content of the entered text and generates an appropriate response. The emotion engine analyzes the emotion contained in the user's message and adjusts the response generated by the natural language processing engine based on the results. For example, if the user is expressing negative emotion, the server will recognize this and generate a more comforting or encouraging response. The generated response is sent from the server to the user's device and displayed.

[1129] As the conversation progresses and the end time approaches, an extension option is displayed. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends the extension request and payment information to the server, which calculates the fee and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal, and the conversation time is extended.

[1130] After the conversation ends, a feedback input form is displayed, and the user enters their rating and comments about the service and clicks the send button. The device then sends the feedback information to the server, which stores it in a database. This feedback information also includes the user's emotional data analyzed by the emotion engine and is used to improve the service.

[1131] As a concrete example, consider a case where a user wants to talk to an avatar of a famous actor. The user accesses a web platform, creates an account, and logs in. Next, they enter the actor's name in the search bar and select the corresponding avatar. After starting a conversation, the user types, "I'm feeling stressed at work these days." The server analyzes this message, and the emotion engine recognizes that the user is expressing negative emotions. Based on this, the natural language processing engine adjusts the response, generating and sending a comforting message such as, "That's tough to be stressed out. Maybe it would help to find a way to decompress." Just before the conversation ends, an extension option is displayed, and if the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is stored on the server.

[1132] As described above, the system of the present invention provides a function that allows users to easily enjoy conversations with celebrity avatars, and furthermore, by using an emotion engine to generate responses that correspond to the user's emotions, it provides a more satisfying experience for the user.

[1133] The processing flow will be explained below.

[1134] Step 1:

[1135] A user accesses the web platform and clicks the "Sign Up" button.

[1136] Step 2:

[1137] The device will display a user registration screen and prompt you to enter your name, email address, password, etc.

[1138] Step 3:

[1139] The user enters the required information and clicks the "Submit" button.

[1140] Step 4:

[1141] The terminal transmits the input information to the server.

[1142] Step 5:

[1143] The server receives the input information, validates it, and if validation passes, stores the information in a database.

[1144] Step 6:

[1145] The server generates a registration success message and sends it to the user's terminal.

[1146] Step 7:

[1147] The device will display a registration complete message.

[1148] Step 8:

[1149] The user enters their email address and password on the login screen and clicks the "Login" button.

[1150] Step 9:

[1151] The terminal sends the entered login information to the server.

[1152] Step 10:

[1153] The server validates the login information and generates an authentication token.

[1154] Step 11:

[1155] The server sends the authentication token to the user's device.

[1156] Step 12:

[1157] The device receives the authentication token and displays the main dashboard screen.

[1158] Step 13:

[1159] The user clicks the "Avatar List" button to display a list of celebrity avatars.

[1160] Step 14:

[1161] The device sends an avatar list display request to the server.

[1162] Step 15:

[1163] The server retrieves all avatar information from the database and sends it to the user's device.

[1164] Step 16:

[1165] The device will display a list of avatars.

[1166] Step 17:

[1167] A user enters the name of a particular celebrity in the search bar and clicks the "Search" button.

[1168] Step 18:

[1169] The device sends a search query to the server.

[1170] Step 19:

[1171] The server searches the database based on the search query and retrieves the corresponding avatar information.

[1172] Step 20:

[1173] The server transmits the acquired avatar information to the user's terminal.

[1174] Step 21:

[1175] Your device will display the search results.

[1176] Step 22:

[1177] The user selects a specific avatar and clicks the "Start Talking" button.

[1178] Step 23:

[1179] The terminal sends a conversation start request to the server along with information about the selected avatar.

[1180] Step 24:

[1181] The server creates a conversation session and sends an initial response to the user's terminal.

[1182] Step 25:

[1183] The terminal displays an initial response and waits for user input.

[1184] Step 26:

[1185] The user enters a question or message in the chat box and sends it.

[1186] Step 27:

[1187] The terminal sends the user's message to the server.

[1188] Step 28:

[1189] The server analyzes the user's message using a natural language processing engine and an emotion engine.

[1190] Step 29:

[1191] The server generates an appropriate response based on the analysis results, particularly adjusting the response according to the user's emotions.

[1192] Step 30:

[1193] The server generates a response and sends it to the user's terminal.

[1194] Step 31:

[1195] The terminal displays the response message and waits for further user input.

[1196] Step 32:

[1197] When the conversation is about to end, the device will display extension options and prices.

[1198] Step 33:

[1199] The user selects the extension time and clicks the "Purchase Extension" button.

[1200] Step 34:

[1201] The terminal sends the extension request and payment information to the server.

[1202] Step 35:

[1203] The server calculates the fee and requests the payment processing system to process it.

[1204] Step 36:

[1205] The server sends a success message to the user's terminal.

[1206] Step 37:

[1207] The terminal displays a message indicating that the extension is complete, and the conversation time is extended.

[1208] Step 38:

[1209] After the conversation ends, the device displays a feedback input form.

[1210] Step 39:

[1211] The user enters a rating and comment for the service and clicks the "Submit" button.

[1212] Step 40:

[1213] The terminal sends feedback information to the server.

[1214] Step 41:

[1215] The server stores the feedback information and the analysis results of the emotion engine in a database.

[1216] The above are the specific processing steps in the system of the present invention.

[1217] Example 2

[1218] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1219] Conventional web platforms have limitations in allowing users to enjoy natural conversations with celebrity avatars, making it difficult to fully understand the user's emotions and generate appropriate responses. Furthermore, the complicated procedures for extending conversation sessions and processing payments hinder users' smooth use of the service. Furthermore, there is a lack of a way to effectively utilize the feedback collected after the conversation ends. Therefore, a new system is needed that improves the quality of the user experience while providing smooth operation and appropriate responses based on emotions.

[1220] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1221] In this invention, the server includes: a means for a user to access the web platform and create a user account by entering necessary information; a means for receiving authentication information for the user account and generating and transmitting an authentication token; a means for searching and selecting celebrity avatar information; a means for receiving the user's input, analyzing it using a natural language processing engine and an emotion engine, generating and transmitting an appropriate response; a means for managing the conversation time, offering an extension option, calculating fees, and requesting processing from a payment processing system; and a means for displaying a feedback input form after the conversation ends and storing the feedback information and emotion data in a database. This enables a smooth extension of the conversation session and payment processing while understanding the user's emotions and providing appropriate responses accordingly. Furthermore, the collected feedback and emotion data can be effectively utilized.

[1222] "User" refers to any person who accesses the web platform and uses the services provided therein.

[1223] "Web platform" refers to the system that enables access to information and services provided on the Internet and the performance of various activities.

[1224] "User account" refers to a set of information that individually identifies a user and manages access rights and service usage.

[1225] An "authentication token" refers to unique data generated based on a user's authentication information and used to manage the user's session.

[1226] An "avatar" is a virtual person or character that runs on a computer and that a user can select and interact with.

[1227] A "natural language processing engine" is a software module for understanding and interpreting natural language, and is used to analyze user input and generate appropriate responses.

[1228] An "emotion engine" is a software module that recognizes and analyzes emotions contained in user input, and works in conjunction with a natural language processing engine to generate responses.

[1229] A "conversation session" refers to a session in which a series of conversations take place between a user and an avatar, and the time from start to finish is managed.

[1230] The "extension option" is a service provided near the end of a conversation session, allowing the user to extend the conversation time by paying an additional fee.

[1231] "Payment processing system" refers to a system for receiving payment information from users and completing payments securely.

[1232] The "feedback input form" is an interface that allows users to input their evaluations and comments about the service.

[1233] A "database" refers to a digital storage system for efficiently storing, retrieving, updating, and deleting information.

[1234] "Feedback Information" refers to data on ratings and comments provided by users through the feedback input form.

[1235] "Emotion data" refers to emotional information analyzed by the emotion engine from user input.

[1236] The present invention relates to a web platform that allows users to casually enjoy conversations with celebrity avatars, and in particular incorporates an emotion engine that recognizes the user's emotions and generates responses accordingly. The system of the present invention provides a single process for users to access the web platform, create a user account, log in, select a celebrity avatar, start a conversation, manage the conversation time, select extension options, make a payment, collect feedback, and save the information in a database.

[1237] Hardware used

[1238] Server: A high-performance computer (e.g., a virtual server on a cloud platform)

[1239] Terminal: User's personal computer (PC), smartphone, or other device

[1240] Software used

[1241] Web framework: Django

[1242] Database: PostgreSQL

[1243] Natural Language Processing Engine: GPT Model

[1244] Sentiment Engine: Sentiment Analysis API

[1245] Payment Processing System: Payment API

[1246] Processing flow

[1247] First, a user accesses the web platform and creates a user account by entering information such as name, email address, and password. The device sends this information to the server, which then validates it using the Django framework and stores it in the PostgreSQL database. Once registration is complete, the server generates a success message and sends it to the user's device.

[1248] Next, the user enters their email address and password on the login screen and clicks the login button. The device sends this information to the server, which verifies its validity and then generates an authentication token, which is sent to the user's device. The device receives the token and displays the main dashboard screen.

[1249] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, or search for an avatar by entering the name of a celebrity in the search bar. The device sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the avatar list or search results on the screen.

[1250] When a user selects a specific avatar and clicks the "Start Conversation" button, the device sends this selection information to the server. The server creates a new conversation session and sends an initial response to the user's device. The user advances the conversation by entering questions or messages in the chat box and sending them. The device sends the user's input to the server, which analyzes it using a natural language processing engine and an emotion engine. The natural language processing engine analyzes the entered text and generates an appropriate response. The emotion engine analyzes the emotion contained in the user's message and adjusts the response generated by the natural language processing engine based on the results. For example, if the user is expressing negative emotions, the server recognizes this and generates a more comforting or encouraging response. The generated response is sent from the server to the user's device and displayed.

[1251] When the conversation is in progress and the end time is approaching, an extension option is displayed. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends the extension request and payment information to the server, which calculates the fee and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal and the conversation time is extended.

[1252] After the conversation ends, a feedback input form is displayed, and the user enters their rating or comment on the service and clicks the send button. The device then sends the feedback information to the server, which stores it in a database. This feedback information also includes the user's emotional data analyzed by the emotion engine and is used to improve the service.

[1253] Specific examples

[1254] For example, consider a case where a user wants to talk to an avatar of a famous celebrity. The user accesses the web platform, creates an account, and logs in. Next, they enter the celebrity's name in the search bar and select the corresponding avatar. After starting a conversation, the user types, "I'm feeling stressed at work these days." The server analyzes this message, and the emotion engine recognizes that the user is expressing negative emotions. Based on this, the natural language processing engine adjusts the response, generating and sending a comforting message such as, "That's tough to be stressed out. Maybe it would help to find a way to relax." Before the conversation ends, an option to extend the conversation is displayed. If the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is stored on the server.

[1255] Prompt Sentence Examples

[1256] "Just visit our web platform and start chatting with the avatars of famous celebrities. Just enter their name in the search bar, select their avatar and enjoy the conversation."

[1257] "Speak to a celebrity avatar to discuss work stress. The emotion engine identifies your emotions and provides appropriate responses."

[1258] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1259] Step 1: Divide the processing flow of this system's program into processing steps

[1260] Step 1: Create a user account

[1261] Step 2: User Login and Authentication

[1262] Step 3: Avatar selection and search

[1263] Step 4: Initiating and conducting a conversation session

[1264] Step 5: Extend the conversation and settle

[1265] Step 6: Gather feedback

[1266] Step 2: Explain each processing step in detail

[1267] Step 1: Create a user account

[1268] Input: The user enters their name, email address, and password.

[1269] Operation: The terminal sends the entered user information to the server, which validates the information and stores it in a database.

[1270] Output: The server sends a registration success message to the terminal, which displays it to the user.

[1271] Step 2: User Login and Authentication

[1272] Input: The user enters their email address and password on the login screen.

[1273] How it works: The device sends the entered login information to the server, which generates an authentication token and sends it to the device.

[1274] Output: The device receives the authentication token and displays the main dashboard.

[1275] Step 3: Avatar selection and search

[1276] Input: Users click the "Avatar List" button on the main dashboard or type the name of a specific celebrity into the search bar.

[1277] How it works: The device sends a user request to the server, which retrieves the relevant avatar information from the database and sends it to the device.

[1278] Output: The device displays the list of avatars and search results to the user.

[1279] Step 4: Initiating and conducting a conversation session

[1280] Input: The user selects a specific avatar and clicks the "Start Talking" button.

[1281] Operation: The device sends the selection information to the server. The server creates a conversation session and sends an initial response to the device. The user enters a question or message in the chat box and sends it. The device sends the message to the server, which analyzes it using its natural language processing engine and emotion engine and generates a response.

[1282] Output: The server generates a response and sends it to the terminal, which displays it to the user.

[1283] Step 5: Extend the conversation and settle

[1284] Input: The user selects the extension option that appears when the conversation is about to end. Enters payment information.

[1285] Operation: The terminal sends an extension request and payment information to the server, which calculates the fee and processes it in the payment processing system.

[1286] Output: The server sends an extension completion message to the terminal, which displays it and extends the conversation time.

[1287] Step 6: Gather feedback

[1288] Input: After the conversation ends, the user enters their rating or comment in the feedback input form and submits it.

[1289] Operation: The device sends feedback information to the server, which stores the feedback information and emotion data in a database.

[1290] Output: The server sends a save complete message to the terminal, which displays it to the user.

[1291] (Application example 2)

[1292] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1293] Conventional web platforms lack the ability to properly recognize a user's emotions and generate appropriate responses when users converse with celebrity avatars. Furthermore, there is a lack of a way for users to enjoy natural conversations with celebrity avatars while moving around in the real world. Therefore, there is a need to provide an interactive conversation experience that increases user satisfaction and can be used in the real world.

[1294] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for a user to access a web platform and create a user account by entering required information; means for receiving authentication information for the user account and generating and transmitting an authentication token; means for searching and selecting celebrity avatar information; means for receiving the user's input, analyzing it using a natural language processing engine, and generating and transmitting an appropriate response; means for managing the conversation time, offering extension options, calculating fees, and requesting processing from a payment processing system; means for displaying a feedback input form after the conversation ends and saving the feedback information in a database; means for tracking the user's gaze using an application installed in the smart glasses and realizing natural conversation using voice recognition technology; and means for analyzing the user's voice input using an emotion engine and generating and transmitting a response according to the user's emotion. This allows the user to enjoy interactive conversations with celebrity avatars even while moving around in the real world, thereby increasing user satisfaction.

[1295] "User Account" means an account for personal identification created by a User to access the Web Platform.

[1296] An "authentication token" is a digital token that is generated based on a user's authentication information and is used to grant access authorization.

[1297] "Celebrity avatar information" is digital data that represents a specific celebrity as a virtual character.

[1298] A "natural language processing engine" is a technology that analyzes natural language text entered by a user and generates an appropriate response.

[1299] An "emotion engine" is a technology that analyzes the emotions contained in user input and adjusts responses according to those emotions.

[1300] "Management of conversation time" is a function for measuring the conversation time between the user and the avatar and managing whether to extend the conversation as necessary.

[1301] An "extension option" is a choice that provides additional time if the user wishes to continue the conversation.

[1302] A "payment processing system" is a system that calculates service fees and processes payments from users.

[1303] The "feedback input form" is a screen where users can input and provide their evaluations and comments on the service.

[1304] "Smart glasses" are devices that users can wear to utilize functions such as eye tracking and voice recognition.

[1305] "Eye tracking" is a technology that detects the movement of a user's eyes and performs operations accordingly.

[1306] "Speech recognition technology" is a technology that converts a user's voice into text and analyzes its meaning.

[1307] This invention is a system that allows users to casually enjoy conversations with celebrity avatars. In particular, it incorporates an emotion engine and a natural language processing engine to recognize the user's emotions and generate responses accordingly, and can be used while moving around in the real world using smart glasses.

[1308] The system is structured as follows: First, a user accesses the web platform and enters the necessary information to create a user account. This data is sent to the server, where the validity of the registration information is confirmed and then stored in the database. Once the account is created, the server generates and sends an authentication token to the user.

[1309] Next, the user wears the smart glasses, logs in, and uses an authentication token to access the main dashboard. The user can search for and select a celebrity avatar. The selected avatar is sent to the server, which then creates a conversation session and sends an initial response to the user's device.

[1310] When a user starts a conversation, the device (smart glasses) receives the user's voice input and converts it into text using speech recognition technology. The server then analyzes the received text using a natural language processing engine and generates an appropriate response. At the same time, the emotion engine analyzes the user's emotions and adjusts the response. The generated response is sent from the server to the user's device (smart glasses) and displayed to the user.

[1311] For example, if a user says, "I've been feeling stressed at work lately," the smart glasses convert this speech into text and send it to the server. The server uses an emotion engine to recognize negative emotions and generate a response based on that. The response generated is, "It's tough being stressed. Maybe it would be good to find a way to decompress," and is displayed to the user.

[1312] When the conversation time is about to end, the server presents the user with an option to extend the conversation. If the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. This fee calculation and settlement process are also performed by the server and handled by the settlement system.

[1313] After the conversation is over, the server presents the user with a feedback form, where the user can enter and submit their rating and comments about the service. This feedback information is stored in a database and used to improve the service.

[1314] The main hardware used is smart glasses, voice recognition software (e.g., Google Cloud Speech-to-Text), and emotion recognition engines (e.g., Affectiva), which allow users to enjoy interactive conversations with celebrity avatars while moving around in the real world.

[1315] An example of a prompt to input to a generative AI model is as follows:

[1316] "In response to a user's message, 'I've been feeling stressed at work lately,' use an emotion recognition engine to detect negative emotions and generate a comforting or encouraging message."

[1317] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1318] Step 1:

[1319] A user accesses the web platform and enters the required information to create a user account. The user enters their name, email address, and password, and clicks the submit button. The entered information is sent from the device to the server. The server verifies its validity, stores it in the database, and sends a registration success message to the user's device.

[1320] Step 2:

[1321] The user enters their email address and password on the login screen and clicks the login button. The entered information is sent from the device to the server. The server verifies the authentication information and, if correct, generates an authentication token and sends it to the user's device. The device stores the received authentication token and displays the main dashboard.

[1322] Step 3:

[1323] The user clicks the "Avatar List" button on the main dashboard and selects from the displayed avatars. The selected avatar information is sent from the device to the server, and the server creates a conversation session and sends an initial response to the user's device, which displays this response.

[1324] Step 4:

[1325] A user wears smart glasses and speaks to an avatar. The smart glasses convert the voice input into text. The text data is sent from the device to a server. The server uses a natural language processing engine to analyze the text and generate an appropriate response. At the same time, an emotion engine analyzes the user's emotions and adjusts the response. The generated response is sent from the server to the user's device, which then displays it to the user.

[1326] Step 5:

[1327] When the conversation time is nearing the end, the terminal presents the user with an option to extend the conversation. If the user wishes to extend the conversation, the terminal inputs the extension time and payment information. The input information is sent from the terminal to the server, which calculates the fee and requests processing from the payment processing system. Once the payment is completed, the server sends an extension completion message to the terminal, and the conversation time is extended.

[1328] Step 6:

[1329] After the conversation ends, the device displays a feedback input form. The user enters their rating or comment on the service and clicks the send button. The feedback information is sent from the device to the server, which stores it in a database. The user's emotional data, analyzed by the emotion engine, is also included in the feedback information and used to improve the service.

[1330] In this way, users can enjoy natural conversations with celebrity avatars while moving around in the real world using smart glasses. In addition, the emotion engine and natural language processing engine generate responses based on the user's emotions, increasing user satisfaction.

[1331] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1332] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1333] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1334] [Fourth embodiment]

[1335] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1336] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1337] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1338] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1339] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1340] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1341] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1342] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1343] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1344] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1345] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1346] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1347] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1348] The present invention relates to a web platform that allows users to casually enjoy conversations with celebrity avatars. The system of the present invention provides a process for users to access the web platform, create a user account, log in, select a celebrity avatar, start a conversation, manage time, and provide feedback.

[1349] When a user accesses the web platform, they are first shown a registration screen to create a user account. The user enters information such as their name, email address, and password, and clicks the submit button. The device sends this information to the server, which receives it, verifies its validity, and stores it in a database. Once registration is complete, the server sends a success message to the user, which is displayed on the device.

[1350] Next, the user enters their email address and password on the login screen and clicks the login button. The device sends this information to the server, which verifies the validity of the information, generates an authentication token, and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[1351] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, or search for an avatar by entering the name of a specific celebrity in the search bar. The device sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the retrieved avatar list and search results on the screen.

[1352] When a user selects a specific avatar and clicks the "Start Conversation" button, the terminal sends this selection information to the server, which then creates a conversation session and sends an initial response to the user's terminal, thereby starting the conversation.

[1353] Users can enter questions or messages into the chat box and send them to advance the conversation. The device sends the user's input to the server, which then analyzes the input using a natural language processing engine, generates an appropriate response, and sends it to the device. The device then displays the generated response to the user and waits for the next input.

[1354] As the conversation progresses and the end time approaches, an extension option is displayed. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends the extension request and payment information to the server, which calculates the fee and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal, and the conversation time is extended.

[1355] After the conversation ends, a feedback input form will appear, and the user can enter their rating and comments about the service and click the submit button. The device will then send the feedback information to the server, which will then store it in a database. This will allow data to be accumulated that will be useful for future service improvements.

[1356] As a concrete example, consider a case where a user wants to talk to an avatar of a famous actor. The user accesses a web platform, creates an account, and logs in. Next, the user enters the actor's name in the search bar and selects the corresponding avatar. After starting the conversation, the user types, "Tell me about new movies." The server parses this message and generates and sends a response, "Recently, new movies are..." An extension option is displayed just before the conversation ends, and if the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is stored on the server.

[1357] As described above, the system of the present invention provides a series of functions that allow users to easily enjoy conversations with celebrity avatars, realizing a fulfilling experience while reducing financial and psychological burdens.

[1358] The processing flow will be explained below.

[1359] Step 1:

[1360] A user accesses the web platform and clicks the "Sign Up" button.

[1361] Step 2:

[1362] The device will display a user registration screen and prompt you to enter your name, email address, password, etc.

[1363] Step 3:

[1364] The user enters the required information and clicks the "Submit" button.

[1365] Step 4:

[1366] The terminal transmits the input information to the server.

[1367] Step 5:

[1368] The server receives the input information, validates it, and if validation passes, stores the information in a database.

[1369] Step 6:

[1370] The server generates a registration success message and sends it to the user's terminal.

[1371] Step 7:

[1372] The device will display a registration complete message.

[1373] Step 8:

[1374] The user enters their email address and password on the login screen and clicks the "Login" button.

[1375] Step 9:

[1376] The terminal sends the entered login information to the server.

[1377] Step 10:

[1378] The server validates the login information and generates an authentication token.

[1379] Step 11:

[1380] The server sends the authentication token to the user's device.

[1381] Step 12:

[1382] The device receives the authentication token and displays the main dashboard screen.

[1383] Step 13:

[1384] The user clicks the "Avatar List" button to display a list of celebrity avatars.

[1385] Step 14:

[1386] The device sends an avatar list display request to the server.

[1387] Step 15:

[1388] The server retrieves all avatar information from the database and sends it to the user's device.

[1389] Step 16:

[1390] The device will display a list of avatars.

[1391] Step 17:

[1392] A user enters the name of a particular celebrity in the search bar and clicks the "Search" button.

[1393] Step 18:

[1394] The device sends a search query to the server.

[1395] Step 19:

[1396] The server searches the database based on the search query and retrieves the corresponding avatar information.

[1397] Step 20:

[1398] The server transmits the acquired avatar information to the user's terminal.

[1399] Step 21:

[1400] Your device will display the search results.

[1401] Step 22:

[1402] The user selects a specific avatar and clicks the "Start Talking" button.

[1403] Step 23:

[1404] The terminal sends a conversation start request to the server along with information about the selected avatar.

[1405] Step 24:

[1406] The server creates a conversation session and sends an initial response to the user's terminal.

[1407] Step 25:

[1408] The terminal displays an initial response and waits for user input.

[1409] Step 26:

[1410] The user enters a question or message in the chat box and sends it.

[1411] Step 27:

[1412] The terminal sends the user's message to the server.

[1413] Step 28:

[1414] The server uses a natural language processing engine to analyze the user's message and generate an appropriate response.

[1415] Step 29:

[1416] The server generates a response and sends it to the user's terminal.

[1417] Step 30:

[1418] The terminal displays the response message and waits for further user input.

[1419] Step 31:

[1420] When the conversation is about to end, the device will display extension options and prices.

[1421] Step 32:

[1422] The user selects the extension time and clicks the "Purchase Extension" button.

[1423] Step 33:

[1424] The terminal sends the extension request and payment information to the server.

[1425] Step 34:

[1426] The server calculates the fee and requests the payment processing system to process it.

[1427] Step 35:

[1428] The server sends a success message to the user's terminal.

[1429] Step 36:

[1430] The terminal displays a message indicating that the extension is complete, and the conversation time is extended.

[1431] Step 37:

[1432] After the conversation ends, the device displays a feedback input form.

[1433] Step 38:

[1434] The user enters a rating and comment for the service and clicks the "Submit" button.

[1435] Step 39:

[1436] The terminal sends feedback information to the server.

[1437] Step 40:

[1438] The server stores the feedback information in a database.

[1439] The above are the specific processing steps in the system of the present invention.

[1440] Example 1

[1441] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1442] Previous web platforms had the problem of making it difficult for users to enjoy real-time conversations with celebrities. The process from starting to ending a conversation was often cumbersome, which compromised the user experience. Furthermore, features like feedback collection and conversation extensions were lacking, making it impossible to fully meet user needs.

[1443] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1444] In this invention, the server includes means for receiving authentication information of a user account and generating and transmitting an authentication token, means for searching and selecting avatar information, means for analyzing a user's input using a natural language processing engine and generating and transmitting an appropriate response, means for generating a conversation session and transmitting an initial response to the user's terminal, means for managing conversation time, providing an extension option, calculating fees, and requesting processing from a payment processing system, and means for displaying a feedback input form after the conversation ends and storing the feedback information in a database. This allows users to easily enjoy conversations with celebrity avatars, improving the real-time conversation experience.

[1445] "User" means an individual or entity that uses the web platform, creates an account, logs in and interacts with an avatar.

[1446] The "web platform" refers to a software system accessible over the Internet that allows users to create interactive experiences.

[1447] A "User Account" is an individual identification on the Platform created based on information such as a User's unique name, email address, and password.

[1448] An "authentication token" is a security token that is generated by the server after the user enters correct authentication information and sent to the user's terminal.

[1449] An "avatar" is a simulated person or character with which a user interacts on a web platform.

[1450] A "natural language processing engine" is a software engine that analyzes natural language input from a user and generates an appropriate response.

[1451] A "conversation session" is a unit for managing a series of conversation processes generated by the server in order for a user to have a conversation with an avatar.

[1452] An "initial response" is the first message that the server sends to the user's terminal at the start of a conversation session.

[1453] The "extension option" is information about additional time and price that can be selected if the user wishes to extend the interaction time.

[1454] "Payment Processing System" means an external or internal payment platform for processing fees when a user selects the extension option.

[1455] The "feedback input form" is a form in which the user can input their evaluation or comments on the service after the conversation has ended.

[1456] A "database" is a structured data storage system for storing user information, avatar information, feedback, etc.

[1457] The present invention relates to a web platform that allows users to casually engage in conversations with celebrity avatars. The main elements of the platform are user account registration and authentication, avatar selection, conversation initiation and progression, conversation extension options, and feedback collection.

[1458] Registration Process

[1459] The user accesses the web platform and enters the required information, such as name, email address, and password. The device sends this information to the server as an HTTP POST request. The server verifies the validity of the entered information and stores it in a database (e.g., MySQL). Once registration is complete, the server sends a message to the device saying "Registration completed," which the device displays to the user.

[1460] Login Process

[1461] The user enters their email address and password on the login screen, and the device sends this to the server. The server retrieves user information from the database based on the received information, and if it matches, generates a JWT (JSON Web Token) and sends it to the device. The device uses this token to display the main dashboard screen.

[1462] Avatar Selection

[1463] Users can click the "Avatar List" button on the main dashboard or enter the name of a specific celebrity in the search bar. The device then sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device, which then displays it to the user.

[1464] Initiating and conducting a conversation

[1465] When a user selects a specific avatar and clicks the "Start Conversation" button, the device sends the selection information to the server. The server creates a new conversation session and generates an initial message based on a natural language processing engine (such as GPT-4). This initial message is sent to the device, which displays it to the user. When the user enters a question or message and the device sends it, the server passes it to the natural language processing engine for analysis and generates an appropriate response. The generated response is sent to the device and displayed to the user.

[1466] Extending the conversation

[1467] As the conversation approaches its end time, the server sends an extension option to the terminal. The terminal displays an extension suggestion and fee information to the user. If the user wishes to extend the conversation and enters payment information, the terminal sends this to the server. The server processes the payment using a payment system such as Stripe, and if successful, sends a message to the terminal indicating that the extension has been completed. The terminal notifies the user, and the conversation is extended.

[1468] Enter your feedback

[1469] After the conversation ends, the user enters their rating and comments in the feedback input form. The device sends this information to the server, which stores it in a database. This feedback information is used to improve the service.

[1470] Specific examples

[1471] For example, if a user wants to have a conversation with an avatar of a famous actor, the user accesses the web platform, creates an account, and logs in. Then, the user enters the actor's name in the search bar and selects the actor's avatar. After the conversation begins, the user types, "Tell me about new movies." The server analyzes this message and generates a response, "Recently, new movies...," and sends it to the device.

[1472] Prompt Sentence Examples

[1473] Generate a response when a user asks, "Hello, famous actor. What movies have you been in recently?"

[1474] This system aims to improve the user experience by providing a function that allows users to easily enjoy real-time conversations with celebrity avatars. By using this platform, users can achieve a fulfilling conversational experience with minimal out-of-pocket costs.

[1475] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1476] Step 1:

[1477] A user accesses the web platform and enters their name, email address, and password on the account creation page. The device collects this input information and sends it to the server as an HTTP POST request. The server validates the received information, ensuring that it is a correctly formatted email address and that the password meets the required security standards, for example by using a validation library (e.g., Joi). The server then stores the information in a database (e.g., MySQL), and generates a success message and sends it to the device. The device displays the success message to the user. The input data are the name, email address, and password, and the output is the success message.

[1478] Step 2:

[1479] The user enters their email address and password on the login screen and clicks the login button. The device sends the entered login information to the server. The server receives this information, searches for the corresponding user information in the database, and confirms that it matches. If authentication is successful, the server generates a JWT (JSON Web Token) and sends it to the device. The device receives this token and displays the main dashboard screen to the user. The input data is the email address and password, and the output is the authentication token and the main dashboard screen.

[1480] Step 3:

[1481] The user clicks the "Avatar List" button on the main dashboard or enters the name of a specific celebrity in the search bar. The device sends the user's request to the server as an HTTP GET request. The server retrieves the corresponding avatar information from the database and sends it in JSON format to the device. The device analyzes the retrieved avatar information and displays a list of images and names. The input data is an avatar selection request, and the output is a list of avatar information.

[1482] Step 4:

[1483] The user selects a specific avatar and clicks the "Start Conversation" button. The device sends the selection information to the server. The server creates a new conversation session and generates an initial message using a natural language processing engine (e.g., a generative AI model). The server sends this initial message to the device, which displays it to the user. The input data is the avatar selection information, and the output is the initial message.

[1484] Step 5:

[1485] The user enters a message in the chat box and clicks the send button. The terminal sends this input to the server. The server passes the received input to a natural language processing engine for analysis and generates an appropriate response. The generated response is sent by the server to the terminal. The terminal displays the response to the user. The input data is the user's message and the output is the generated response.

[1486] Step 6:

[1487] As the conversation approaches its end time, the server sends an extension option to the terminal. The terminal displays the extension option and fee information to the user. When the user selects the extension time and price and enters payment information, the terminal sends this information to the server. The server calculates the fee and processes the payment using a payment processing system (e.g., an external payment platform). If the payment is successful, the server generates an extension completion message and sends it to the terminal. The terminal notifies the user of this. The input data is the extension request and payment information, and the output is the extension completion message.

[1488] Step 7:

[1489] After the conversation ends, the user enters their rating and comments in the feedback input form. The device sends the feedback information to the server, which stores it in a database and uses it to improve the service. The input data is the feedback information, and the output is a feedback save confirmation message.

[1490] Through the above series of steps, users can enjoy real-time conversations with celebrity avatars, providing a highly satisfying interactive experience.

[1491] (Application example 1)

[1492] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1493] In interactive virtual stores, when users interact with celebrity avatars in real time to learn about products and make purchases, conventional systems lack the quality and realism of responses. This limits the user experience and reduces shopping satisfaction. It also makes it difficult to extend conversations, process payments, and efficiently collect feedback.

[1494] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1495] In this invention, the server includes: means for a user to access the web platform and create a user account by inputting necessary information; means for receiving authentication information for the user account and generating and transmitting an authentication token; means for searching and selecting celebrity avatar information; means for receiving the user's input, analyzing it using a natural language processing engine, and generating and transmitting an appropriate response; means for managing the conversation time, offering an extension option, calculating fees, and requesting processing from a payment processing system; means for displaying a feedback input form after the conversation ends and saving the feedback information in a database; and means for requesting product explanations and purchasing advice from the celebrity avatar in the virtual store and receiving a response. This allows the user to receive detailed product explanations and purchasing advice from the celebrity avatar in real time in the virtual store, thereby improving shopping satisfaction.

[1496] A "web platform" is an online system that users can access via the Internet and use various services and functions.

[1497] "User Account" means a collection of information that identifies an individual user on the Web Platform and grants access rights to use the Services.

[1498] An "authentication token" is a temporary identifier generated to verify a user's identity and authorize them to operate within a system.

[1499] A "celebrity avatar" is a digital representation of a real-life celebrity that can interact with users.

[1500] A "natural language processing engine" is a technology or software that enables a computer to understand, analyze, and generate responses to human language.

[1501] "Conversation time management" is a function for monitoring the duration of a conversation between a user and a celebrity avatar and extending it as necessary.

[1502] The "extension option" is a choice to extend the set time if the user wishes to continue the conversation.

[1503] "Charge calculation" is the process of calculating the charges incurred for the use of a service.

[1504] A "payment processing system" is a system for accepting and processing payments from users.

[1505] The "feedback input form" is a screen element that allows users to input ratings and comments on the service.

[1506] A "virtual store" is a virtual shopping environment where products can be displayed, explained, and purchased online.

[1507] "Product description" is information that explains the product's features, usage, price, etc. to the user.

[1508] "Purchase advice" refers to providing information and advice that is useful to users when purchasing products.

[1509] The present invention relates to a system that allows users to receive product explanations and purchasing advice from celebrity avatars in a virtual store. The system of the present invention provides a series of processes for users to access a web platform, create a user account, log in, select a celebrity avatar, start a conversation, select extension options and payment processing, and finally provide feedback.

[1510] First, when a user accesses the web platform, a registration screen for creating a user account is displayed. The user enters information such as name, email address, and password and clicks the submit button. The server receives this input information, verifies its validity, and saves it in a database.

[1511] Next, the user enters their email address and password on the login screen and clicks the login button. The server receives this information, generates an authentication token, and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[1512] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, and then search for avatars by entering the name of a specific celebrity in the search bar. The server retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the retrieved avatar list and search results on the screen.

[1513] When a user selects a specific avatar and clicks the "Start Conversation" button, the server creates a conversation session and starts the conversation by sending an initial response to the user's device, such as "Nice to meet you! Is there anything you'd like to ask me?"

[1514] Users can enter questions or messages into the chat box and send them to advance the conversation. The device sends the user's input to the server, which then analyzes the input using a natural language processing engine (e.g., GPT-3), generates an appropriate response, and sends it to the device. The device then displays the generated response to the user and waits for the next input.

[1515] As the conversation progresses and the end time approaches, an extension option will appear on the terminal. If the user wishes to extend the conversation, they will select the extension time and price and enter payment information. The server receives the extension request and payment information, calculates the fee, and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal, and the conversation time is extended.

[1516] After the conversation ends, a feedback input form will appear on the device, and the user can enter their rating and comments about the service and click the submit button. The server will receive the feedback information and store it in a database. This will allow the server to accumulate data that will be useful for future service improvements.

[1517] As a concrete example, consider a case where a user wants to talk to an avatar of a famous actor. The user accesses a web platform, creates an account, and logs in. Next, the user enters the actor's name in the search bar and selects the corresponding avatar. After starting the conversation, the user types, "Tell me about new movies." The server analyzes this message and generates and sends the response, "Actor Avatar: The latest new movies are...." Just before the conversation ends, an extension option is displayed, and if the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is saved on the server.

[1518] Example prompt sentence:

[1519] 1. Go to the web platform and click on the "Create an Account" button.

[1520] 2. Enter the required information (name, email address, password) and click the Send button.

[1521] 3. Once you have completed the registration, click the "Login" button and enter your email address and password to log in.

[1522] 4. From the main dashboard, click the "Avatar List" button to view the list of avatars.

[1523] 5. Select your actor's avatar and click the "Start Talking" button.

[1524] 6. Type "Tell me about new movies" in the message box and send.

[1525] 7. You will see a response such as "Actor Avatar: In the latest new movie..."

[1526] This system allows users to receive detailed product descriptions and purchasing advice in real time from celebrity avatars within a virtual store, improving their shopping satisfaction.

[1527] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1528] Step 1:

[1529] A user accesses the web platform, enters the required information on the account creation screen, and submits it. The user enters a username, email address, and password. The submitted data is sent to the server. The server verifies the validity of the received data, and if the verification is successful, stores it in a database. It then sends a message to the user's device indicating that account creation has been completed.

[1530] Input: Username, Email Address, Password

[1531] Output: Account creation complete message

[1532] Step 2:

[1533] The user enters their email address and password on the login screen and submits it. The user's authentication information is sent to the server. The server compares it with information in the database, and if authentication is successful, generates an authentication token and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[1534] Input: User's email address, password

[1535] Output: Auth token, main dashboard

[1536] Step 3:

[1537] The user clicks the "Avatar List" button on the main dashboard to display a list of avatars. The server retrieves avatar information from the database and sends it to the device. The user checks the displayed avatar information.

[1538] Input: User avatar list request

[1539] Output: List of displayed avatars

[1540] Step 4:

[1541] A user enters the avatar of a particular celebrity into the search bar and clicks the search execution button. The device sends the input information to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The corresponding avatar information is then displayed on the device.

[1542] Input: User search input (famous person's name)

[1543] Output: Avatar information for the displayed search results

[1544] Step 5:

[1545] The user selects a specific avatar and clicks the "Start Conversation" button. The device sends a session initiation request to the server, which creates a conversation session. An initial response is generated and sent to the user's device. The device displays "Nice to meet you! Is there anything you'd like to ask me?"

[1546] Input: User's avatar selection information

[1547] Output: Initial response message

[1548] Step 6:

[1549] The user enters a question or message into the chat box and sends it. The device sends the user's input to the server, which then analyzes the message using a natural language processing engine (e.g., GPT-3). An appropriate response is generated and sent to the device. The generated response message is displayed on the device. Responses such as "Actor Avatar: In recent new movies..." are provided.

[1550] Input: User's message

[1551] Output: The generated response message

[1552] Step 7:

[1553] As the conversation nears the end, an extension option appears on the terminal. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends this information to the server, which calculates the fee and requests processing from the payment processing system. If successful, an extension completion message is sent to the terminal and the conversation time is extended.

[1554] Input: Extended time, payment information

[1555] Output: Extension complete message

[1556] Step 8:

[1557] After the conversation ends, a feedback input form is displayed on the device. The user enters their rating and comments and submits them. The device then sends the feedback information to the server, which stores it in a database. User feedback is accumulated as data that will help improve the service.

[1558] Input: User feedback

[1559] Output: Feedback save completion notification

[1560] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1561] The present invention relates to a web platform that allows users to casually enjoy conversations with celebrity avatars, and in particular incorporates an emotion engine that recognizes the user's emotions and generates responses accordingly. The system of the present invention provides a process for users to access the web platform, create a user account, log in, select a celebrity avatar, start a conversation, manage time, and provide feedback.

[1562] When a user accesses the web platform, they are first shown a registration screen to create a user account. The user enters information such as their name, email address, and password, and clicks the submit button. The device sends this information to the server, which receives it, verifies its validity, and stores it in a database. Once registration is complete, the server sends a success message to the user, which is displayed on the device.

[1563] Next, the user enters their email address and password on the login screen and clicks the login button. The device sends this information to the server, which verifies the validity of the information, generates an authentication token, and sends it to the user's device. The device receives the authentication token and displays the main dashboard screen.

[1564] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, or search for an avatar by entering the name of a specific celebrity in the search bar. The device sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the retrieved avatar list and search results on the screen.

[1565] When a user selects a specific avatar and clicks the "Start Conversation" button, the terminal sends this selection information to the server, which then creates a conversation session and sends an initial response to the user's terminal, thereby starting the conversation.

[1566] Users advance the conversation by entering questions or messages into the chat box and sending them. The device sends the user's input to the server, which analyzes the input using a natural language processing engine and an emotion engine. The natural language processing engine analyzes the content of the entered text and generates an appropriate response. The emotion engine analyzes the emotion contained in the user's message and adjusts the response generated by the natural language processing engine based on the results. For example, if the user is expressing negative emotion, the server will recognize this and generate a more comforting or encouraging response. The generated response is sent from the server to the user's device and displayed.

[1567] As the conversation progresses and the end time approaches, an extension option is displayed. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends the extension request and payment information to the server, which calculates the fee and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal, and the conversation time is extended.

[1568] After the conversation ends, a feedback input form is displayed, and the user enters their rating and comments about the service and clicks the send button. The device then sends the feedback information to the server, which stores it in a database. This feedback information also includes the user's emotional data analyzed by the emotion engine and is used to improve the service.

[1569] As a concrete example, consider a case where a user wants to talk to an avatar of a famous actor. The user accesses a web platform, creates an account, and logs in. Next, they enter the actor's name in the search bar and select the corresponding avatar. After starting a conversation, the user types, "I'm feeling stressed at work these days." The server analyzes this message, and the emotion engine recognizes that the user is expressing negative emotions. Based on this, the natural language processing engine adjusts the response, generating and sending a comforting message such as, "That's tough to be stressed out. Maybe it would help to find a way to decompress." Just before the conversation ends, an extension option is displayed, and if the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is stored on the server.

[1570] As described above, the system of the present invention provides a function that allows users to easily enjoy conversations with celebrity avatars, and furthermore, by using an emotion engine to generate responses that correspond to the user's emotions, it provides a more satisfying experience for the user.

[1571] The processing flow will be explained below.

[1572] Step 1:

[1573] A user accesses the web platform and clicks the "Sign Up" button.

[1574] Step 2:

[1575] The device will display a user registration screen and prompt you to enter your name, email address, password, etc.

[1576] Step 3:

[1577] The user enters the required information and clicks the "Submit" button.

[1578] Step 4:

[1579] The terminal transmits the input information to the server.

[1580] Step 5:

[1581] The server receives the input information, validates it, and if validation passes, stores the information in a database.

[1582] Step 6:

[1583] The server generates a registration success message and sends it to the user's terminal.

[1584] Step 7:

[1585] The device will display a registration complete message.

[1586] Step 8:

[1587] The user enters their email address and password on the login screen and clicks the "Login" button.

[1588] Step 9:

[1589] The terminal sends the entered login information to the server.

[1590] Step 10:

[1591] The server validates the login information and generates an authentication token.

[1592] Step 11:

[1593] The server sends the authentication token to the user's device.

[1594] Step 12:

[1595] The device receives the authentication token and displays the main dashboard screen.

[1596] Step 13:

[1597] The user clicks the "Avatar List" button to display a list of celebrity avatars.

[1598] Step 14:

[1599] The device sends an avatar list display request to the server.

[1600] Step 15:

[1601] The server retrieves all avatar information from the database and sends it to the user's device.

[1602] Step 16:

[1603] The device will display a list of avatars.

[1604] Step 17:

[1605] A user enters the name of a particular celebrity in the search bar and clicks the "Search" button.

[1606] Step 18:

[1607] The device sends a search query to the server.

[1608] Step 19:

[1609] The server searches the database based on the search query and retrieves the corresponding avatar information.

[1610] Step 20:

[1611] The server transmits the acquired avatar information to the user's terminal.

[1612] Step 21:

[1613] Your device will display the search results.

[1614] Step 22:

[1615] The user selects a specific avatar and clicks the "Start Talking" button.

[1616] Step 23:

[1617] The terminal sends a conversation start request to the server along with information about the selected avatar.

[1618] Step 24:

[1619] The server creates a conversation session and sends an initial response to the user's terminal.

[1620] Step 25:

[1621] The terminal displays an initial response and waits for user input.

[1622] Step 26:

[1623] The user enters a question or message in the chat box and sends it.

[1624] Step 27:

[1625] The terminal sends the user's message to the server.

[1626] Step 28:

[1627] The server analyzes the user's message using a natural language processing engine and an emotion engine.

[1628] Step 29:

[1629] The server generates an appropriate response based on the analysis results, particularly adjusting the response according to the user's emotions.

[1630] Step 30:

[1631] The server generates a response and sends it to the user's terminal.

[1632] Step 31:

[1633] The terminal displays the response message and waits for further user input.

[1634] Step 32:

[1635] When the conversation is about to end, the device will display extension options and prices.

[1636] Step 33:

[1637] The user selects the extension time and clicks the "Purchase Extension" button.

[1638] Step 34:

[1639] The terminal sends the extension request and payment information to the server.

[1640] Step 35:

[1641] The server calculates the fee and requests the payment processing system to process it.

[1642] Step 36:

[1643] The server sends a success message to the user's terminal.

[1644] Step 37:

[1645] The terminal displays a message indicating that the extension is complete, and the conversation time is extended.

[1646] Step 38:

[1647] After the conversation ends, the device displays a feedback input form.

[1648] Step 39:

[1649] The user enters a rating and comment for the service and clicks the "Submit" button.

[1650] Step 40:

[1651] The terminal sends feedback information to the server.

[1652] Step 41:

[1653] The server stores the feedback information and the analysis results of the emotion engine in a database.

[1654] The above are the specific processing steps in the system of the present invention.

[1655] Example 2

[1656] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1657] Conventional web platforms have limitations in allowing users to enjoy natural conversations with celebrity avatars, making it difficult to fully understand the user's emotions and generate appropriate responses. Furthermore, the complicated procedures for extending conversation sessions and processing payments hinder users' smooth use of the service. Furthermore, there is a lack of a way to effectively utilize the feedback collected after the conversation ends. Therefore, a new system is needed that improves the quality of the user experience while providing smooth operation and appropriate responses based on emotions.

[1658] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1659] In this invention, the server includes: a means for a user to access the web platform and create a user account by entering necessary information; a means for receiving authentication information for the user account and generating and transmitting an authentication token; a means for searching and selecting celebrity avatar information; a means for receiving the user's input, analyzing it using a natural language processing engine and an emotion engine, generating and transmitting an appropriate response; a means for managing the conversation time, offering an extension option, calculating fees, and requesting processing from a payment processing system; and a means for displaying a feedback input form after the conversation ends and storing the feedback information and emotion data in a database. This enables a smooth extension of the conversation session and payment processing while understanding the user's emotions and providing appropriate responses accordingly. Furthermore, the collected feedback and emotion data can be effectively utilized.

[1660] "User" refers to any person who accesses the web platform and uses the services provided therein.

[1661] "Web platform" refers to the system that enables access to information and services provided on the Internet and the performance of various activities.

[1662] "User account" refers to a set of information that individually identifies a user and manages access rights and service usage.

[1663] An "authentication token" refers to unique data generated based on a user's authentication information and used to manage the user's session.

[1664] An "avatar" is a virtual person or character that runs on a computer and that a user can select and interact with.

[1665] A "natural language processing engine" is a software module for understanding and interpreting natural language, and is used to analyze user input and generate appropriate responses.

[1666] An "emotion engine" is a software module that recognizes and analyzes emotions contained in user input, and works in conjunction with a natural language processing engine to generate responses.

[1667] A "conversation session" refers to a session in which a series of conversations take place between a user and an avatar, and the time from start to finish is managed.

[1668] The "extension option" is a service provided near the end of a conversation session, allowing the user to extend the conversation time by paying an additional fee.

[1669] "Payment processing system" refers to a system for receiving payment information from users and completing payments securely.

[1670] The "feedback input form" is an interface that allows users to input their evaluations and comments about the service.

[1671] A "database" refers to a digital storage system for efficiently storing, retrieving, updating, and deleting information.

[1672] "Feedback Information" refers to data on ratings and comments provided by users through the feedback input form.

[1673] "Emotion data" refers to emotional information analyzed by the emotion engine from user input.

[1674] The present invention relates to a web platform that allows users to casually enjoy conversations with celebrity avatars, and in particular incorporates an emotion engine that recognizes the user's emotions and generates responses accordingly. The system of the present invention provides a single process for users to access the web platform, create a user account, log in, select a celebrity avatar, start a conversation, manage the conversation time, select extension options, make a payment, collect feedback, and save the information in a database.

[1675] Hardware used

[1676] Server: A high-performance computer (e.g., a virtual server on a cloud platform)

[1677] Terminal: User's personal computer (PC), smartphone, or other device

[1678] Software used

[1679] Web framework: Django

[1680] Database: PostgreSQL

[1681] Natural Language Processing Engine: GPT Model

[1682] Sentiment Engine: Sentiment Analysis API

[1683] Payment Processing System: Payment API

[1684] Processing flow

[1685] First, a user accesses the web platform and creates a user account by entering information such as name, email address, and password. The device sends this information to the server, which then validates it using the Django framework and stores it in the PostgreSQL database. Once registration is complete, the server generates a success message and sends it to the user's device.

[1686] Next, the user enters their email address and password on the login screen and clicks the login button. The device sends this information to the server, which verifies its validity and then generates an authentication token, which is sent to the user's device. The device receives the token and displays the main dashboard screen.

[1687] On the main dashboard, users can click the "Avatar List" button to display a list of avatars, or search for an avatar by entering the name of a celebrity in the search bar. The device sends the user's request to the server, which retrieves the corresponding avatar information from the database and sends it to the device. The device then displays the avatar list or search results on the screen.

[1688] When a user selects a specific avatar and clicks the "Start Conversation" button, the device sends this selection information to the server. The server creates a new conversation session and sends an initial response to the user's device. The user advances the conversation by entering questions or messages in the chat box and sending them. The device sends the user's input to the server, which analyzes it using a natural language processing engine and an emotion engine. The natural language processing engine analyzes the entered text and generates an appropriate response. The emotion engine analyzes the emotion contained in the user's message and adjusts the response generated by the natural language processing engine based on the results. For example, if the user is expressing negative emotions, the server recognizes this and generates a more comforting or encouraging response. The generated response is sent from the server to the user's device and displayed.

[1689] When the conversation is in progress and the end time is approaching, an extension option is displayed. If the user wishes to extend the conversation, they select the extension time and price and enter payment information. The terminal sends the extension request and payment information to the server, which calculates the fee and processes it in the payment processing system. If the process is successful, the server sends an extension completion message to the terminal and the conversation time is extended.

[1690] After the conversation ends, a feedback input form is displayed, and the user enters their rating or comment on the service and clicks the send button. The device then sends the feedback information to the server, which stores it in a database. This feedback information also includes the user's emotional data analyzed by the emotion engine and is used to improve the service.

[1691] Specific examples

[1692] For example, consider a case where a user wants to talk to an avatar of a famous celebrity. The user accesses the web platform, creates an account, and logs in. Next, they enter the celebrity's name in the search bar and select the corresponding avatar. After starting a conversation, the user types, "I'm feeling stressed at work these days." The server analyzes this message, and the emotion engine recognizes that the user is expressing negative emotions. Based on this, the natural language processing engine adjusts the response, generating and sending a comforting message such as, "That's tough to be stressed out. Maybe it would help to find a way to relax." Before the conversation ends, an option to extend the conversation is displayed. If the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. After the conversation ends, the user provides feedback, which is stored on the server.

[1693] Prompt Sentence Examples

[1694] "Just visit our web platform and start chatting with the avatars of famous celebrities. Just enter their name in the search bar, select their avatar and enjoy the conversation."

[1695] "Speak to a celebrity avatar to discuss work stress. The emotion engine identifies your emotions and provides appropriate responses."

[1696] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1697] Step 1: Divide the processing flow of this system's program into processing steps

[1698] Step 1: Create a user account

[1699] Step 2: User Login and Authentication

[1700] Step 3: Avatar selection and search

[1701] Step 4: Initiating and conducting a conversation session

[1702] Step 5: Extend the conversation and settle

[1703] Step 6: Gather feedback

[1704] Step 2: Explain each processing step in detail

[1705] Step 1: Create a user account

[1706] Input: The user enters their name, email address, and password.

[1707] Operation: The terminal sends the entered user information to the server, which validates the information and stores it in a database.

[1708] Output: The server sends a registration success message to the terminal, which displays it to the user.

[1709] Step 2: User Login and Authentication

[1710] Input: The user enters their email address and password on the login screen.

[1711] How it works: The device sends the entered login information to the server, which generates an authentication token and sends it to the device.

[1712] Output: The device receives the authentication token and displays the main dashboard.

[1713] Step 3: Avatar selection and search

[1714] Input: Users click the "Avatar List" button on the main dashboard or type the name of a specific celebrity into the search bar.

[1715] How it works: The device sends a user request to the server, which retrieves the relevant avatar information from the database and sends it to the device.

[1716] Output: The device displays the list of avatars and search results to the user.

[1717] Step 4: Initiating and conducting a conversation session

[1718] Input: The user selects a specific avatar and clicks the "Start Talking" button.

[1719] Operation: The device sends the selection information to the server. The server creates a conversation session and sends an initial response to the device. The user enters a question or message in the chat box and sends it. The device sends the message to the server, which analyzes it using its natural language processing engine and emotion engine and generates a response.

[1720] Output: The server generates a response and sends it to the terminal, which displays it to the user.

[1721] Step 5: Extend the conversation and settle

[1722] Input: The user selects the extension option that appears when the conversation is about to end. Enters payment information.

[1723] Operation: The terminal sends an extension request and payment information to the server, which calculates the fee and processes it in the payment processing system.

[1724] Output: The server sends an extension completion message to the terminal, which displays it and extends the conversation time.

[1725] Step 6: Gather feedback

[1726] Input: After the conversation ends, the user enters their rating or comment in the feedback input form and submits it.

[1727] Operation: The device sends feedback information to the server, which stores the feedback information and emotion data in a database.

[1728] Output: The server sends a save complete message to the terminal, which displays it to the user.

[1729] (Application example 2)

[1730] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1731] Conventional web platforms lack the ability to properly recognize a user's emotions and generate appropriate responses when users converse with celebrity avatars. Furthermore, there is a lack of a way for users to enjoy natural conversations with celebrity avatars while moving around in the real world. Therefore, there is a need to provide an interactive conversation experience that increases user satisfaction and can be used in the real world.

[1732] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for a user to access a web platform and create a user account by entering required information; means for receiving authentication information for the user account and generating and transmitting an authentication token; means for searching and selecting celebrity avatar information; means for receiving the user's input, analyzing it using a natural language processing engine, and generating and transmitting an appropriate response; means for managing the conversation time, offering extension options, calculating fees, and requesting processing from a payment processing system; means for displaying a feedback input form after the conversation ends and saving the feedback information in a database; means for tracking the user's gaze using an application installed in the smart glasses and realizing natural conversation using voice recognition technology; and means for analyzing the user's voice input using an emotion engine and generating and transmitting a response according to the user's emotion. This allows the user to enjoy interactive conversations with celebrity avatars even while moving around in the real world, thereby increasing user satisfaction.

[1733] "User Account" means an account for personal identification created by a User to access the Web Platform.

[1734] An "authentication token" is a digital token that is generated based on a user's authentication information and is used to grant access authorization.

[1735] "Celebrity avatar information" is digital data that represents a specific celebrity as a virtual character.

[1736] A "natural language processing engine" is a technology that analyzes natural language text entered by a user and generates an appropriate response.

[1737] An "emotion engine" is a technology that analyzes the emotions contained in user input and adjusts responses according to those emotions.

[1738] "Management of conversation time" is a function for measuring the conversation time between the user and the avatar and managing whether to extend the conversation as necessary.

[1739] An "extension option" is a choice that provides additional time if the user wishes to continue the conversation.

[1740] A "payment processing system" is a system that calculates service fees and processes payments from users.

[1741] The "feedback input form" is a screen where users can input and provide their evaluations and comments on the service.

[1742] "Smart glasses" are devices that users can wear to utilize functions such as eye tracking and voice recognition.

[1743] "Eye tracking" is a technology that detects the movement of a user's eyes and performs operations accordingly.

[1744] "Speech recognition technology" is a technology that converts a user's voice into text and analyzes its meaning.

[1745] This invention is a system that allows users to casually enjoy conversations with celebrity avatars. In particular, it incorporates an emotion engine and a natural language processing engine to recognize the user's emotions and generate responses accordingly, and can be used while moving around in the real world using smart glasses.

[1746] The system is structured as follows: First, a user accesses the web platform and enters the necessary information to create a user account. This data is sent to the server, where the validity of the registration information is confirmed and then stored in the database. Once the account is created, the server generates and sends an authentication token to the user.

[1747] Next, the user wears the smart glasses, logs in, and uses an authentication token to access the main dashboard. The user can search for and select a celebrity avatar. The selected avatar is sent to the server, which then creates a conversation session and sends an initial response to the user's device.

[1748] When a user starts a conversation, the device (smart glasses) receives the user's voice input and converts it into text using speech recognition technology. The server then analyzes the received text using a natural language processing engine and generates an appropriate response. At the same time, the emotion engine analyzes the user's emotions and adjusts the response. The generated response is sent from the server to the user's device (smart glasses) and displayed to the user.

[1749] For example, if a user says, "I've been feeling stressed at work lately," the smart glasses convert this speech into text and send it to the server. The server uses an emotion engine to recognize negative emotions and generate a response based on that. The response generated is, "It's tough being stressed. Maybe it would be good to find a way to decompress," and is displayed to the user.

[1750] When the conversation time is about to end, the server presents the user with an option to extend the conversation. If the user wishes to extend the conversation, they can pay an additional fee to continue the conversation. This fee calculation and settlement process are also performed by the server and handled by the settlement system.

[1751] After the conversation is over, the server presents the user with a feedback form, where the user can enter and submit their rating and comments about the service. This feedback information is stored in a database and used to improve the service.

[1752] The main hardware used is smart glasses, voice recognition software (e.g., Google Cloud Speech-to-Text), and emotion recognition engines (e.g., Affectiva), which allow users to enjoy interactive conversations with celebrity avatars while moving around in the real world.

[1753] An example of a prompt to input to a generative AI model is as follows:

[1754] "In response to a user's message, 'I've been feeling stressed at work lately,' use an emotion recognition engine to detect negative emotions and generate a comforting or encouraging message."

[1755] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1756] Step 1:

[1757] A user accesses the web platform and enters the required information to create a user account. The user enters their name, email address, and password, and clicks the submit button. The entered information is sent from the device to the server. The server verifies its validity, stores it in the database, and sends a registration success message to the user's device.

[1758] Step 2:

[1759] The user enters their email address and password on the login screen and clicks the login button. The entered information is sent from the device to the server. The server verifies the authentication information and, if correct, generates an authentication token and sends it to the user's device. The device stores the received authentication token and displays the main dashboard.

[1760] Step 3:

[1761] The user clicks the "Avatar List" button on the main dashboard and selects from the displayed avatars. The selected avatar information is sent from the device to the server, and the server creates a conversation session and sends an initial response to the user's device, which displays this response.

[1762] Step 4:

[1763] A user wears smart glasses and speaks to an avatar. The smart glasses convert the voice input into text. The text data is sent from the device to a server. The server uses a natural language processing engine to analyze the text and generate an appropriate response. At the same time, an emotion engine analyzes the user's emotions and adjusts the response. The generated response is sent from the server to the user's device, which then displays it to the user.

[1764] Step 5:

[1765] When the conversation time is nearing the end, the terminal presents the user with an option to extend the conversation. If the user wishes to extend the conversation, the terminal inputs the extension time and payment information. The input information is sent from the terminal to the server, which calculates the fee and requests processing from the payment processing system. Once the payment is completed, the server sends an extension completion message to the terminal, and the conversation time is extended.

[1766] Step 6:

[1767] After the conversation ends, the device displays a feedback input form. The user enters their rating or comment on the service and clicks the send button. The feedback information is sent from the device to the server, which stores it in a database. The user's emotional data, analyzed by the emotion engine, is also included in the feedback information and used to improve the service.

[1768] In this way, users can enjoy natural conversations with celebrity avatars while moving around in the real world using smart glasses. In addition, the emotion engine and natural language processing engine generate responses based on the user's emotions, increasing user satisfaction.

[1769] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1770] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1771] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1772] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot...

Claims

1. a means for a user to access the web platform and enter required information to create a user account; means for receiving user account authentication information and generating and transmitting an authentication token; a means for searching and selecting celebrity avatar information; means for receiving user input, analyzing it using a natural language processing engine, and generating and transmitting an appropriate response; A means for managing the duration of a conversation, providing an option to extend the duration of the conversation, calculating fees, and submitting the processing to a payment processing system; A means for displaying a feedback input form after the conversation ends and storing the feedback information in a database; A system including:

2. 2. The system according to claim 1, further comprising means for the server to generate an initial response and transmit it to the user's terminal when the user initiates a conversation with a particular avatar.

3. 2. The system according to claim 1, further comprising means for the server to receive the user's input, analyze it with a natural language processing engine, and then transmit a generated response to the user's terminal.

Images