System

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving input from a user and performing user registration; means for generating a AI avatar based on a celebrity's profile information; means for enabling a conversation with the generated AI avatar; and means for performing fee setting and payment processing according to usage.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The spread of social media has made it possible to interact with celebrities more easily, but there are still psychological and financial hurdles to actually interacting with celebrities directly. Young people in particular want to interact with celebrities, but are often prevented from doing so by physical, time, and financial constraints. This invention aims to overcome these constraints and provide an environment in which users can easily interact with AI avatars of celebrities. [Means for solving the problem]

[0005] The present invention solves the above problems by the following means.

[0006] The system includes a means for receiving input data from users and registering them, a means for generating an AI avatar based on a celebrity's profile information, a means for enabling conversations with the generated AI avatar, and a means for setting fees and processing payments according to usage. The system also includes a means for the AI ​​avatar to generate responses in one or more of the following formats during conversations with the user: text, audio, image, or video; and a means for validating the user's input data and transmitting it to a server in an appropriate format, allowing users to interact with the celebrity's AI avatar in a variety of formats. This reduces psychological and economic constraints, allowing anyone to easily enjoy interacting with celebrities.

[0007] "User" refers to an individual who uses the system to interact with a celebrity's AI avatar.

[0008] "Input data" refers to information that a user provides to the system, and primarily includes user registration information, profile information, conversation content, and the like.

[0009] "User registration" refers to the process by which a user provides personal information required to use the system and completes authentication.

[0010] A "celebrity" is a person who is widely known to the public, who is generated as an AI avatar within the system, and who can interact with users.

[0011] "Profile information" refers to the data necessary to generate an AI avatar, such as a celebrity's name, photo, voice sample, and biography.

[0012] An "AI avatar" is an artificial intelligence-based virtual persona created based on a celebrity's profile information and capable of conversing with the user.

[0013] "Generation" refers to the process of creating an AI avatar using a celebrity's profile information.

[0014] "Conversation" refers to the act of exchanging information between a user and an AI avatar in one or more of the following formats: text, audio, images, and / or video.

[0015] "Pricing" refers to the process of determining the costs for using a system.

[0016] "Payment processing" refers to the procedure for paying fees based on the fee plan selected by the user.

[0017] "Text" refers to a conversational format using written information.

[0018] "Speech" refers to a form of conversation using acoustic information.

[0019] "Image" refers to a conversational format using still images.

[0020] "Video" refers to a conversational format using visual information.

[0021] "Validation" refers to the process of ensuring that the data entered by a user is appropriate.

[0022] "Server" refers to the central computer that manages the entire system and processes user input data, generates AI avatars, and processes conversations.

[0023] "System" refers to a computer program and its environment that provides a series of functions including user registration, AI avatar generation, conversation, pricing, and payment processing. [Brief explanation of the drawings]

[0024] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0025] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0026] First, the terms used in the following description will be explained.

[0027] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0028] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0029] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0030] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0031] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0032] [First embodiment]

[0033] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0034] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0035] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0036] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0037] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0038] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0039] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0040] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0041] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0042] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0043] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0044] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0045] This invention provides a B2C web platform that allows users to easily interact with AI avatars of celebrities. This system allows users to easily converse with AI avatars of celebrities and offers flexibility in terms of time and price. Specific embodiments of this system are described below.

[0046] User Registration and Authentication

[0047] A user first accesses the system and enters information such as name, email address, and password on the new registration screen. The terminal receives this input data and performs validation. Once validation is complete, the terminal sends the data to the server. The server stores the received data and returns a registration success message to the terminal. This registers the user in the system and they can begin using it.

[0048] AI avatar generation for celebrities

[0049] The user enters the celebrity's profile information, such as their name, photo, voice sample, and biography, into a form within the system. The device receives this information and verifies the required fields. After verification, the device sends this data to the server. The server analyzes the received information and passes it to the AI ​​generation model. The AI ​​generation model generates a realistic AI avatar of the celebrity. This avatar is designed to respond in the form of text, voice, image, or video. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device displays a preview of the AI ​​avatar to the user along with a message of success.

[0050] Start a conversation with an AI avatar

[0051] The user clicks the Start Conversation button to converse with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the AI ​​avatar, and the AI ​​avatar generates an initial greeting message. The generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data and generates a response for the AI ​​avatar. This response is sent back to the device, which displays or plays it back to the user. This achieves an interactive conversation between the user and the AI ​​avatar.

[0052] Pricing and Payment

[0053] The user operates the pricing plan screen and selects the usage time and price options. For example, plans include 30 minutes for 500 yen or 1 hour for 1,000 yen. The terminal sends the selected data to the server. The server calculates the fee and displays the payment page on the terminal. When the user enters the payment information and completes the payment, the terminal sends confirmation to the server. The server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan.

[0054] Specific examples

[0055] For example, suppose a user registers in the system under the name "Yamada Taro" and generates an AI avatar of a famous person named "Tanaka Minako." The user enters their profile information and checks a preview of the generated avatar. Next, after selecting a pricing plan and completing payment, a conversation with Tanaka Minako's AI avatar begins. The user asks questions via text or voice, and the AI ​​avatar responds individually to them. In this way, users can easily enjoy interactive interactions with famous people.

[0056] The embodiments of the present invention allow users to interact with real AI avatars of celebrities in a variety of ways while keeping psychological and economic hurdles low.

[0057] The processing flow will be explained below.

[0058] User Registration and Authentication

[0059] Step 1:

[0060] The user accesses the new registration screen and enters registration information such as name, email address, and password.

[0061] Step 2:

[0062] The terminal receives the entered information and validates that all required fields have been entered.

[0063] Step 3:

[0064] The terminal sends the data that has passed validation to the server.

[0065] Step 4:

[0066] The server receives the submitted data and creates a new user record in the database.

[0067] Step 5:

[0068] The server returns a successful response to the terminal.

[0069] Step 6:

[0070] The terminal receives the response and displays a "Registration successful" message to the user.

[0071] AI avatar generation for celebrities

[0072] Step 1:

[0073] A user enters profile information such as the celebrity's name, photo, voice sample, and biography.

[0074] Step 2:

[0075] The terminal receives the entered information and validates it to ensure there are no missing details.

[0076] Step 3:

[0077] The device sends the validated data to the server.

[0078] Step 4:

[0079] The server analyzes the received data and passes it to the AI ​​generation model.

[0080] Step 5:

[0081] The server's AI generative model uses the data to generate an AI avatar of the celebrity, which can respond in the form of text, voice, images, and video.

[0082] Step 6:

[0083] The server stores the generated AI avatar in a database and returns a response indicating successful generation to the device.

[0084] Step 7:

[0085] The device receives the response and displays a preview of the generated AI avatar to the user.

[0086] Start a conversation with an AI avatar

[0087] Step 1:

[0088] The user selects the AI ​​avatar they want to talk to and clicks the Start Conversation button.

[0089] Step 2:

[0090] The terminal sends a conversation initiation request to the server.

[0091] Step 3:

[0092] The server creates a conversation session with the selected AI avatar and generates an initial greeting message.

[0093] Step 4:

[0094] The server sends the generated initial message to the terminal.

[0095] Step 5:

[0096] The terminal displays a welcome message to the user.

[0097] Step 6:

[0098] The user enters a response by text or voice.

[0099] Step 7:

[0100] The terminal sends the user's input to the server.

[0101] Step 8:

[0102] The server receives the user's input data and processes it to generate a response from the AI ​​avatar.

[0103] Step 9:

[0104] The server sends the generated AI avatar's response to the device.

[0105] Step 10:

[0106] The terminal receives the response and displays or plays it back to the user, and this process is repeated to continue the interactive conversation.

[0107] Pricing and Payment

[0108] Step 1:

[0109] The user accesses the pricing plan screen and sees the available time and price options.

[0110] Step 2:

[0111] The user selects the plan they want and enters their payment information.

[0112] Step 3:

[0113] The terminal sends the selected plan and payment information to the server.

[0114] Step 4:

[0115] The server receives the transmitted data and executes the payment process in cooperation with the payment system.

[0116] Step 5:

[0117] The server checks the result of the payment process and returns a success or failure response to the terminal.

[0118] Step 6:

[0119] The terminal receives the result of the payment process and displays a message to the user saying "Payment completed." If the payment is successful, a message also appears stating that the user is authorized to start using the service.

[0120] Example 1

[0121] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0122] Although systems exist that allow users to easily interact with celebrity avatars, the process of user registration, entering profile information, and starting a conversation is cumbersome, and the pricing and payment processes are also complicated, making it difficult for users to use. Another problem is that the process for generating AI avatars is unclear, and the quality of responses cannot be guaranteed. It is necessary to resolve these issues and enable users to use the system intuitively and smoothly.

[0123] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0124] In this invention, the server includes means for receiving input data from a user and performing user registration, means for generating an AI avatar based on the celebrity's profile information, means for enabling conversation with the generated AI avatar, means for setting fees according to usage and processing payments, means for validating the input data and transmitting it to the server in an appropriate format, means for starting a conversation session and generating an initial greeting message, and means for analyzing the user's response data and generating a response for the AI ​​avatar. This allows users to easily use the system and smoothly interact with the celebrity's AI avatar.

[0125] "Input data" refers to information that users enter into the system, such as names, email addresses, passwords, and celebrity profile information.

[0126] "User registration" is the process in which a user provides information such as name, email address, and password to use the system, and the system receives and stores that information.

[0127] "Profile information" refers to information necessary to generate an AI avatar, such as a celebrity's name, photo, voice sample, and biography.

[0128] An "AI avatar" is an artificially intelligent character that has the appearance, voice, and personality of a famous person, created using a generative AI model.

[0129] A "conversation session" is the process in which a user and an AI avatar communicate with each other through text and voice.

[0130] "Pricing" refers to the process by which a user selects a pricing plan when using a conversation service with an AI avatar.

[0131] "Payment processing" refers to the process of entering payment information and completing payment based on the rate plan selected by the user.

[0132] Validation is the process of ensuring that the data entered by a user into a system is accurate and meets the required format and conditions.

[0133] The "server" is the central control unit of the system, a computer device that receives and stores data from users, generates AI avatars, and manages conversation sessions.

[0134] A "generative AI model" is an artificial intelligence algorithm that generates realistic AI avatars of celebrities based on input profile information.

[0135] A "prompt" is a text or voice message that a user enters as a question or request to an AI avatar.

[0136] "Proper format" means data formatted in a way that allows the server to parse and process the data correctly.

[0137] An "initial greeting message" is the first message generated by an AI avatar and displayed to the user at the start of a conversation session.

[0138] "Response data" refers to the answers and reactions generated by an AI avatar in response to user input.

[0139] The present invention provides a system for providing a web platform that allows users to easily interact with AI avatars of celebrities. Hereinafter, the embodiments of the present invention will be described in detail.

[0140] User Registration and Authentication

[0141] A user accesses the system through a web browser and enters information such as name, email address, and password on the new registration screen. This input data is first validated on the terminal. If validation is successful, the terminal sends the data to the server, which saves it in a database. Once saving is complete, a registration success message is returned to the terminal, and the user is able to access the system.

[0142] AI avatar generation for celebrities

[0143] The user enters profile information, such as the celebrity's name, photo, voice sample, and biography, into a form within the system. The device verifies the required fields of the entered information and sends it to the server. The server analyzes the received profile information and passes it to a generative AI model. The generative AI model uses, for example, GPT-3 or a core image recognition model. The generative AI model generates a realistic AI avatar of the celebrity and stores it in a database on the server. A preview of the AI ​​avatar is returned to the device along with a message indicating generation was successful, and the user can view it.

[0144] As a specific example, if you want to generate an AI avatar for a famous person called "Taro Yamada," you can enter their name, photo, voice sample, and biography, and then check a preview of the generated avatar.

[0145] Start a conversation with an AI avatar

[0146] To converse with the generated AI avatar, the user clicks the Start Conversation button. The device sends this request to the server, which then initiates the conversation session. During this process, the AI ​​avatar generates an initial greeting message and sends it to the device. When the user responds with text or voice, the device sends the response data to the server, which analyzes the data and generates the next response. This response is then sent back to the device and displayed or played back to the user.

[0147] As an example of a specific prompt, if you ask the AI ​​avatar, "Tell me about your recent activities," the AI ​​avatar will generate an appropriate response.

[0148] Pricing and Payment

[0149] The user selects the usage time and price options on the pricing plan screen. For example, they can choose a plan such as 500 yen for 30 minutes or 1,000 yen for 1 hour. The device sends the selected plan data to the server, which calculates the fee and displays the payment page. Once the user enters their payment information and completes the payment, a confirmation of successful payment is sent to the server, and the payment data is confirmed and saved. The user can then begin using the service based on the selected plan.

[0150] For example, if a user selects a 30-minute plan and completes payment with a credit card, a payment success message will be displayed. In this way, the user can smoothly use the service through the system.

[0151] This invention is a system that allows users to interact with AI avatars of real celebrities in a variety of ways while keeping psychological and financial hurdles low.

[0152] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0153] Step 1:

[0154] A user accesses the system through a web browser and enters their name, email address, and password on the new registration screen.

[0155] Input: The user enters their name, email address, and password.

[0156] Specific operation: The user opens a browser, enters information on the registration screen, and clicks the submit button.

[0157] Step 2:

[0158] The terminal receives the data in the input form and performs validation.

[0159] Input: Name, email address, and password entered by the user.

[0160] Data processing: Check the contents of the input data on the terminal (check whether it is in the correct format).

[0161] Output: Validation result (pass / fail).

[0162] What happens: The JavaScript code on the device checks the input data and displays an error message if there is an error.

[0163] Step 3:

[0164] If the validation is successful, the terminal transmits the data to the server.

[0165] Input: Name, email address, and password data that passes validation.

[0166] Data processing: None.

[0167] Output: HTTP request (POST request) from the terminal to the server.

[0168] Specific operation: Data is sent from the terminal to the server.

[0169] Step 4:

[0170] The server stores the received registration data in a database.

[0171] Input: Name, Email Address, Password data.

[0172] Data processing: Saving to a database.

[0173] Output: User information stored in the database.

[0174] Specific operation: On the server side, the registration data is inserted into the database using an SQL query.

[0175] Step 5:

[0176] When the server has completed saving the data in the database, it returns a registration success message to the terminal.

[0177] Input: Successful result of saving to database.

[0178] Data processing: Generate a registration success message.

[0179] Output: HTTP response to the device.

[0180] Specific operation: The server sends a registration success message as an HTTP response.

[0181] Step 6:

[0182] The terminal receives a registration success message from the server and displays it to the user.

[0183] Input: Registration success message from the server.

[0184] Data processing: None.

[0185] Output: Message to display to the user.

[0186] Specific behavior: A message such as "Registration successful" will appear in the browser.

[0187] Step 7:

[0188] Users fill out a form within the system and enter profile information such as the celebrity's name (e.g., "Yamada Taro"), photo, voice sample, and biography.

[0189] Input: celebrity name, photo, voice sample, biographical data.

[0190] What happens: The user enters information in the browser and uploads photos and audio files.

[0191] Step 8:

[0192] The terminal checks the required fields of the entered information and sends it to the server.

[0193] Input: Profile information entered.

[0194] Data processing: Check required fields.

[0195] Output: Verified profile information.

[0196] Specific operation: JavaScript code on the terminal checks the required fields and sends them to the server after confirmation is complete.

[0197] Step 9:

[0198] The server analyzes the received profile information and passes it to the generative AI model.

[0199] Input: Verified profile information.

[0200] Data processing: Analyzing information and converting it into an input format for generative AI models.

[0201] Output: The input data to a generative AI model.

[0202] Specific operation: The server-side program receives the profile information and calls the AI ​​model's API.

[0203] Step 10:

[0204] The generative AI model generates a realistic AI avatar and stores it in a database on the server.

[0205] Input: Parsed profile information.

[0206] Data processing: Generation of AI avatars.

[0207] Output: Generated AI avatar data.

[0208] How it works: The generative AI model learns images and voices of celebrities, creates avatars, and stores them in a database.

[0209] Step 11:

[0210] The server returns a preview of the AI ​​avatar to the device along with a message that creation was successful.

[0211] Input: Data for the generated AI avatar.

[0212] Data processing: Generate a generation success message.

[0213] Output: HTTP response to the device.

[0214] Specific operation: The server sends a generation success message and a preview image as an HTTP response.

[0215] Step 12:

[0216] The device will display a preview of the AI ​​avatar to the user along with a message that creation was successful.

[0217] Input: A success message and a preview image from the server.

[0218] Data processing: None.

[0219] Output: Message and preview image displayed to the user.

[0220] Specific behavior: A preview of the AI ​​avatar will be displayed in the browser.

[0221] Step 13:

[0222] The user clicks the Start Conversation button to have a conversation with the generated AI avatar.

[0223] Input: User clicks.

[0224] Specific action: The user clicks the "Start conversation" button.

[0225] Step 14:

[0226] The terminal sends this request to the server, which then initiates the conversation session.

[0227] Input: A conversation initiation request.

[0228] Data processing: Initializing a conversation session.

[0229] Output: Initial message generation.

[0230] Specific operation: An HTTP request is sent from the terminal to the server, and a conversation session is prepared on the server side.

[0231] Step 15:

[0232] The server sends an initial greeting message generated by the AI ​​avatar to the device, which then displays it to the user.

[0233] Input: An initial greeting message from the AI ​​avatar.

[0234] Data processing: None.

[0235] Output: Message to display to the user.

[0236] Specific operation: The server generates an initial greeting message and sends it as an HTTP response. The device displays it in the browser.

[0237] Step 16:

[0238] When the user responds with text or voice, the terminal sends this response data to the server.

[0239] Input: User text or voice data.

[0240] What happens: The user enters text or records a voice message and clicks the send button.

[0241] Step 17:

[0242] The server analyzes the received data and generates a response for the AI ​​avatar.

[0243] Input: User text or voice data.

[0244] Data processing: data analysis, response generation.

[0245] Output: The generated response data.

[0246] How it works: On the server side, the AI ​​model analyzes the user's input and generates an appropriate response.

[0247] Step 18:

[0248] The server sends the generated response to the terminal, which displays or plays it back to the user.

[0249] Input: The generated response data.

[0250] Data processing: None.

[0251] Output: A message displayed or audio played to the user.

[0252] Specific operation: The server sends the response as an HTTP response, and the device displays it in the browser or plays it as audio.

[0253] Step 19:

[0254] Users select usage time and price options on the pricing plan screen.

[0255] Input: Price plan selection data.

[0256] Specific behavior: The user selects an option on the pricing plan screen and clicks the confirm button.

[0257] Step 20:

[0258] The terminal transmits the selected plan data to the server, which calculates the fee and displays the payment page.

[0259] Input: Selected rate plan data.

[0260] Data processing: calculation of fees.

[0261] Output: Payment page display data.

[0262] Specific operation: Fee calculation is performed on the server side, and payment page data is returned as an HTTP response.

[0263] Step 21:

[0264] The user enters payment information and completes the payment, which the terminal sends to the server.

[0265] Input: Payment information.

[0266] Specific behavior: The user enters credit card information and clicks the pay button.

[0267] Step 22:

[0268] The server verifies the payment data and returns permission to start using the service to the terminal.

[0269] Input: Payment information.

[0270] Data processing: Payment verification.

[0271] Output: Message that permission to start using is granted.

[0272] Specific operation: The payment confirmation process is performed on the server side, and a success message is returned as an HTTP response.

[0273] Step 23:

[0274] The terminal displays a payment success message to the user, and the user begins using services based on the plan.

[0275] Input: Payment success message.

[0276] Data processing: None.

[0277] Output: Message to display to the user.

[0278] Specific operation: A message such as "Payment successful" will be displayed on the browser, and the user can start using the service.

[0279] (Application example 1)

[0280] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0281] Conventional navigation and entertainment systems in autonomous vehicles have provided a poor user experience and limited interaction. Furthermore, the lack of services such as tourist information prevented the enjoyment and convenience of the ride from improving. Furthermore, the lack of a system that easily enabled interaction with celebrities prevented many users from getting an engaging experience. To address these issues, a system that enriches the user experience, enables real-time interaction, and can also provide tourist information and entertainment is needed.

[0282] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0283] In this invention, the server includes means for receiving input data from a user and performing user registration, means for generating an AI avatar based on profile information of a celebrity, means for enabling conversation with the generated AI avatar, and means for providing services such as navigation, tourist information, and entertainment within the self-driving vehicle using the generated AI avatar. This allows users to have an interactive experience within the self-driving vehicle and enjoy a service that integrates navigation, tourist information, and entertainment.

[0284] "User" refers to a person who uses this system to interact with an AI avatar or receive services within an autonomous vehicle.

[0285] "Input Data" means information, including name, email address, password, and other required details, that a User provides to the System for purposes of registration, authentication, instructions, etc.

[0286] A "celebrity" is someone who is generally well-known and recognized by many people, including famous actors, athletes, singers, etc.

[0287] "Profile Information" refers to detailed information about a celebrity, such as their name, photo, voice sample, and biography.

[0288] An "AI avatar" is an artificial intelligence model created based on the profile information of a celebrity, and refers to a virtual person who can converse and interact with users in the form of text, voice, image, video, etc.

[0289] "Navigation" refers to a service that allows users to receive route guidance to their destination in an autonomous vehicle.

[0290] "Tourist information" refers to a service that provides information about tourist spots and local areas that can be seen from an autonomous vehicle while the user is traveling.

[0291] "Entertainment" refers to services that provide entertainment such as music, video, and interaction that users can enjoy in their autonomous vehicles.

[0292] "Pricing" refers to the process or method for determining the amount a user must pay when using an AI avatar or a service within an autonomous vehicle.

[0293] "Payment Processing" refers to the process by which a User pays for the Service and the method by which such payment is verified and recorded.

[0294] To implement this invention, we provide a system that allows users to interact with AI avatars of celebrities in self-driving vehicles. Specific embodiments of this system are described below.

[0295] User Registration and Authentication

[0296] First, a user accesses the system and registers by providing input data such as name, email address, and password. The terminal validates this input data and sends it to the server in the appropriate format. The server stores the received data and returns a message to the terminal indicating successful user registration. The user can then use the system.

[0297] AI avatar generation for celebrities

[0298] The user uses a form within the system to enter profile information such as the celebrity's name, photo, voice sample, and biography. The device receives this information, checks the required fields, and then sends it to the server. The server analyzes the received information and passes it to a generative AI model to generate a realistic AI avatar of the celebrity. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device then displays a preview of the AI ​​avatar to the user along with a message of success.

[0299] Start a conversation with an AI avatar

[0300] The user clicks the Start Conversation button to have a conversation with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the AI ​​avatar, and the AI ​​avatar generates an initial greeting message. This generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data, generates a response for the AI ​​avatar, and sends it back to the device. The device displays or plays this to the user. This achieves an interactive dialogue between the user and the AI ​​avatar.

[0301] Providing services inside autonomous vehicles

[0302] Inside the autonomous vehicle, the user wears a head-mounted display and can interact with an AI avatar to receive navigation, tourist information, and entertainment services. In the navigation service, the user sets a destination and the AI ​​avatar provides directions. In addition, in the tourist information function, the AI ​​avatar provides tourist information for the areas the vehicle passes through. In the entertainment function, the AI ​​avatar provides entertainment such as music and videos to the user.

[0303] Pricing and Payment

[0304] The user operates the pricing plan screen and selects options such as usage time and price. This selection data is sent from the terminal to the server, which calculates the fee and displays the payment page on the terminal. When the user enters payment information and completes the payment, the terminal sends a confirmation to the server. The server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan.

[0305] Specific examples

[0306] For example, if a user generates an AI avatar of a famous actor and asks the AI ​​avatar to navigate to "Tokyo Tower" in a self-driving vehicle, the AI ​​avatar will begin providing directions and information about tourist spots they will pass along the way. Entertainment features such as playing favorite music to make the journey more comfortable are also provided. An example of a prompt sentence would be "generate ai avatar for celebrity actor with bio..." and the generative AI model would be able to generate an actor's avatar.

[0307] This system will further enrich the user experience, making travel time in an autonomous vehicle more comfortable and meaningful.

[0308] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0309] Step 1:

[0310] A user accesses the system and registers by entering their name, email address, and password. The terminal receives this input data and performs validation. Once validation is complete, the terminal sends the data to the server. The server stores the received data and returns a message to the terminal indicating successful user registration. The input for this step is the name, email address, and password, and the output is a message indicating successful user registration.

[0311] Step 2:

[0312] The user enters the celebrity's profile information, such as their name, photo, voice sample, and biography, into a form within the system. The device receives this information, checks the required fields, and then sends it to the server. The server analyzes the received information and passes it to a generative AI model to generate a realistic AI avatar of the celebrity. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device then displays a preview of the AI ​​avatar to the user along with a message of success. The input of this step is the celebrity's profile information, and the output is a preview of the generated AI avatar.

[0313] Step 3:

[0314] The user clicks the Start Conversation button to have a conversation with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the AI ​​avatar, and the AI ​​avatar generates an initial greeting message. This generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data and generates a response for the AI ​​avatar, which is sent back to the device. The device displays or plays this to the user. The input of this step is the user's response, and the output is the AI ​​avatar's response.

[0315] Step 4:

[0316] Inside the autonomous vehicle, the user wears a head-mounted display and receives navigation, tourist information, and entertainment services through interactions with an AI avatar. When the user sets a destination, the device sends this information to the server. The server calculates a navigation route based on the destination and has the AI ​​avatar provide directions. The tourist information function also generates tourist information for the areas the vehicle passes through, which the AI ​​avatar provides to the user. For the entertainment function, the server plays selected music and video content. The inputs to this step are the destination setting and entertainment selection, and the outputs are route information, tourist information, and entertainment content.

[0317] Step 5:

[0318] The user operates the pricing plan screen and selects options such as usage time and price. This selection data is sent from the terminal to the server, which calculates the fee and then displays the payment page on the terminal. When the user enters payment information and completes the payment, the terminal sends a confirmation to the server. The server verifies and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan. The input to this step is the pricing plan selection data and payment information, and the output is a payment success message.

[0319] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0320] This invention provides a B2C web platform that allows users to easily interact with AI avatars of celebrities. In particular, this system is equipped with an emotion engine that recognizes users' emotions and can generate responses according to the user's emotions. Specific embodiments of this system are described below.

[0321] User Registration and Authentication

[0322] A user first accesses the system and enters information such as name, email address, and password on the new registration screen. The terminal receives this input data and validates that all required fields have been entered. Once validation is complete, the terminal sends the data to the server. The server stores the received data and returns a registration success message to the terminal. This registers the user in the system and they can begin using it.

[0323] AI avatar generation for celebrities

[0324] The user enters the celebrity's profile information, such as their name, photo, voice sample, and biography, into a form within the system. The device receives this information and validates it for completeness. After validation, the device sends this data to the server. The server analyzes the received information and passes it to the AI ​​generation model. The AI ​​generation model generates a realistic AI avatar of the celebrity. This avatar can respond in the form of text, voice, image, or video. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device displays a preview of the AI ​​avatar to the user along with a message of success.

[0325] Start a conversation with an AI avatar

[0326] The user clicks the Start Conversation button to converse with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the selected AI avatar and generates an initial greeting message. The generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data and generates a response for the AI ​​avatar. This response is sent back to the device, which displays or plays it back to the user. This achieves an interactive conversation between the user and the AI ​​avatar.

[0327] Emotion Engine Operation

[0328] The system is equipped with an emotion engine that recognizes the user's emotions. When the user provides input in the form of text, voice, image, or video, the device sends this data to the emotion engine. The emotion engine analyzes the input data and recognizes the user's emotional state. For example, it identifies emotions such as "happy" if the user is happy, or "sad" if the user is sad. The emotion engine then sends the recognized emotion data to the server. The server generates a response for the AI ​​avatar based on the emotion data, and the response is delivered in a content and tone that matches the user's emotion.

[0329] Pricing and Payment

[0330] The user operates the pricing plan screen and selects the usage time and price options. For example, plans include 30 minutes for 500 yen or 1 hour for 1,000 yen. The terminal sends the selected data to the server. The server calculates the fee and displays the payment page on the terminal. When the user enters the payment information and completes the payment, the terminal sends confirmation to the server. The server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan.

[0331] Specific examples

[0332] For example, suppose a user registers in the system under the name "Yamada Taro" and generates an AI avatar of a celebrity named "Tanaka Minako." The user enters their profile information and checks a preview of the generated avatar. Next, after selecting a pricing plan and completing payment, a conversation with Tanaka Minako's AI avatar begins. The user asks questions via text or voice, and the AI ​​avatar responds individually. Furthermore, the emotion engine recognizes the user's emotions based on their input and generates responses accordingly, resulting in a more intimate and adapted conversation. In this way, users can easily enjoy interactive interactions with celebrities.

[0333] The embodiments of the present invention allow users to interact with realistic AI avatars of celebrities in a variety of ways, while keeping psychological and economic hurdles low, and receiving responses that correspond to their emotions.

[0334] The processing flow will be explained below.

[0335] User Registration and Authentication

[0336] Step 1:

[0337] The user accesses the new registration screen and enters registration information such as name, email address, and password.

[0338] Step 2:

[0339] The terminal receives the entered information and validates that all required fields have been entered.

[0340] Step 3:

[0341] The terminal sends the data that has passed validation to the server.

[0342] Step 4:

[0343] The server receives the submitted data and creates a new user record in the database.

[0344] Step 5:

[0345] The server returns a successful response to the terminal.

[0346] Step 6:

[0347] The terminal receives the response and displays a "Registration successful" message to the user.

[0348] AI avatar generation for celebrities

[0349] Step 1:

[0350] A user enters profile information such as the celebrity's name, photo, voice sample, and biography.

[0351] Step 2:

[0352] The terminal receives the entered information and validates it to ensure there are no missing details.

[0353] Step 3:

[0354] The device sends the validated data to the server.

[0355] Step 4:

[0356] The server analyzes the received data and passes it to the AI ​​generation model.

[0357] Step 5:

[0358] The server's AI generative model uses the data to generate an AI avatar of the celebrity, which can respond in the form of text, voice, images, and video.

[0359] Step 6:

[0360] The server stores the generated AI avatar in a database and returns a response indicating successful generation to the device.

[0361] Step 7:

[0362] The device receives the response and displays a preview of the generated AI avatar to the user.

[0363] Start a conversation with an AI avatar

[0364] Step 1:

[0365] The user selects the AI ​​avatar they want to talk to and clicks the Start Conversation button.

[0366] Step 2:

[0367] The terminal sends a conversation initiation request to the server.

[0368] Step 3:

[0369] The server creates a conversation session with the selected AI avatar and generates an initial greeting message.

[0370] Step 4:

[0371] The server sends the generated initial message to the terminal.

[0372] Step 5:

[0373] The terminal displays a welcome message to the user.

[0374] Step 6:

[0375] The user enters a response by text or voice.

[0376] Step 7:

[0377] The terminal sends the user's input to the server.

[0378] Step 8:

[0379] The server analyzes the user's input data, and the emotion engine recognizes the user's emotions.

[0380] Step 9:

[0381] The emotion engine sends the emotion data to the server, which processes it so that the AI ​​avatar can generate a response according to the emotion.

[0382] Step 10:

[0383] The server sends the generated AI avatar's response to the device.

[0384] Step 11:

[0385] The terminal receives the response and displays or plays it back to the user, and this process is repeated to continue the interactive conversation.

[0386] Pricing and Payment

[0387] Step 1:

[0388] The user accesses the pricing plan screen and sees the available time and price options.

[0389] Step 2:

[0390] The user selects the plan they want and enters their payment information.

[0391] Step 3:

[0392] The terminal sends the selected plan and payment information to the server.

[0393] Step 4:

[0394] The server receives the transmitted data and executes the payment process in cooperation with the payment system.

[0395] Step 5:

[0396] The server checks the result of the payment process and returns a success or failure response to the terminal.

[0397] Step 6:

[0398] The terminal receives the result of the payment process and displays a message to the user saying "Payment completed." If the payment is successful, a message also appears stating that the user is authorized to start using the service.

[0399] Specific examples

[0400] Step 1:

[0401] For example, when a user registers a new account under the name "Yamada Taro," the steps of user registration and authentication are executed in order.

[0402] Step 2:

[0403] After completing registration, the user wants to generate an AI avatar for a celebrity named "Minako Tanaka." To do this, the user enters the celebrity's profile information into a form and executes the steps to generate the celebrity's AI avatar.

[0404] Step 3:

[0405] After the AI ​​avatar is generated and the user checks its preview, the user executes a series of steps to start a conversation with the AI ​​avatar, including a procedure in which the emotion engine recognizes the emotion when the user provides emotional input and generates an adapted response.

[0406] Step 4:

[0407] After the conversation ends, the user performs the steps of setting the price and paying for the usage time. Once payment is completed based on the selected plan, the system usage is officially terminated.

[0408] In this way, users can not only easily enjoy interactive conversations with AI avatars of celebrities, but also experience more intimate and adapted interactions by receiving responses based on their emotions.

[0409] Example 2

[0410] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0411] In recent years, advances in AI technology have led to an increasing demand for interactive dialogue systems. However, conventional dialogue systems often lack the ability to fully recognize user emotions and generate appropriate responses. As a result, they can only provide one-way information to users, resulting in a poor user experience. Furthermore, real-time responses are difficult to make for pricing and payment processing, requiring cumbersome procedures for users. To solve these problems, a system capable of recognizing user emotions in real time and generating adaptive responses is needed.

[0412] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0413] In this invention, the server includes means for receiving input data from a user and performing user registration, means for generating an AI avatar based on profile information of a celebrity, means for enabling conversation with the generated AI avatar, means for transmitting the input data to an emotion engine and recognizing the user's emotions, means for generating a response from the AI ​​avatar based on the recognized emotion data, and means for setting fees according to usage and performing payment processing.

[0414] This allows users to receive real-time emotional responses when using the system, resulting in a more personalized and interactive experience, as well as simplified pricing and payment processing, improving the user experience.

[0415] A "user" is a person who uses the system to register, interact, make payments, and perform other operations.

[0416] "Input Data" refers to information provided by a user to the system, including names, email addresses, passwords, celebrity profile information, text, audio, images, and video.

[0417] "Validation" is the process of checking whether the data entered by the user meets the system requirements.

[0418] The "server" is the central computer in the system that receives, stores, analyzes, and generates AI avatars from data entered by users.

[0419] A "terminal" is a device that a user uses to access the system and input and display data, including a PC, smartphone, tablet, etc.

[0420] An "AI avatar" is a virtual presence generated based on a celebrity's profile information and can respond to users in the form of text, voice, image, and / or video.

[0421] An "emotion engine" is a software component that analyzes user input data and recognizes the user's emotional state.

[0422] "Pricing" is the process of determining the time and price plan a user may select to use the system.

[0423] "Payment processing" refers to the process in which a user enters payment information based on the selected fee plan and actually pays the fee.

[0424] "Profile Information" is information associated with a public figure, such as name, photograph, voice sample, and biography.

[0425] A "generative AI model" is an artificial intelligence algorithm for generating AI avatars based on input data.

[0426] A "response" is a reply message generated by an AI avatar in response to user input, and can include text, audio, images, and video.

[0427] This invention provides a web platform that allows users to easily interact with AI avatars of celebrities. In particular, it is equipped with an emotion engine that can generate responses according to the user's emotions.

[0428] Overall system configuration

[0429] The system mainly includes the following components:

[0430] 1. User's device: a device such as a computer, smartphone, or tablet.

[0431] 2. Server: The central computer that stores and analyzes input data, generates AI avatars, and runs the emotion engine.

[0432] 3. Emotion Engine: A software component that recognizes the user's emotional state and generates a response based on it.

[0433] 4. Generative AI model: An artificial intelligence algorithm that generates AI avatars based on celebrity profile information.

[0434] User Registration and Authentication

[0435] 1. The user accesses the system and enters their name, email address, password, etc. on the new registration screen.

[0436] 2. The terminal receives the input data and validates that all required fields are entered.

[0437] 3. Once the validation is complete, the device sends the data to the server.

[0438] 4. The server stores the received data and returns a registration success message to the terminal.

[0439] 5. The terminal displays a registration success message to the user.

[0440] AI avatar generation for celebrities

[0441] 1. Users enter profile information such as the celebrity's name, photo, voice sample, and biography into a form within the system.

[0442] 2. The terminal receives this information and validates the input for any missing information.

[0443] 3. The device sends the data to the server.

[0444] 4. The server analyzes the received information and passes it to the generative AI model.

[0445] 5. The generative AI model generates realistic AI avatars of celebrities and stores them in a database.

[0446] 6. The server returns a creation success message to the terminal.

[0447] 7. The device will display a preview of the AI ​​avatar to the user along with a message that creation was successful.

[0448] Start a conversation with an AI avatar

[0449] 1. The user clicks the Start Conversation button to begin a conversation with the generated AI avatar.

[0450] 2. The device sends a request to the server.

[0451] 3. The server initiates a conversation session with the selected AI avatar and generates an initial greeting message and sends it to the device.

[0452] 4. The terminal displays an initial greeting message to the user.

[0453] 5. When the user responds with text or voice, the device sends this to the server.

[0454] 6. The server analyzes the data and generates a response for the AI ​​avatar.

[0455] 7. The server sends the response to the terminal, which displays or plays it back to the user.

[0456] Emotion Engine Operation

[0457] 1. When the user provides input in the form of text, voice, image, or video, the device sends this to the emotion engine.

[0458] 2. The emotion engine analyzes the input data and recognizes the user's emotional state.

[0459] 3. The emotion engine sends the recognized emotion data to the server.

[0460] 4. The server generates a response for the AI ​​avatar based on the emotion data.

[0461] 5. The server provides a response with content and tone that matches the user's emotions.

[0462] Pricing and Payment

[0463] 1. The user navigates to the pricing plan screen and selects usage time and price options.

[0464] 2. The device sends the selection data to the server.

[0465] 3. The server calculates the fee and displays the payment page on the terminal.

[0466] 4. Once the user enters their payment information and completes the payment, the terminal sends a confirmation to the server.

[0467] 5. The server confirms and saves the payment data and returns permission to start using the service to the device.

[0468] 6. The terminal will display a message that the payment was successful.

[0469] Specific examples

[0470] For example, suppose a user registers with the system under the name "Yamada Taro" and generates an AI avatar of a famous person named "Tanaka Minako." After selecting a pricing plan and completing payment, a conversation with Tanaka Minako's AI avatar begins. The user asks questions via text or voice, and the AI ​​avatar responds individually. Furthermore, the emotion engine recognizes the user's emotions based on their input and generates responses accordingly, resulting in a more intimate and adapted conversation.

[0471] Example prompt:

[0472] User: I want to register in the system

[0473] Device: Display new registration screen

[0474] User: Enter your name, email address, and password

[0475] Device: Sends data to server

[0476] Server: Saves the data and returns a registration success message to the device.

[0477] Device: Display a registration success message to the user

[0478] This embodiment of the present invention allows users to easily interact with realistic AI avatars of celebrities while minimizing psychological and economic barriers, and the emotion recognition function allows users to receive more personalized responses.

[0479] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0480] User Registration and Authentication

[0481] Step 1:

[0482] The user accesses the system and enters information such as name, email address, and password on the new registration screen.

[0483] Input: Name, Email Address, Password

[0484] Output: Input data

[0485] Step 2:

[0486] The terminal receives the entered data and validates that all required fields have been entered.

[0487] Input: Input data

[0488] Output: Validation result (success / failure)

[0489] Behavior: Checks whether the entered data is in the correct format.

[0490] Step 3:

[0491] Once the validation is complete, the terminal sends the data to the server.

[0492] Input: Data that has been successfully validated

[0493] Output: Data sent to the server

[0494] Step 4:

[0495] The server stores the received data and returns a registration success message to the terminal.

[0496] Input: Data sent to the server

[0497] Output: Registration successful message

[0498] What it does: Saves user information in a database.

[0499] Step 5:

[0500] The terminal displays a registration successful message to the user.

[0501] Input: Registration success message

[0502] Output: Shown to the user

[0503] AI avatar generation for celebrities

[0504] Step 1:

[0505] Users fill out a form within the system to enter profile information such as the celebrity's name, photo, voice sample, and biography.

[0506] Input: celebrity name, photo, voice sample, biography

[0507] Output: Input data

[0508] Step 2:

[0509] The terminal receives this information and validates the input for any missing information.

[0510] Input: Input data

[0511] Output: Validation result (success / failure)

[0512] Behavior: Checks whether all the input data is present.

[0513] Step 3:

[0514] The terminal transmits the data to the server.

[0515] Input: Data that has been successfully validated

[0516] Output: Data sent to the server

[0517] Step 4:

[0518] The server analyzes the received information and passes it to the generative AI model.

[0519] Input: Data sent to the server

[0520] Output: Input data to a generative AI model

[0521] Step 5:

[0522] The generative AI model generates realistic AI avatars of celebrities and stores them in a database.

[0523] Input: Input data to the generative AI model

[0524] Output: Generated AI avatar

[0525] Operation: Analyze using a model and generate an AI avatar.

[0526] Step 6:

[0527] The server returns a creation success message to the terminal.

[0528] Input: Generated AI avatar

[0529] Output: Creation successful message

[0530] Step 7:

[0531] The device will display a preview of the AI ​​avatar to the user along with a message that creation was successful.

[0532] Input: Generation success message, AI avatar preview

[0533] Output: Shown to the user

[0534] Start a conversation with an AI avatar

[0535] Step 1:

[0536] The user clicks the Start Conversation button to begin a conversation with the generated AI avatar.

[0537] Input: Click the Start Conversation button

[0538] Output: Conversation start request

[0539] Step 2:

[0540] The terminal sends a request to the server.

[0541] Input: Conversation start request

[0542] Output: Request sent to the server

[0543] Step 3:

[0544] The server initiates a conversation session with the selected AI avatar and generates an initial greeting message to send to the device.

[0545] Input: Conversation start request

[0546] Output: Initial greeting message

[0547] What it does: Manages the session and generates the initial message.

[0548] Step 4:

[0549] The terminal displays an initial greeting message to the user.

[0550] Input: Initial greeting message

[0551] Output: Shown to the user

[0552] Step 5:

[0553] When the user responds with text or voice, the device sends this to the server.

[0554] Input: Text or voice response

[0555] Output: Response data sent to the server

[0556] Step 6:

[0557] The server analyzes the data and generates a response for the AI ​​avatar.

[0558] Input: User response data

[0559] Output: The generated AI avatar's response

[0560] Behavior: Analyzes the received data and generates an appropriate response.

[0561] Step 7:

[0562] The server sends the response to the terminal, which displays or plays it back to the user.

[0563] Input: The response of the generated AI avatar

[0564] Output: Show or play to the user

[0565] Emotion Engine Operation

[0566] Step 1:

[0567] The user provides input in the form of text, audio, images, or video.

[0568] Input: Text, audio, image, and video input

[0569] Output: Input data

[0570] Step 2:

[0571] The device sends this data to the emotion engine.

[0572] Input: Input data

[0573] Output: Input data to the emotion engine

[0574] Step 3:

[0575] The emotion engine analyzes the input data and recognizes the user's emotional state.

[0576] Input: Input data to the emotion engine

[0577] Output: Recognized emotion data

[0578] How it works: Input data is analyzed using emotion recognition algorithms.

[0579] Step 4:

[0580] The emotion engine sends the recognized emotion data to the server.

[0581] Input: Recognized emotion data

[0582] Output: Emotion data sent to the server

[0583] Step 5:

[0584] The server generates responses for the AI ​​avatar based on the emotional data.

[0585] Input: Emotion data sent to the server

[0586] Output: Emotion-adapted AI avatar responses

[0587] Action: Generate a response based on the emotion data.

[0588] Step 6:

[0589] The server provides a response with content and tone that matches the user's emotions.

[0590] Input: Emotion-adaptive AI avatar responses

[0591] Output: Show or play to the user

[0592] Pricing and Payment

[0593] Step 1:

[0594] Users navigate through the pricing plan screen and select usage time and price options.

[0595] Input: Time and price options

[0596] Output: Selected data

[0597] Step 2:

[0598] The terminal transmits the selection data to the server.

[0599] Input:Selection data

[0600] Output: Data sent to the server

[0601] Step 3:

[0602] The server performs the billing calculation.

[0603] Input: Data sent to the server

[0604] Output: Charge calculation results

[0605] How it works: Calculates charges based on time and price.

[0606] Step 4:

[0607] The server displays a payment page on the terminal.

[0608] Input: Fee calculation result

[0609] Output: Payment page

[0610] Step 5:

[0611] The user enters payment information and completes the payment.

[0612] Input: Payment information

[0613] Output: Payment completion data

[0614] Step 6:

[0615] The terminal sends a confirmation to the server.

[0616] Input: Payment completion data

[0617] Output: Payment confirmation request

[0618] Step 7:

[0619] The server verifies and stores the payment data.

[0620] Input: Payment confirmation request

[0621] Output: Confirmation completed message

[0622] What it does: Stores and verifies payment data.

[0623] Step 8:

[0624] The server returns permission to start using the device.

[0625] Input: Confirmation completion message

[0626] Output: Permission to start using

[0627] Step 9:

[0628] The terminal will display a message that the payment was successful.

[0629] Input: Permission to start using

[0630] Output: Payment successful message

[0631] (Application example 2)

[0632] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0633] Modern factories require efficient sharing of skills among technicians and engineers and rapid problem-solving. However, receiving real-time on-site training is difficult, posing a significant barrier, especially for new or inexperienced staff. Furthermore, there is a lack of emotion-based feedback, which creates challenges in terms of work efficiency and mental health. Therefore, there is a need for a system that provides technical assistance and appropriate feedback through emotion recognition within factories.

[0634] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means including an emotion engine that analyzes voice data from factory staff and robots, means for generating a response of an AI avatar based on the analysis results of the emotion engine, and means for generating an AI avatar based on the profile information of the engineer. This allows for real-time technical support and feedback according to the staff's emotions.

[0635] "User" means any person or entity that registers, accesses, and operates using the System.

[0636] "Input data" refers to information such as text, audio, images, or video that a user provides to a system.

[0637] "User registration" is the process by which a new user enters their information into the system and obtains the right to use the system.

[0638] An "engineer" is an individual who has a high level of expertise or skill in a particular field.

[0639] "Profile Information" is individual information that may include a person's name, photo, voice sample, biography, etc.

[0640] An "AI avatar" is a digital character that resembles a specific person and is generated using AI technology.

[0641] A "conversation" is an interaction between a user and an AI avatar via text, voice, images, or video.

[0642] "Pricing" is the process of determining the costs and plans required to use the system.

[0643] "Payment processing" refers to the procedures and operations required for users to pay system usage fees.

[0644] An "emotion engine" is an AI technology that analyzes user input data and identifies their emotional state.

[0645] "Analysis" is the process of examining input data in detail and understanding its content and meaning.

[0646] "Generating a response" is the process by which a system creates an appropriate reply to input from a user.

[0647] "Factory staff" refers to employees and personnel working on the manufacturing floor.

[0648] A "robot" is an automated mechanical device that is programmed to perform specific tasks.

[0649] A "server" is a computer system that stores, processes data, and provides services to other devices on a network.

[0650] A system for realizing this invention will now be described in detail. The system is composed of a series of components including a user, a terminal, a server, and an AI avatar.

[0651] First, a user uses a terminal to register and access the system. The terminal receives input data (e.g., name, email address, password), validates them, and sends them to the server. The server stores the received data and sends a registration success message to the terminal.

[0652] The next phase is to generate an AI avatar based on the engineer's profile information. The user enters the person's name, photo, voice sample, and career information into a form on the device. The device checks for missing information and sends it to the server. The server analyzes the information and generates an AI avatar based on a generative AI model (e.g., GPT-4). This AI avatar can respond in the form of text, voice, image, or video. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device displays a preview of the AI ​​avatar to the user along with a message of success.

[0653] The user can have an interactive conversation with the generated AI avatar. When the user clicks the conversation start button on the device, the device sends a request to the server. The server starts the conversation session, generates an initial greeting message, and sends it to the device. The user's text and voice responses are sent from the device to the server, and the server generates responses for the AI ​​avatar and sends them back to the device.

[0654] Furthermore, the system incorporates an emotion engine that recognizes emotions from user input data. It identifies the emotional state (e.g., "joy" or "sadness") and transmits it to the server. The server then generates a response for the AI ​​avatar based on the emotional data, providing appropriate feedback according to the user's emotions.

[0655] When installed on factory staff and robots, this system can also be used as a tool to improve factory work efficiency. Factory staff can talk to an AI avatar of a technician in real time through smart glasses or a robot and receive technical support. This is expected to help solve problems during production and improve efficiency.

[0656] Specific examples

[0657] When a factory line engineer needs to fix a malfunction in the electrical system, he calls up an AI avatar of "Technician A" through smart glasses. The interaction goes as follows:

[0658] Engineer: "Technician A, the light switch isn't working. What should I do?"

[0659] Technician A AI: "Check the circuit first. Don't worry, you can do it."

[0660] Prompt Sentence Examples

[0661] If an electrical system malfunction occurs on a factory production line, provide advice on how to troubleshoot the circuit, including encouraging impatient engineers to stay calm.

[0662] This allows the invention to provide real-time technical assistance and emotion-recognition-based feedback to prioritize and improve efficiency and effectiveness in factories and other workplaces.

[0663] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0664] Step 1:

[0665] The server receives input data from the user (name, email address, password). The device validates this data, ensuring all required fields are filled in, and sends the data to the server. The server stores the data and returns a registration success message to the device.

[0666] Step 2:

[0667] The user uses the device to input the technician's profile information (name, photo, voice sample, and resume). The device receives this information, validates it for any missing information, and then sends the data to the server. The server analyzes the received data and generates an AI avatar using a generative AI model.

[0668] Step 3:

[0669] The server saves the generated AI avatar in a database and returns a preview of the AI ​​avatar along with a message confirming the creation to the device. The device displays this preview to the user, who can then click the Start Conversation button to begin the conversation.

[0670] Step 4:

[0671] The device sends the user's conversation start request to the server, which starts a conversation session between the AI ​​avatar and the user, generates an initial greeting message, and sends it to the device, which then displays the greeting message to the user.

[0672] Step 5:

[0673] The user enters a response via text or voice, and the device sends this response data to the server, which analyzes the data and generates a response from the AI ​​avatar. This response is then sent back to the device, which displays or plays it back to the user.

[0674] Step 6:

[0675] The device sends the user's input data (text, voice, image, video) to the emotion engine, which analyzes this data and recognizes the emotional state (e.g., "joy," "sadness," etc.). The emotional data is then sent to the server.

[0676] Step 7:

[0677] The server generates a response from the AI ​​avatar based on the emotional data received from the emotion engine. This response is created with content and tone that matches the user's emotion and is sent to the device. The device then displays or plays the response to the user based on this emotion.

[0678] Step 8:

[0679] The user selects a pricing plan and enters payment information through the terminal. The terminal sends this data to the server. The server calculates the fee and generates a payment page that is displayed on the terminal. Once the user completes the payment, the server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user indicating that payment was successful, and the user can begin using the service based on the selected plan.

[0680] This completes the entire processing flow, and the interactive conversation between the user and the AI ​​avatar continues.

[0681] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0682] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0683] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0684] [Second embodiment]

[0685] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0686] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0687] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0688] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0689] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0690] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0691] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0692] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0693] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0694] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0695] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0696] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0697] This invention provides a B2C web platform that allows users to easily interact with AI avatars of celebrities. This system allows users to easily converse with AI avatars of celebrities and offers flexibility in terms of time and price. Specific embodiments of this system are described below.

[0698] User Registration and Authentication

[0699] A user first accesses the system and enters information such as name, email address, and password on the new registration screen. The terminal receives this input data and performs validation. Once validation is complete, the terminal sends the data to the server. The server stores the received data and returns a registration success message to the terminal. This registers the user in the system and they can begin using it.

[0700] AI avatar generation for celebrities

[0701] The user enters the celebrity's profile information, such as their name, photo, voice sample, and biography, into a form within the system. The device receives this information and verifies the required fields. After verification, the device sends this data to the server. The server analyzes the received information and passes it to the AI ​​generation model. The AI ​​generation model generates a realistic AI avatar of the celebrity. This avatar is designed to respond in the form of text, voice, image, or video. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device displays a preview of the AI ​​avatar to the user along with a message of success.

[0702] Start a conversation with an AI avatar

[0703] The user clicks the Start Conversation button to converse with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the AI ​​avatar, and the AI ​​avatar generates an initial greeting message. The generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data and generates a response for the AI ​​avatar. This response is sent back to the device, which displays or plays it back to the user. This achieves an interactive conversation between the user and the AI ​​avatar.

[0704] Pricing and Payment

[0705] The user operates the pricing plan screen and selects the usage time and price options. For example, plans include 30 minutes for 500 yen or 1 hour for 1,000 yen. The terminal sends the selected data to the server. The server calculates the fee and displays the payment page on the terminal. When the user enters the payment information and completes the payment, the terminal sends confirmation to the server. The server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan.

[0706] Specific examples

[0707] For example, suppose a user registers in the system under the name "Yamada Taro" and generates an AI avatar of a famous person named "Tanaka Minako." The user enters their profile information and checks a preview of the generated avatar. Next, after selecting a pricing plan and completing payment, a conversation with Tanaka Minako's AI avatar begins. The user asks questions via text or voice, and the AI ​​avatar responds individually to them. In this way, users can easily enjoy interactive interactions with famous people.

[0708] The embodiments of the present invention allow users to interact with real AI avatars of celebrities in a variety of ways while keeping psychological and economic hurdles low.

[0709] The processing flow will be explained below.

[0710] User Registration and Authentication

[0711] Step 1:

[0712] The user accesses the new registration screen and enters registration information such as name, email address, and password.

[0713] Step 2:

[0714] The terminal receives the entered information and validates that all required fields have been entered.

[0715] Step 3:

[0716] The terminal sends the data that has passed validation to the server.

[0717] Step 4:

[0718] The server receives the submitted data and creates a new user record in the database.

[0719] Step 5:

[0720] The server returns a successful response to the terminal.

[0721] Step 6:

[0722] The terminal receives the response and displays a "Registration successful" message to the user.

[0723] AI avatar generation for celebrities

[0724] Step 1:

[0725] A user enters profile information such as the celebrity's name, photo, voice sample, and biography.

[0726] Step 2:

[0727] The terminal receives the entered information and validates it to ensure there are no missing details.

[0728] Step 3:

[0729] The device sends the validated data to the server.

[0730] Step 4:

[0731] The server analyzes the received data and passes it to the AI ​​generation model.

[0732] Step 5:

[0733] The server's AI generative model uses the data to generate an AI avatar of the celebrity, which can respond in the form of text, voice, images, and video.

[0734] Step 6:

[0735] The server stores the generated AI avatar in a database and returns a response indicating successful generation to the device.

[0736] Step 7:

[0737] The device receives the response and displays a preview of the generated AI avatar to the user.

[0738] Start a conversation with an AI avatar

[0739] Step 1:

[0740] The user selects the AI ​​avatar they want to talk to and clicks the Start Conversation button.

[0741] Step 2:

[0742] The terminal sends a conversation initiation request to the server.

[0743] Step 3:

[0744] The server creates a conversation session with the selected AI avatar and generates an initial greeting message.

[0745] Step 4:

[0746] The server sends the generated initial message to the terminal.

[0747] Step 5:

[0748] The terminal displays a welcome message to the user.

[0749] Step 6:

[0750] The user enters a response by text or voice.

[0751] Step 7:

[0752] The terminal sends the user's input to the server.

[0753] Step 8:

[0754] The server receives the user's input data and processes it to generate a response from the AI ​​avatar.

[0755] Step 9:

[0756] The server sends the generated AI avatar's response to the device.

[0757] Step 10:

[0758] The terminal receives the response and displays or plays it back to the user, and this process is repeated to continue the interactive conversation.

[0759] Pricing and Payment

[0760] Step 1:

[0761] The user accesses the pricing plan screen and sees the available time and price options.

[0762] Step 2:

[0763] The user selects the plan they want and enters their payment information.

[0764] Step 3:

[0765] The terminal sends the selected plan and payment information to the server.

[0766] Step 4:

[0767] The server receives the transmitted data and executes the payment process in cooperation with the payment system.

[0768] Step 5:

[0769] The server checks the result of the payment process and returns a success or failure response to the terminal.

[0770] Step 6:

[0771] The terminal receives the result of the payment process and displays a message to the user saying "Payment completed." If the payment is successful, a message also appears stating that the user is authorized to start using the service.

[0772] Example 1

[0773] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0774] Although systems exist that allow users to easily interact with celebrity avatars, the process of user registration, entering profile information, and starting a conversation is cumbersome, and the pricing and payment processes are also complicated, making it difficult for users to use. Another problem is that the process for generating AI avatars is unclear, and the quality of responses cannot be guaranteed. It is necessary to resolve these issues and enable users to use the system intuitively and smoothly.

[0775] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0776] In this invention, the server includes means for receiving input data from a user and performing user registration, means for generating an AI avatar based on the celebrity's profile information, means for enabling conversation with the generated AI avatar, means for setting fees according to usage and processing payments, means for validating the input data and transmitting it to the server in an appropriate format, means for starting a conversation session and generating an initial greeting message, and means for analyzing the user's response data and generating a response for the AI ​​avatar. This allows users to easily use the system and smoothly interact with the celebrity's AI avatar.

[0777] "Input data" refers to information that users enter into the system, such as names, email addresses, passwords, and celebrity profile information.

[0778] "User registration" is the process in which a user provides information such as name, email address, and password to use the system, and the system receives and stores that information.

[0779] "Profile information" refers to information necessary to generate an AI avatar, such as a celebrity's name, photo, voice sample, and biography.

[0780] An "AI avatar" is an artificially intelligent character that has the appearance, voice, and personality of a famous person, created using a generative AI model.

[0781] A "conversation session" is the process in which a user and an AI avatar communicate with each other through text and voice.

[0782] "Pricing" refers to the process by which a user selects a pricing plan when using a conversation service with an AI avatar.

[0783] "Payment processing" refers to the process of entering payment information and completing payment based on the rate plan selected by the user.

[0784] Validation is the process of ensuring that the data entered by a user into a system is accurate and meets the required format and conditions.

[0785] The "server" is the central control unit of the system, a computer device that receives and stores data from users, generates AI avatars, and manages conversation sessions.

[0786] A "generative AI model" is an artificial intelligence algorithm that generates realistic AI avatars of celebrities based on input profile information.

[0787] A "prompt" is a text or voice message that a user enters as a question or request to an AI avatar.

[0788] "Proper format" means data formatted in a way that allows the server to parse and process the data correctly.

[0789] An "initial greeting message" is the first message generated by an AI avatar and displayed to the user at the start of a conversation session.

[0790] "Response data" refers to the answers and reactions generated by an AI avatar in response to user input.

[0791] The present invention provides a system for providing a web platform that allows users to easily interact with AI avatars of celebrities. Hereinafter, the embodiments of the present invention will be described in detail.

[0792] User Registration and Authentication

[0793] A user accesses the system through a web browser and enters information such as name, email address, and password on the new registration screen. This input data is first validated on the terminal. If validation is successful, the terminal sends the data to the server, which saves it in a database. Once saving is complete, a registration success message is returned to the terminal, and the user is able to access the system.

[0794] AI avatar generation for celebrities

[0795] The user enters profile information, such as the celebrity's name, photo, voice sample, and biography, into a form within the system. The device verifies the required fields of the entered information and sends it to the server. The server analyzes the received profile information and passes it to a generative AI model. The generative AI model uses, for example, GPT-3 or a core image recognition model. The generative AI model generates a realistic AI avatar of the celebrity and stores it in a database on the server. A preview of the AI ​​avatar is returned to the device along with a message indicating generation was successful, and the user can view it.

[0796] As a specific example, if you want to generate an AI avatar for a famous person called "Taro Yamada," you can enter their name, photo, voice sample, and biography, and then check a preview of the generated avatar.

[0797] Start a conversation with an AI avatar

[0798] To converse with the generated AI avatar, the user clicks the Start Conversation button. The device sends this request to the server, which then initiates the conversation session. During this process, the AI ​​avatar generates an initial greeting message and sends it to the device. When the user responds with text or voice, the device sends the response data to the server, which analyzes the data and generates the next response. This response is then sent back to the device and displayed or played back to the user.

[0799] As an example of a specific prompt, if you ask the AI ​​avatar, "Tell me about your recent activities," the AI ​​avatar will generate an appropriate response.

[0800] Pricing and Payment

[0801] The user selects the usage time and price options on the pricing plan screen. For example, they can choose a plan such as 500 yen for 30 minutes or 1,000 yen for 1 hour. The device sends the selected plan data to the server, which calculates the fee and displays the payment page. Once the user enters their payment information and completes the payment, a confirmation of successful payment is sent to the server, and the payment data is confirmed and saved. The user can then begin using the service based on the selected plan.

[0802] For example, if a user selects a 30-minute plan and completes payment with a credit card, a payment success message will be displayed. In this way, the user can smoothly use the service through the system.

[0803] This invention is a system that allows users to interact with AI avatars of real celebrities in a variety of ways while keeping psychological and financial hurdles low.

[0804] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0805] Step 1:

[0806] A user accesses the system through a web browser and enters their name, email address, and password on the new registration screen.

[0807] Input: The user enters their name, email address, and password.

[0808] Specific operation: The user opens a browser, enters information on the registration screen, and clicks the submit button.

[0809] Step 2:

[0810] The terminal receives the data in the input form and performs validation.

[0811] Input: Name, email address, and password entered by the user.

[0812] Data processing: Check the contents of the input data on the terminal (check whether it is in the correct format).

[0813] Output: Validation result (pass / fail).

[0814] What happens: The JavaScript code on the device checks the input data and displays an error message if there is an error.

[0815] Step 3:

[0816] If the validation is successful, the terminal transmits the data to the server.

[0817] Input: Name, email address, and password data that passes validation.

[0818] Data processing: None.

[0819] Output: HTTP request (POST request) from the terminal to the server.

[0820] Specific operation: Data is sent from the terminal to the server.

[0821] Step 4:

[0822] The server stores the received registration data in a database.

[0823] Input: Name, Email Address, Password data.

[0824] Data processing: Saving to a database.

[0825] Output: User information stored in the database.

[0826] Specific operation: On the server side, the registration data is inserted into the database using an SQL query.

[0827] Step 5:

[0828] When the server has completed saving the data in the database, it returns a registration success message to the terminal.

[0829] Input: Successful result of saving to database.

[0830] Data processing: Generate a registration success message.

[0831] Output: HTTP response to the device.

[0832] Specific operation: The server sends a registration success message as an HTTP response.

[0833] Step 6:

[0834] The terminal receives a registration success message from the server and displays it to the user.

[0835] Input: Registration success message from the server.

[0836] Data processing: None.

[0837] Output: Message to display to the user.

[0838] Specific behavior: A message such as "Registration successful" will appear in the browser.

[0839] Step 7:

[0840] Users fill out a form within the system and enter profile information such as the celebrity's name (e.g., "Yamada Taro"), photo, voice sample, and biography.

[0841] Input: celebrity name, photo, voice sample, biographical data.

[0842] What happens: The user enters information in the browser and uploads photos and audio files.

[0843] Step 8:

[0844] The terminal checks the required fields of the entered information and sends it to the server.

[0845] Input: Profile information entered.

[0846] Data processing: Check required fields.

[0847] Output: Verified profile information.

[0848] Specific operation: JavaScript code on the terminal checks the required fields and sends them to the server after confirmation is complete.

[0849] Step 9:

[0850] The server analyzes the received profile information and passes it to the generative AI model.

[0851] Input: Verified profile information.

[0852] Data processing: Analyzing information and converting it into an input format for generative AI models.

[0853] Output: The input data to a generative AI model.

[0854] Specific operation: The server-side program receives the profile information and calls the AI ​​model's API.

[0855] Step 10:

[0856] The generative AI model generates a realistic AI avatar and stores it in a database on the server.

[0857] Input: Parsed profile information.

[0858] Data processing: Generation of AI avatars.

[0859] Output: Generated AI avatar data.

[0860] How it works: The generative AI model learns images and voices of celebrities, creates avatars, and stores them in a database.

[0861] Step 11:

[0862] The server returns a preview of the AI ​​avatar to the device along with a message that creation was successful.

[0863] Input: Data for the generated AI avatar.

[0864] Data processing: Generate a generation success message.

[0865] Output: HTTP response to the device.

[0866] Specific operation: The server sends a generation success message and a preview image as an HTTP response.

[0867] Step 12:

[0868] The device will display a preview of the AI ​​avatar to the user along with a message that creation was successful.

[0869] Input: A success message and a preview image from the server.

[0870] Data processing: None.

[0871] Output: Message and preview image displayed to the user.

[0872] Specific behavior: A preview of the AI ​​avatar will be displayed in the browser.

[0873] Step 13:

[0874] The user clicks the Start Conversation button to have a conversation with the generated AI avatar.

[0875] Input: User clicks.

[0876] Specific action: The user clicks the "Start conversation" button.

[0877] Step 14:

[0878] The terminal sends this request to the server, which then initiates the conversation session.

[0879] Input: A conversation initiation request.

[0880] Data processing: Initializing a conversation session.

[0881] Output: Initial message generation.

[0882] Specific operation: An HTTP request is sent from the terminal to the server, and a conversation session is prepared on the server side.

[0883] Step 15:

[0884] The server sends an initial greeting message generated by the AI ​​avatar to the device, which then displays it to the user.

[0885] Input: An initial greeting message from the AI ​​avatar.

[0886] Data processing: None.

[0887] Output: Message to display to the user.

[0888] Specific operation: The server generates an initial greeting message and sends it as an HTTP response. The device displays it in the browser.

[0889] Step 16:

[0890] When the user responds with text or voice, the terminal sends this response data to the server.

[0891] Input: User text or voice data.

[0892] What happens: The user enters text or records a voice message and clicks the send button.

[0893] Step 17:

[0894] The server analyzes the received data and generates a response for the AI ​​avatar.

[0895] Input: User text or voice data.

[0896] Data processing: data analysis, response generation.

[0897] Output: The generated response data.

[0898] How it works: On the server side, the AI ​​model analyzes the user's input and generates an appropriate response.

[0899] Step 18:

[0900] The server sends the generated response to the terminal, which displays or plays it back to the user.

[0901] Input: The generated response data.

[0902] Data processing: None.

[0903] Output: A message displayed or audio played to the user.

[0904] Specific operation: The server sends the response as an HTTP response, and the device displays it in the browser or plays it as audio.

[0905] Step 19:

[0906] Users select usage time and price options on the pricing plan screen.

[0907] Input: Price plan selection data.

[0908] Specific behavior: The user selects an option on the pricing plan screen and clicks the confirm button.

[0909] Step 20:

[0910] The terminal transmits the selected plan data to the server, which calculates the fee and displays the payment page.

[0911] Input: Selected rate plan data.

[0912] Data processing: calculation of fees.

[0913] Output: Payment page display data.

[0914] Specific operation: Fee calculation is performed on the server side, and payment page data is returned as an HTTP response.

[0915] Step 21:

[0916] The user enters payment information and completes the payment, which the terminal sends to the server.

[0917] Input: Payment information.

[0918] Specific behavior: The user enters credit card information and clicks the pay button.

[0919] Step 22:

[0920] The server verifies the payment data and returns permission to start using the service to the terminal.

[0921] Input: Payment information.

[0922] Data processing: Payment verification.

[0923] Output: Message that permission to start using is granted.

[0924] Specific operation: The payment confirmation process is performed on the server side, and a success message is returned as an HTTP response.

[0925] Step 23:

[0926] The terminal displays a payment success message to the user, and the user begins using services based on the plan.

[0927] Input: Payment success message.

[0928] Data processing: None.

[0929] Output: Message to display to the user.

[0930] Specific operation: A message such as "Payment successful" will be displayed on the browser, and the user can start using the service.

[0931] (Application example 1)

[0932] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0933] Conventional navigation and entertainment systems in autonomous vehicles have provided a poor user experience and limited interaction. Furthermore, the lack of services such as tourist information prevented the enjoyment and convenience of the ride from improving. Furthermore, the lack of a system that easily enabled interaction with celebrities prevented many users from getting an engaging experience. To address these issues, a system that enriches the user experience, enables real-time interaction, and can also provide tourist information and entertainment is needed.

[0934] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0935] In this invention, the server includes means for receiving input data from a user and performing user registration, means for generating an AI avatar based on profile information of a celebrity, means for enabling conversation with the generated AI avatar, and means for providing services such as navigation, tourist information, and entertainment within the self-driving vehicle using the generated AI avatar. This allows users to have an interactive experience within the self-driving vehicle and enjoy a service that integrates navigation, tourist information, and entertainment.

[0936] "User" refers to a person who uses this system to interact with an AI avatar or receive services within an autonomous vehicle.

[0937] "Input Data" means information, including name, email address, password, and other required details, that a User provides to the System for purposes of registration, authentication, instructions, etc.

[0938] A "celebrity" is someone who is generally well-known and recognized by many people, including famous actors, athletes, singers, etc.

[0939] "Profile Information" refers to detailed information about a celebrity, such as their name, photo, voice sample, and biography.

[0940] An "AI avatar" is an artificial intelligence model created based on the profile information of a celebrity, and refers to a virtual person who can converse and interact with users in the form of text, voice, image, video, etc.

[0941] "Navigation" refers to a service that allows users to receive route guidance to their destination in an autonomous vehicle.

[0942] "Tourist information" refers to a service that provides information about tourist spots and local areas that can be seen from an autonomous vehicle while the user is traveling.

[0943] "Entertainment" refers to services that provide entertainment such as music, video, and interaction that users can enjoy in their autonomous vehicles.

[0944] "Pricing" refers to the process or method for determining the amount a user must pay when using an AI avatar or a service within an autonomous vehicle.

[0945] "Payment Processing" refers to the process by which a User pays for the Service and the method by which such payment is verified and recorded.

[0946] To implement this invention, we provide a system that allows users to interact with AI avatars of celebrities in self-driving vehicles. Specific embodiments of this system are described below.

[0947] User Registration and Authentication

[0948] First, a user accesses the system and registers by providing input data such as name, email address, and password. The terminal validates this input data and sends it to the server in the appropriate format. The server stores the received data and returns a message to the terminal indicating successful user registration. The user can then use the system.

[0949] AI avatar generation for celebrities

[0950] The user uses a form within the system to enter profile information such as the celebrity's name, photo, voice sample, and biography. The device receives this information, checks the required fields, and then sends it to the server. The server analyzes the received information and passes it to a generative AI model to generate a realistic AI avatar of the celebrity. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device then displays a preview of the AI ​​avatar to the user along with a message of success.

[0951] Start a conversation with an AI avatar

[0952] The user clicks the Start Conversation button to have a conversation with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the AI ​​avatar, and the AI ​​avatar generates an initial greeting message. This generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data, generates a response for the AI ​​avatar, and sends it back to the device. The device displays or plays this to the user. This achieves an interactive dialogue between the user and the AI ​​avatar.

[0953] Providing services inside autonomous vehicles

[0954] Inside the autonomous vehicle, the user wears a head-mounted display and can interact with an AI avatar to receive navigation, tourist information, and entertainment services. In the navigation service, the user sets a destination and the AI ​​avatar provides directions. In addition, in the tourist information function, the AI ​​avatar provides tourist information for the areas the vehicle passes through. In the entertainment function, the AI ​​avatar provides entertainment such as music and videos to the user.

[0955] Pricing and Payment

[0956] The user operates the pricing plan screen and selects options such as usage time and price. This selection data is sent from the terminal to the server, which calculates the fee and displays the payment page on the terminal. When the user enters payment information and completes the payment, the terminal sends a confirmation to the server. The server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan.

[0957] Specific examples

[0958] For example, if a user generates an AI avatar of a famous actor and asks the AI ​​avatar to navigate to "Tokyo Tower" in a self-driving vehicle, the AI ​​avatar will begin providing directions and information about tourist spots they will pass along the way. Entertainment features such as playing favorite music to make the journey more comfortable are also provided. An example of a prompt sentence would be "generate ai avatar for celebrity actor with bio..." and the generative AI model would be able to generate an actor's avatar.

[0959] This system will further enrich the user experience, making travel time in an autonomous vehicle more comfortable and meaningful.

[0960] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0961] Step 1:

[0962] A user accesses the system and registers by entering their name, email address, and password. The terminal receives this input data and performs validation. Once validation is complete, the terminal sends the data to the server. The server stores the received data and returns a message to the terminal indicating successful user registration. The input for this step is the name, email address, and password, and the output is a message indicating successful user registration.

[0963] Step 2:

[0964] The user enters the celebrity's profile information, such as their name, photo, voice sample, and biography, into a form within the system. The device receives this information, checks the required fields, and then sends it to the server. The server analyzes the received information and passes it to a generative AI model to generate a realistic AI avatar of the celebrity. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device then displays a preview of the AI ​​avatar to the user along with a message of success. The input of this step is the celebrity's profile information, and the output is a preview of the generated AI avatar.

[0965] Step 3:

[0966] The user clicks the Start Conversation button to have a conversation with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the AI ​​avatar, and the AI ​​avatar generates an initial greeting message. This generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data and generates a response for the AI ​​avatar, which is sent back to the device. The device displays or plays this to the user. The input of this step is the user's response, and the output is the AI ​​avatar's response.

[0967] Step 4:

[0968] Inside the autonomous vehicle, the user wears a head-mounted display and receives navigation, tourist information, and entertainment services through interactions with an AI avatar. When the user sets a destination, the device sends this information to the server. The server calculates a navigation route based on the destination and has the AI ​​avatar provide directions. The tourist information function also generates tourist information for the areas the vehicle passes through, which the AI ​​avatar provides to the user. For the entertainment function, the server plays selected music and video content. The inputs to this step are the destination setting and entertainment selection, and the outputs are route information, tourist information, and entertainment content.

[0969] Step 5:

[0970] The user operates the pricing plan screen and selects options such as usage time and price. This selection data is sent from the terminal to the server, which calculates the fee and then displays the payment page on the terminal. When the user enters payment information and completes the payment, the terminal sends a confirmation to the server. The server verifies and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan. The input to this step is the pricing plan selection data and payment information, and the output is a payment success message.

[0971] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0972] This invention provides a B2C web platform that allows users to easily interact with AI avatars of celebrities. In particular, this system is equipped with an emotion engine that recognizes users' emotions and can generate responses according to the user's emotions. Specific embodiments of this system are described below.

[0973] User Registration and Authentication

[0974] A user first accesses the system and enters information such as name, email address, and password on the new registration screen. The terminal receives this input data and validates that all required fields have been entered. Once validation is complete, the terminal sends the data to the server. The server stores the received data and returns a registration success message to the terminal. This registers the user in the system and they can begin using it.

[0975] AI avatar generation for celebrities

[0976] The user enters the celebrity's profile information, such as their name, photo, voice sample, and biography, into a form within the system. The device receives this information and validates it for completeness. After validation, the device sends this data to the server. The server analyzes the received information and passes it to the AI ​​generation model. The AI ​​generation model generates a realistic AI avatar of the celebrity. This avatar can respond in the form of text, voice, image, or video. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device displays a preview of the AI ​​avatar to the user along with a message of success.

[0977] Start a conversation with an AI avatar

[0978] The user clicks the Start Conversation button to converse with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the selected AI avatar and generates an initial greeting message. The generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data and generates a response for the AI ​​avatar. This response is sent back to the device, which displays or plays it back to the user. This achieves an interactive conversation between the user and the AI ​​avatar.

[0979] Emotion Engine Operation

[0980] The system is equipped with an emotion engine that recognizes the user's emotions. When the user provides input in the form of text, voice, image, or video, the device sends this data to the emotion engine. The emotion engine analyzes the input data and recognizes the user's emotional state. For example, it identifies emotions such as "happy" if the user is happy, or "sad" if the user is sad. The emotion engine then sends the recognized emotion data to the server. The server generates a response for the AI ​​avatar based on the emotion data, and the response is delivered in a content and tone that matches the user's emotion.

[0981] Pricing and Payment

[0982] The user operates the pricing plan screen and selects the usage time and price options. For example, plans include 30 minutes for 500 yen or 1 hour for 1,000 yen. The terminal sends the selected data to the server. The server calculates the fee and displays the payment page on the terminal. When the user enters the payment information and completes the payment, the terminal sends confirmation to the server. The server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan.

[0983] Specific examples

[0984] For example, suppose a user registers in the system under the name "Yamada Taro" and generates an AI avatar of a celebrity named "Tanaka Minako." The user enters their profile information and checks a preview of the generated avatar. Next, after selecting a pricing plan and completing payment, a conversation with Tanaka Minako's AI avatar begins. The user asks questions via text or voice, and the AI ​​avatar responds individually. Furthermore, the emotion engine recognizes the user's emotions based on their input and generates responses accordingly, resulting in a more intimate and adapted conversation. In this way, users can easily enjoy interactive interactions with celebrities.

[0985] The embodiments of the present invention allow users to interact with realistic AI avatars of celebrities in a variety of ways, while keeping psychological and economic hurdles low, and receiving responses that correspond to their emotions.

[0986] The processing flow will be explained below.

[0987] User Registration and Authentication

[0988] Step 1:

[0989] The user accesses the new registration screen and enters registration information such as name, email address, and password.

[0990] Step 2:

[0991] The terminal receives the entered information and validates that all required fields have been entered.

[0992] Step 3:

[0993] The terminal sends the data that has passed validation to the server.

[0994] Step 4:

[0995] The server receives the submitted data and creates a new user record in the database.

[0996] Step 5:

[0997] The server returns a successful response to the terminal.

[0998] Step 6:

[0999] The terminal receives the response and displays a "Registration successful" message to the user.

[1000] AI avatar generation for celebrities

[1001] Step 1:

[1002] A user enters profile information such as the celebrity's name, photo, voice sample, and biography.

[1003] Step 2:

[1004] The terminal receives the entered information and validates it to ensure there are no missing details.

[1005] Step 3:

[1006] The device sends the validated data to the server.

[1007] Step 4:

[1008] The server analyzes the received data and passes it to the AI ​​generation model.

[1009] Step 5:

[1010] The server's AI generative model uses the data to generate an AI avatar of the celebrity, which can respond in the form of text, voice, images, and video.

[1011] Step 6:

[1012] The server stores the generated AI avatar in a database and returns a response indicating successful generation to the device.

[1013] Step 7:

[1014] The device receives the response and displays a preview of the generated AI avatar to the user.

[1015] Start a conversation with an AI avatar

[1016] Step 1:

[1017] The user selects the AI ​​avatar they want to talk to and clicks the Start Conversation button.

[1018] Step 2:

[1019] The terminal sends a conversation initiation request to the server.

[1020] Step 3:

[1021] The server creates a conversation session with the selected AI avatar and generates an initial greeting message.

[1022] Step 4:

[1023] The server sends the generated initial message to the terminal.

[1024] Step 5:

[1025] The terminal displays a welcome message to the user.

[1026] Step 6:

[1027] The user enters a response by text or voice.

[1028] Step 7:

[1029] The terminal sends the user's input to the server.

[1030] Step 8:

[1031] The server analyzes the user's input data, and the emotion engine recognizes the user's emotions.

[1032] Step 9:

[1033] The emotion engine sends the emotion data to the server, which processes it so that the AI ​​avatar can generate a response according to the emotion.

[1034] Step 10:

[1035] The server sends the generated AI avatar's response to the device.

[1036] Step 11:

[1037] The terminal receives the response and displays or plays it back to the user, and this process is repeated to continue the interactive conversation.

[1038] Pricing and Payment

[1039] Step 1:

[1040] The user accesses the pricing plan screen and sees the available time and price options.

[1041] Step 2:

[1042] The user selects the plan they want and enters their payment information.

[1043] Step 3:

[1044] The terminal sends the selected plan and payment information to the server.

[1045] Step 4:

[1046] The server receives the transmitted data and executes the payment process in cooperation with the payment system.

[1047] Step 5:

[1048] The server checks the result of the payment process and returns a success or failure response to the terminal.

[1049] Step 6:

[1050] The terminal receives the result of the payment process and displays a message to the user saying "Payment completed." If the payment is successful, a message also appears stating that the user is authorized to start using the service.

[1051] Specific examples

[1052] Step 1:

[1053] For example, when a user registers a new account under the name "Yamada Taro," the steps of user registration and authentication are executed in order.

[1054] Step 2:

[1055] After completing registration, the user wants to generate an AI avatar for a celebrity named "Minako Tanaka." To do this, the user enters the celebrity's profile information into a form and executes the steps to generate the celebrity's AI avatar.

[1056] Step 3:

[1057] After the AI ​​avatar is generated and the user checks its preview, the user executes a series of steps to start a conversation with the AI ​​avatar, including a procedure in which the emotion engine recognizes the emotion when the user provides emotional input and generates an adapted response.

[1058] Step 4:

[1059] After the conversation ends, the user performs the steps of setting the price and paying for the usage time. Once payment is completed based on the selected plan, the system usage is officially terminated.

[1060] In this way, users can not only easily enjoy interactive conversations with AI avatars of celebrities, but also experience more intimate and adapted interactions by receiving responses based on their emotions.

[1061] Example 2

[1062] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1063] In recent years, advances in AI technology have led to an increasing demand for interactive dialogue systems. However, conventional dialogue systems often lack the ability to fully recognize user emotions and generate appropriate responses. As a result, they can only provide one-way information to users, resulting in a poor user experience. Furthermore, real-time responses are difficult to make for pricing and payment processing, requiring cumbersome procedures for users. To solve these problems, a system capable of recognizing user emotions in real time and generating adaptive responses is needed.

[1064] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1065] In this invention, the server includes means for receiving input data from a user and performing user registration, means for generating an AI avatar based on profile information of a celebrity, means for enabling conversation with the generated AI avatar, means for transmitting the input data to an emotion engine and recognizing the user's emotions, means for generating a response from the AI ​​avatar based on the recognized emotion data, and means for setting fees according to usage and performing payment processing.

[1066] This allows users to receive real-time emotional responses when using the system, resulting in a more personalized and interactive experience, as well as simplified pricing and payment processing, improving the user experience.

[1067] A "user" is a person who uses the system to register, interact, make payments, and perform other operations.

[1068] "Input Data" refers to information provided by a user to the system, including names, email addresses, passwords, celebrity profile information, text, audio, images, and video.

[1069] "Validation" is the process of checking whether the data entered by the user meets the system requirements.

[1070] The "server" is the central computer in the system that receives, stores, analyzes, and generates AI avatars from data entered by users.

[1071] A "terminal" is a device that a user uses to access the system and input and display data, including a PC, smartphone, tablet, etc.

[1072] An "AI avatar" is a virtual presence generated based on a celebrity's profile information and can respond to users in the form of text, voice, image, and / or video.

[1073] An "emotion engine" is a software component that analyzes user input data and recognizes the user's emotional state.

[1074] "Pricing" is the process of determining the time and price plan a user may select to use the system.

[1075] "Payment processing" refers to the process in which a user enters payment information based on the selected fee plan and actually pays the fee.

[1076] "Profile Information" is information associated with a public figure, such as name, photograph, voice sample, and biography.

[1077] A "generative AI model" is an artificial intelligence algorithm for generating AI avatars based on input data.

[1078] A "response" is a reply message generated by an AI avatar in response to user input, and can include text, audio, images, and video.

[1079] This invention provides a web platform that allows users to easily interact with AI avatars of celebrities. In particular, it is equipped with an emotion engine that can generate responses according to the user's emotions.

[1080] Overall system configuration

[1081] The system mainly includes the following components:

[1082] 1. User's device: a device such as a computer, smartphone, or tablet.

[1083] 2. Server: The central computer that stores and analyzes input data, generates AI avatars, and runs the emotion engine.

[1084] 3. Emotion Engine: A software component that recognizes the user's emotional state and generates a response based on it.

[1085] 4. Generative AI model: An artificial intelligence algorithm that generates AI avatars based on celebrity profile information.

[1086] User Registration and Authentication

[1087] 1. The user accesses the system and enters their name, email address, password, etc. on the new registration screen.

[1088] 2. The terminal receives the input data and validates that all required fields are entered.

[1089] 3. Once the validation is complete, the device sends the data to the server.

[1090] 4. The server stores the received data and returns a registration success message to the terminal.

[1091] 5. The terminal displays a registration success message to the user.

[1092] AI avatar generation for celebrities

[1093] 1. Users enter profile information such as the celebrity's name, photo, voice sample, and biography into a form within the system.

[1094] 2. The terminal receives this information and validates the input for any missing information.

[1095] 3. The device sends the data to the server.

[1096] 4. The server analyzes the received information and passes it to the generative AI model.

[1097] 5. The generative AI model generates realistic AI avatars of celebrities and stores them in a database.

[1098] 6. The server returns a creation success message to the terminal.

[1099] 7. The device will display a preview of the AI ​​avatar to the user along with a message that creation was successful.

[1100] Start a conversation with an AI avatar

[1101] 1. The user clicks the Start Conversation button to begin a conversation with the generated AI avatar.

[1102] 2. The device sends a request to the server.

[1103] 3. The server initiates a conversation session with the selected AI avatar and generates an initial greeting message and sends it to the device.

[1104] 4. The terminal displays an initial greeting message to the user.

[1105] 5. When the user responds with text or voice, the device sends this to the server.

[1106] 6. The server analyzes the data and generates a response for the AI ​​avatar.

[1107] 7. The server sends the response to the terminal, which displays or plays it back to the user.

[1108] Emotion Engine Operation

[1109] 1. When the user provides input in the form of text, voice, image, or video, the device sends this to the emotion engine.

[1110] 2. The emotion engine analyzes the input data and recognizes the user's emotional state.

[1111] 3. The emotion engine sends the recognized emotion data to the server.

[1112] 4. The server generates a response for the AI ​​avatar based on the emotion data.

[1113] 5. The server provides a response with content and tone that matches the user's emotions.

[1114] Pricing and Payment

[1115] 1. The user navigates to the pricing plan screen and selects usage time and price options.

[1116] 2. The device sends the selection data to the server.

[1117] 3. The server calculates the fee and displays the payment page on the terminal.

[1118] 4. Once the user enters their payment information and completes the payment, the terminal sends a confirmation to the server.

[1119] 5. The server confirms and saves the payment data and returns permission to start using the service to the device.

[1120] 6. The terminal will display a message that the payment was successful.

[1121] Specific examples

[1122] For example, suppose a user registers with the system under the name "Yamada Taro" and generates an AI avatar of a famous person named "Tanaka Minako." After selecting a pricing plan and completing payment, a conversation with Tanaka Minako's AI avatar begins. The user asks questions via text or voice, and the AI ​​avatar responds individually. Furthermore, the emotion engine recognizes the user's emotions based on their input and generates responses accordingly, resulting in a more intimate and adapted conversation.

[1123] Example prompt:

[1124] User: I want to register in the system

[1125] Device: Display new registration screen

[1126] User: Enter your name, email address, and password

[1127] Device: Sends data to server

[1128] Server: Saves the data and returns a registration success message to the device.

[1129] Device: Display a registration success message to the user

[1130] This embodiment of the present invention allows users to easily interact with realistic AI avatars of celebrities while minimizing psychological and economic barriers, and the emotion recognition function allows users to receive more personalized responses.

[1131] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1132] User Registration and Authentication

[1133] Step 1:

[1134] The user accesses the system and enters information such as name, email address, and password on the new registration screen.

[1135] Input: Name, Email Address, Password

[1136] Output: Input data

[1137] Step 2:

[1138] The terminal receives the entered data and validates that all required fields have been entered.

[1139] Input: Input data

[1140] Output: Validation result (success / failure)

[1141] Behavior: Checks whether the entered data is in the correct format.

[1142] Step 3:

[1143] Once the validation is complete, the terminal sends the data to the server.

[1144] Input: Data that has been successfully validated

[1145] Output: Data sent to the server

[1146] Step 4:

[1147] The server stores the received data and returns a registration success message to the terminal.

[1148] Input: Data sent to the server

[1149] Output: Registration successful message

[1150] What it does: Saves user information in a database.

[1151] Step 5:

[1152] The terminal displays a registration successful message to the user.

[1153] Input: Registration success message

[1154] Output: Shown to the user

[1155] AI avatar generation for celebrities

[1156] Step 1:

[1157] Users fill out a form within the system to enter profile information such as the celebrity's name, photo, voice sample, and biography.

[1158] Input: celebrity name, photo, voice sample, biography

[1159] Output: Input data

[1160] Step 2:

[1161] The terminal receives this information and validates the input for any missing information.

[1162] Input: Input data

[1163] Output: Validation result (success / failure)

[1164] Behavior: Checks whether all the input data is present.

[1165] Step 3:

[1166] The terminal transmits the data to the server.

[1167] Input: Data that has been successfully validated

[1168] Output: Data sent to the server

[1169] Step 4:

[1170] The server analyzes the received information and passes it to the generative AI model.

[1171] Input: Data sent to the server

[1172] Output: Input data to a generative AI model

[1173] Step 5:

[1174] The generative AI model generates realistic AI avatars of celebrities and stores them in a database.

[1175] Input: Input data to the generative AI model

[1176] Output: Generated AI avatar

[1177] Operation: Analyze using a model and generate an AI avatar.

[1178] Step 6:

[1179] The server returns a creation success message to the terminal.

[1180] Input: Generated AI avatar

[1181] Output: Creation successful message

[1182] Step 7:

[1183] The device will display a preview of the AI ​​avatar to the user along with a message that creation was successful.

[1184] Input: Generation success message, AI avatar preview

[1185] Output: Shown to the user

[1186] Start a conversation with an AI avatar

[1187] Step 1:

[1188] The user clicks the Start Conversation button to begin a conversation with the generated AI avatar.

[1189] Input: Click the Start Conversation button

[1190] Output: Conversation start request

[1191] Step 2:

[1192] The terminal sends a request to the server.

[1193] Input: Conversation start request

[1194] Output: Request sent to the server

[1195] Step 3:

[1196] The server initiates a conversation session with the selected AI avatar and generates an initial greeting message to send to the device.

[1197] Input: Conversation start request

[1198] Output: Initial greeting message

[1199] What it does: Manages the session and generates the initial message.

[1200] Step 4:

[1201] The terminal displays an initial greeting message to the user.

[1202] Input: Initial greeting message

[1203] Output: Shown to the user

[1204] Step 5:

[1205] When the user responds with text or voice, the device sends this to the server.

[1206] Input: Text or voice response

[1207] Output: Response data sent to the server

[1208] Step 6:

[1209] The server analyzes the data and generates a response for the AI ​​avatar.

[1210] Input: User response data

[1211] Output: The generated AI avatar's response

[1212] Behavior: Analyzes the received data and generates an appropriate response.

[1213] Step 7:

[1214] The server sends the response to the terminal, which displays or plays it back to the user.

[1215] Input: The response of the generated AI avatar

[1216] Output: Show or play to the user

[1217] Emotion Engine Operation

[1218] Step 1:

[1219] The user provides input in the form of text, audio, images, or video.

[1220] Input: Text, audio, image, and video input

[1221] Output: Input data

[1222] Step 2:

[1223] The device sends this data to the emotion engine.

[1224] Input: Input data

[1225] Output: Input data to the emotion engine

[1226] Step 3:

[1227] The emotion engine analyzes the input data and recognizes the user's emotional state.

[1228] Input: Input data to the emotion engine

[1229] Output: Recognized emotion data

[1230] How it works: Input data is analyzed using emotion recognition algorithms.

[1231] Step 4:

[1232] The emotion engine sends the recognized emotion data to the server.

[1233] Input: Recognized emotion data

[1234] Output: Emotion data sent to the server

[1235] Step 5:

[1236] The server generates responses for the AI ​​avatar based on the emotional data.

[1237] Input: Emotion data sent to the server

[1238] Output: Emotion-adapted AI avatar responses

[1239] Action: Generate a response based on the emotion data.

[1240] Step 6:

[1241] The server provides a response with content and tone that matches the user's emotions.

[1242] Input: Emotion-adaptive AI avatar responses

[1243] Output: Show or play to the user

[1244] Pricing and Payment

[1245] Step 1:

[1246] Users navigate through the pricing plan screen and select usage time and price options.

[1247] Input: Time and price options

[1248] Output: Selected data

[1249] Step 2:

[1250] The terminal transmits the selection data to the server.

[1251] Input:Selection data

[1252] Output: Data sent to the server

[1253] Step 3:

[1254] The server performs the billing calculation.

[1255] Input: Data sent to the server

[1256] Output: Charge calculation results

[1257] How it works: Calculates charges based on time and price.

[1258] Step 4:

[1259] The server displays a payment page on the terminal.

[1260] Input: Fee calculation result

[1261] Output: Payment page

[1262] Step 5:

[1263] The user enters payment information and completes the payment.

[1264] Input: Payment information

[1265] Output: Payment completion data

[1266] Step 6:

[1267] The terminal sends a confirmation to the server.

[1268] Input: Payment completion data

[1269] Output: Payment confirmation request

[1270] Step 7:

[1271] The server verifies and stores the payment data.

[1272] Input: Payment confirmation request

[1273] Output: Confirmation completed message

[1274] What it does: Stores and verifies payment data.

[1275] Step 8:

[1276] The server returns permission to start using the device.

[1277] Input: Confirmation completion message

[1278] Output: Permission to start using

[1279] Step 9:

[1280] The terminal will display a message that the payment was successful.

[1281] Input: Permission to start using

[1282] Output: Payment successful message

[1283] (Application example 2)

[1284] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1285] Modern factories require efficient sharing of skills among technicians and engineers and rapid problem-solving. However, receiving real-time on-site training is difficult, posing a significant barrier, especially for new or inexperienced staff. Furthermore, there is a lack of emotion-based feedback, which creates challenges in terms of work efficiency and mental health. Therefore, there is a need for a system that provides technical assistance and appropriate feedback through emotion recognition within factories.

[1286] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means including an emotion engine that analyzes voice data from factory staff and robots, means for generating a response of an AI avatar based on the analysis results of the emotion engine, and means for generating an AI avatar based on the profile information of the engineer. This allows for real-time technical support and feedback according to the staff's emotions.

[1287] "User" means any person or entity that registers, accesses, and operates using the System.

[1288] "Input data" refers to information such as text, audio, images, or video that a user provides to a system.

[1289] "User registration" is the process by which a new user enters their information into the system and obtains the right to use the system.

[1290] An "engineer" is an individual who has a high level of expertise or skill in a particular field.

[1291] "Profile Information" is individual information that may include a person's name, photo, voice sample, biography, etc.

[1292] An "AI avatar" is a digital character that resembles a specific person and is generated using AI technology.

[1293] A "conversation" is an interaction between a user and an AI avatar via text, voice, images, or video.

[1294] "Pricing" is the process of determining the costs and plans required to use the system.

[1295] "Payment processing" refers to the procedures and operations required for users to pay system usage fees.

[1296] An "emotion engine" is an AI technology that analyzes user input data and identifies their emotional state.

[1297] "Analysis" is the process of examining input data in detail and understanding its content and meaning.

[1298] "Generating a response" is the process by which a system creates an appropriate reply to input from a user.

[1299] "Factory staff" refers to employees and personnel working on the manufacturing floor.

[1300] A "robot" is an automated mechanical device that is programmed to perform specific tasks.

[1301] A "server" is a computer system that stores, processes data, and provides services to other devices on a network.

[1302] A system for realizing this invention will now be described in detail. The system is composed of a series of components including a user, a terminal, a server, and an AI avatar.

[1303] First, a user uses a terminal to register and access the system. The terminal receives input data (e.g., name, email address, password), validates them, and sends them to the server. The server stores the received data and sends a registration success message to the terminal.

[1304] The next phase is to generate an AI avatar based on the engineer's profile information. The user enters the person's name, photo, voice sample, and career information into a form on the device. The device checks for missing information and sends it to the server. The server analyzes the information and generates an AI avatar based on a generative AI model (e.g., GPT-4). This AI avatar can respond in the form of text, voice, image, or video. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device displays a preview of the AI ​​avatar to the user along with a message of success.

[1305] The user can have an interactive conversation with the generated AI avatar. When the user clicks the conversation start button on the device, the device sends a request to the server. The server starts the conversation session, generates an initial greeting message, and sends it to the device. The user's text and voice responses are sent from the device to the server, and the server generates responses for the AI ​​avatar and sends them back to the device.

[1306] Furthermore, the system incorporates an emotion engine that recognizes emotions from user input data. It identifies the emotional state (e.g., "joy" or "sadness") and transmits it to the server. The server then generates a response for the AI ​​avatar based on the emotional data, providing appropriate feedback according to the user's emotions.

[1307] When installed on factory staff and robots, this system can also be used as a tool to improve factory work efficiency. Factory staff can talk to an AI avatar of a technician in real time through smart glasses or a robot and receive technical support. This is expected to help solve problems during production and improve efficiency.

[1308] Specific examples

[1309] When a factory line engineer needs to fix a malfunction in the electrical system, he calls up an AI avatar of "Technician A" through smart glasses. The interaction goes as follows:

[1310] Engineer: "Technician A, the light switch isn't working. What should I do?"

[1311] Technician A AI: "Check the circuit first. Don't worry, you can do it."

[1312] Prompt Sentence Examples

[1313] If an electrical system malfunction occurs on a factory production line, provide advice on how to troubleshoot the circuit, including encouraging impatient engineers to stay calm.

[1314] This allows the invention to provide real-time technical assistance and emotion-recognition-based feedback to prioritize and improve efficiency and effectiveness in factories and other workplaces.

[1315] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1316] Step 1:

[1317] The server receives input data from the user (name, email address, password). The device validates this data, ensuring all required fields are filled in, and sends the data to the server. The server stores the data and returns a registration success message to the device.

[1318] Step 2:

[1319] The user uses the device to input the technician's profile information (name, photo, voice sample, and resume). The device receives this information, validates it for any missing information, and then sends the data to the server. The server analyzes the received data and generates an AI avatar using a generative AI model.

[1320] Step 3:

[1321] The server saves the generated AI avatar in a database and returns a preview of the AI ​​avatar along with a message confirming the creation to the device. The device displays this preview to the user, who can then click the Start Conversation button to begin the conversation.

[1322] Step 4:

[1323] The device sends the user's conversation start request to the server, which starts a conversation session between the AI ​​avatar and the user, generates an initial greeting message, and sends it to the device, which then displays the greeting message to the user.

[1324] Step 5:

[1325] The user enters a response via text or voice, and the device sends this response data to the server, which analyzes the data and generates a response from the AI ​​avatar. This response is then sent back to the device, which displays or plays it back to the user.

[1326] Step 6:

[1327] The device sends the user's input data (text, voice, image, video) to the emotion engine, which analyzes this data and recognizes the emotional state (e.g., "joy," "sadness," etc.). The emotional data is then sent to the server.

[1328] Step 7:

[1329] The server generates a response from the AI ​​avatar based on the emotional data received from the emotion engine. This response is created with content and tone that matches the user's emotion and is sent to the device. The device then displays or plays the response to the user based on this emotion.

[1330] Step 8:

[1331] The user selects a pricing plan and enters payment information through the terminal. The terminal sends this data to the server. The server calculates the fee and generates a payment page that is displayed on the terminal. Once the user completes the payment, the server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user indicating that payment was successful, and the user can begin using the service based on the selected plan.

[1332] This completes the entire processing flow, and the interactive conversation between the user and the AI ​​avatar continues.

[1333] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1334] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1335] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1336] [Third embodiment]

[1337] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1338] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1339] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1340] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1341] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1342] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1343] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1344] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1345] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1346] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1347] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1348] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1349] This invention provides a B2C web platform that allows users to easily interact with AI avatars of celebrities. This system allows users to easily converse with AI avatars of celebrities and offers flexibility in terms of time and price. Specific embodiments of this system are described below.

[1350] User Registration and Authentication

[1351] A user first accesses the system and enters information such as name, email address, and password on the new registration screen. The terminal receives this input data and performs validation. Once validation is complete, the terminal sends the data to the server. The server stores the received data and returns a registration success message to the terminal. This registers the user in the system and they can begin using it.

[1352] AI avatar generation for celebrities

[1353] The user enters the celebrity's profile information, such as their name, photo, voice sample, and biography, into a form within the system. The device receives this information and verifies the required fields. After verification, the device sends this data to the server. The server analyzes the received information and passes it to the AI ​​generation model. The AI ​​generation model generates a realistic AI avatar of the celebrity. This avatar is designed to respond in the form of text, voice, image, or video. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device displays a preview of the AI ​​avatar to the user along with a message of success.

[1354] Start a conversation with an AI avatar

[1355] The user clicks the Start Conversation button to converse with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the AI ​​avatar, and the AI ​​avatar generates an initial greeting message. The generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data and generates a response for the AI ​​avatar. This response is sent back to the device, which displays or plays it back to the user. This achieves an interactive conversation between the user and the AI ​​avatar.

[1356] Pricing and Payment

[1357] The user operates the pricing plan screen and selects the usage time and price options. For example, plans include 30 minutes for 500 yen or 1 hour for 1,000 yen. The terminal sends the selected data to the server. The server calculates the fee and displays the payment page on the terminal. When the user enters the payment information and completes the payment, the terminal sends confirmation to the server. The server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan.

[1358] Specific examples

[1359] For example, suppose a user registers in the system under the name "Yamada Taro" and generates an AI avatar of a famous person named "Tanaka Minako." The user enters their profile information and checks a preview of the generated avatar. Next, after selecting a pricing plan and completing payment, a conversation with Tanaka Minako's AI avatar begins. The user asks questions via text or voice, and the AI ​​avatar responds individually to them. In this way, users can easily enjoy interactive interactions with famous people.

[1360] The embodiments of the present invention allow users to interact with real AI avatars of celebrities in a variety of ways while keeping psychological and economic hurdles low.

[1361] The processing flow will be explained below.

[1362] User Registration and Authentication

[1363] Step 1:

[1364] The user accesses the new registration screen and enters registration information such as name, email address, and password.

[1365] Step 2:

[1366] The terminal receives the entered information and validates that all required fields have been entered.

[1367] Step 3:

[1368] The terminal sends the data that has passed validation to the server.

[1369] Step 4:

[1370] The server receives the submitted data and creates a new user record in the database.

[1371] Step 5:

[1372] The server returns a successful response to the terminal.

[1373] Step 6:

[1374] The terminal receives the response and displays a "Registration successful" message to the user.

[1375] AI avatar generation for celebrities

[1376] Step 1:

[1377] A user enters profile information such as the celebrity's name, photo, voice sample, and biography.

[1378] Step 2:

[1379] The terminal receives the entered information and validates it to ensure there are no missing details.

[1380] Step 3:

[1381] The device sends the validated data to the server.

[1382] Step 4:

[1383] The server analyzes the received data and passes it to the AI ​​generation model.

[1384] Step 5:

[1385] The server's AI generative model uses the data to generate an AI avatar of the celebrity, which can respond in the form of text, voice, images, and video.

[1386] Step 6:

[1387] The server stores the generated AI avatar in a database and returns a response indicating successful generation to the device.

[1388] Step 7:

[1389] The device receives the response and displays a preview of the generated AI avatar to the user.

[1390] Start a conversation with an AI avatar

[1391] Step 1:

[1392] The user selects the AI ​​avatar they want to talk to and clicks the Start Conversation button.

[1393] Step 2:

[1394] The terminal sends a conversation initiation request to the server.

[1395] Step 3:

[1396] The server creates a conversation session with the selected AI avatar and generates an initial greeting message.

[1397] Step 4:

[1398] The server sends the generated initial message to the terminal.

[1399] Step 5:

[1400] The terminal displays a welcome message to the user.

[1401] Step 6:

[1402] The user enters a response by text or voice.

[1403] Step 7:

[1404] The terminal sends the user's input to the server.

[1405] Step 8:

[1406] The server receives the user's input data and processes it to generate a response from the AI ​​avatar.

[1407] Step 9:

[1408] The server sends the generated AI avatar's response to the device.

[1409] Step 10:

[1410] The terminal receives the response and displays or plays it back to the user, and this process is repeated to continue the interactive conversation.

[1411] Pricing and Payment

[1412] Step 1:

[1413] The user accesses the pricing plan screen and sees the available time and price options.

[1414] Step 2:

[1415] The user selects the plan they want and enters their payment information.

[1416] Step 3:

[1417] The terminal sends the selected plan and payment information to the server.

[1418] Step 4:

[1419] The server receives the transmitted data and executes the payment process in cooperation with the payment system.

[1420] Step 5:

[1421] The server checks the result of the payment process and returns a success or failure response to the terminal.

[1422] Step 6:

[1423] The terminal receives the result of the payment process and displays a message to the user saying "Payment completed." If the payment is successful, a message also appears stating that the user is authorized to start using the service.

[1424] Example 1

[1425] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1426] Although systems exist that allow users to easily interact with celebrity avatars, the process of user registration, entering profile information, and starting a conversation is cumbersome, and the pricing and payment processes are also complicated, making it difficult for users to use. Another problem is that the process for generating AI avatars is unclear, and the quality of responses cannot be guaranteed. It is necessary to resolve these issues and enable users to use the system intuitively and smoothly.

[1427] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1428] In this invention, the server includes means for receiving input data from a user and performing user registration, means for generating an AI avatar based on the celebrity's profile information, means for enabling conversation with the generated AI avatar, means for setting fees according to usage and processing payments, means for validating the input data and transmitting it to the server in an appropriate format, means for starting a conversation session and generating an initial greeting message, and means for analyzing the user's response data and generating a response for the AI ​​avatar. This allows users to easily use the system and smoothly interact with the celebrity's AI avatar.

[1429] "Input data" refers to information that users enter into the system, such as names, email addresses, passwords, and celebrity profile information.

[1430] "User registration" is the process in which a user provides information such as name, email address, and password to use the system, and the system receives and stores that information.

[1431] "Profile information" refers to information necessary to generate an AI avatar, such as a celebrity's name, photo, voice sample, and biography.

[1432] An "AI avatar" is an artificially intelligent character that has the appearance, voice, and personality of a famous person, created using a generative AI model.

[1433] A "conversation session" is the process in which a user and an AI avatar communicate with each other through text and voice.

[1434] "Pricing" refers to the process by which a user selects a pricing plan when using a conversation service with an AI avatar.

[1435] "Payment processing" refers to the process of entering payment information and completing payment based on the rate plan selected by the user.

[1436] Validation is the process of ensuring that the data entered by a user into a system is accurate and meets the required format and conditions.

[1437] The "server" is the central control unit of the system, a computer device that receives and stores data from users, generates AI avatars, and manages conversation sessions.

[1438] A "generative AI model" is an artificial intelligence algorithm that generates realistic AI avatars of celebrities based on input profile information.

[1439] A "prompt" is a text or voice message that a user enters as a question or request to an AI avatar.

[1440] "Proper format" means data formatted in a way that allows the server to parse and process the data correctly.

[1441] An "initial greeting message" is the first message generated by an AI avatar and displayed to the user at the start of a conversation session.

[1442] "Response data" refers to the answers and reactions generated by an AI avatar in response to user input.

[1443] The present invention provides a system for providing a web platform that allows users to easily interact with AI avatars of celebrities. Hereinafter, the embodiments of the present invention will be described in detail.

[1444] User Registration and Authentication

[1445] A user accesses the system through a web browser and enters information such as name, email address, and password on the new registration screen. This input data is first validated on the terminal. If validation is successful, the terminal sends the data to the server, which saves it in a database. Once saving is complete, a registration success message is returned to the terminal, and the user is able to access the system.

[1446] AI avatar generation for celebrities

[1447] The user enters profile information, such as the celebrity's name, photo, voice sample, and biography, into a form within the system. The device verifies the required fields of the entered information and sends it to the server. The server analyzes the received profile information and passes it to a generative AI model. The generative AI model uses, for example, GPT-3 or a core image recognition model. The generative AI model generates a realistic AI avatar of the celebrity and stores it in a database on the server. A preview of the AI ​​avatar is returned to the device along with a message indicating generation was successful, and the user can view it.

[1448] As a specific example, if you want to generate an AI avatar for a famous person called "Taro Yamada," you can enter their name, photo, voice sample, and biography, and then check a preview of the generated avatar.

[1449] Start a conversation with an AI avatar

[1450] To converse with the generated AI avatar, the user clicks the Start Conversation button. The device sends this request to the server, which then initiates the conversation session. During this process, the AI ​​avatar generates an initial greeting message and sends it to the device. When the user responds with text or voice, the device sends the response data to the server, which analyzes the data and generates the next response. This response is then sent back to the device and displayed or played back to the user.

[1451] As an example of a specific prompt, if you ask the AI ​​avatar, "Tell me about your recent activities," the AI ​​avatar will generate an appropriate response.

[1452] Pricing and Payment

[1453] The user selects the usage time and price options on the pricing plan screen. For example, they can choose a plan such as 500 yen for 30 minutes or 1,000 yen for 1 hour. The device sends the selected plan data to the server, which calculates the fee and displays the payment page. Once the user enters their payment information and completes the payment, a confirmation of successful payment is sent to the server, and the payment data is confirmed and saved. The user can then begin using the service based on the selected plan.

[1454] For example, if a user selects a 30-minute plan and completes payment with a credit card, a payment success message will be displayed. In this way, the user can smoothly use the service through the system.

[1455] This invention is a system that allows users to interact with AI avatars of real celebrities in a variety of ways while keeping psychological and financial hurdles low.

[1456] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1457] Step 1:

[1458] A user accesses the system through a web browser and enters their name, email address, and password on the new registration screen.

[1459] Input: The user enters their name, email address, and password.

[1460] Specific operation: The user opens a browser, enters information on the registration screen, and clicks the submit button.

[1461] Step 2:

[1462] The terminal receives the data in the input form and performs validation.

[1463] Input: Name, email address, and password entered by the user.

[1464] Data processing: Check the contents of the input data on the terminal (check whether it is in the correct format).

[1465] Output: Validation result (pass / fail).

[1466] What happens: The JavaScript code on the device checks the input data and displays an error message if there is an error.

[1467] Step 3:

[1468] If the validation is successful, the terminal transmits the data to the server.

[1469] Input: Name, email address, and password data that passes validation.

[1470] Data processing: None.

[1471] Output: HTTP request (POST request) from the terminal to the server.

[1472] Specific operation: Data is sent from the terminal to the server.

[1473] Step 4:

[1474] The server stores the received registration data in a database.

[1475] Input: Name, Email Address, Password data.

[1476] Data processing: Saving to a database.

[1477] Output: User information stored in the database.

[1478] Specific operation: On the server side, the registration data is inserted into the database using an SQL query.

[1479] Step 5:

[1480] When the server has completed saving the data in the database, it returns a registration success message to the terminal.

[1481] Input: Successful result of saving to database.

[1482] Data processing: Generate a registration success message.

[1483] Output: HTTP response to the device.

[1484] Specific operation: The server sends a registration success message as an HTTP response.

[1485] Step 6:

[1486] The terminal receives a registration success message from the server and displays it to the user.

[1487] Input: Registration success message from the server.

[1488] Data processing: None.

[1489] Output: Message to display to the user.

[1490] Specific behavior: A message such as "Registration successful" will appear in the browser.

[1491] Step 7:

[1492] Users fill out a form within the system and enter profile information such as the celebrity's name (e.g., "Yamada Taro"), photo, voice sample, and biography.

[1493] Input: celebrity name, photo, voice sample, biographical data.

[1494] What happens: The user enters information in the browser and uploads photos and audio files.

[1495] Step 8:

[1496] The terminal checks the required fields of the entered information and sends it to the server.

[1497] Input: Profile information entered.

[1498] Data processing: Check required fields.

[1499] Output: Verified profile information.

[1500] Specific operation: JavaScript code on the terminal checks the required fields and sends them to the server after confirmation is complete.

[1501] Step 9:

[1502] The server analyzes the received profile information and passes it to the generative AI model.

[1503] Input: Verified profile information.

[1504] Data processing: Analyzing information and converting it into an input format for generative AI models.

[1505] Output: The input data to a generative AI model.

[1506] Specific operation: The server-side program receives the profile information and calls the AI ​​model's API.

[1507] Step 10:

[1508] The generative AI model generates a realistic AI avatar and stores it in a database on the server.

[1509] Input: Parsed profile information.

[1510] Data processing: Generation of AI avatars.

[1511] Output: Generated AI avatar data.

[1512] How it works: The generative AI model learns images and voices of celebrities, creates avatars, and stores them in a database.

[1513] Step 11:

[1514] The server returns a preview of the AI ​​avatar to the device along with a message that creation was successful.

[1515] Input: Data for the generated AI avatar.

[1516] Data processing: Generate a generation success message.

[1517] Output: HTTP response to the device.

[1518] Specific operation: The server sends a generation success message and a preview image as an HTTP response.

[1519] Step 12:

[1520] The device will display a preview of the AI ​​avatar to the user along with a message that creation was successful.

[1521] Input: A success message and a preview image from the server.

[1522] Data processing: None.

[1523] Output: Message and preview image displayed to the user.

[1524] Specific behavior: A preview of the AI ​​avatar will be displayed in the browser.

[1525] Step 13:

[1526] The user clicks the Start Conversation button to have a conversation with the generated AI avatar.

[1527] Input: User clicks.

[1528] Specific action: The user clicks the "Start conversation" button.

[1529] Step 14:

[1530] The terminal sends this request to the server, which then initiates the conversation session.

[1531] Input: A conversation initiation request.

[1532] Data processing: Initializing a conversation session.

[1533] Output: Initial message generation.

[1534] Specific operation: An HTTP request is sent from the terminal to the server, and a conversation session is prepared on the server side.

[1535] Step 15:

[1536] The server sends an initial greeting message generated by the AI ​​avatar to the device, which then displays it to the user.

[1537] Input: An initial greeting message from the AI ​​avatar.

[1538] Data processing: None.

[1539] Output: Message to display to the user.

[1540] Specific operation: The server generates an initial greeting message and sends it as an HTTP response. The device displays it in the browser.

[1541] Step 16:

[1542] When the user responds with text or voice, the terminal sends this response data to the server.

[1543] Input: User text or voice data.

[1544] What happens: The user enters text or records a voice message and clicks the send button.

[1545] Step 17:

[1546] The server analyzes the received data and generates a response for the AI ​​avatar.

[1547] Input: User text or voice data.

[1548] Data processing: data analysis, response generation.

[1549] Output: The generated response data.

[1550] How it works: On the server side, the AI ​​model analyzes the user's input and generates an appropriate response.

[1551] Step 18:

[1552] The server sends the generated response to the terminal, which displays or plays it back to the user.

[1553] Input: The generated response data.

[1554] Data processing: None.

[1555] Output: A message displayed or audio played to the user.

[1556] Specific operation: The server sends the response as an HTTP response, and the device displays it in the browser or plays it as audio.

[1557] Step 19:

[1558] Users select usage time and price options on the pricing plan screen.

[1559] Input: Price plan selection data.

[1560] Specific behavior: The user selects an option on the pricing plan screen and clicks the confirm button.

[1561] Step 20:

[1562] The terminal transmits the selected plan data to the server, which calculates the fee and displays the payment page.

[1563] Input: Selected rate plan data.

[1564] Data processing: calculation of fees.

[1565] Output: Payment page display data.

[1566] Specific operation: Fee calculation is performed on the server side, and payment page data is returned as an HTTP response.

[1567] Step 21:

[1568] The user enters payment information and completes the payment, which the terminal sends to the server.

[1569] Input: Payment information.

[1570] Specific behavior: The user enters credit card information and clicks the pay button.

[1571] Step 22:

[1572] The server verifies the payment data and returns permission to start using the service to the terminal.

[1573] Input: Payment information.

[1574] Data processing: Payment verification.

[1575] Output: Message that permission to start using is granted.

[1576] Specific operation: The payment confirmation process is performed on the server side, and a success message is returned as an HTTP response.

[1577] Step 23:

[1578] The terminal displays a payment success message to the user, and the user begins using services based on the plan.

[1579] Input: Payment success message.

[1580] Data processing: None.

[1581] Output: Message to display to the user.

[1582] Specific operation: A message such as "Payment successful" will be displayed on the browser, and the user can start using the service.

[1583] (Application example 1)

[1584] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1585] Conventional navigation and entertainment systems in autonomous vehicles have provided a poor user experience and limited interaction. Furthermore, the lack of services such as tourist information prevented the enjoyment and convenience of the ride from improving. Furthermore, the lack of a system that easily enabled interaction with celebrities prevented many users from getting an engaging experience. To address these issues, a system that enriches the user experience, enables real-time interaction, and can also provide tourist information and entertainment is needed.

[1586] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1587] In this invention, the server includes means for receiving input data from a user and performing user registration, means for generating an AI avatar based on profile information of a celebrity, means for enabling conversation with the generated AI avatar, and means for providing services such as navigation, tourist information, and entertainment within the self-driving vehicle using the generated AI avatar. This allows users to have an interactive experience within the self-driving vehicle and enjoy a service that integrates navigation, tourist information, and entertainment.

[1588] "User" refers to a person who uses this system to interact with an AI avatar or receive services within an autonomous vehicle.

[1589] "Input Data" means information, including name, email address, password, and other required details, that a User provides to the System for purposes of registration, authentication, instructions, etc.

[1590] A "celebrity" is someone who is generally well-known and recognized by many people, including famous actors, athletes, singers, etc.

[1591] "Profile Information" refers to detailed information about a celebrity, such as their name, photo, voice sample, and biography.

[1592] An "AI avatar" is an artificial intelligence model created based on the profile information of a celebrity, and refers to a virtual person who can converse and interact with users in the form of text, voice, image, video, etc.

[1593] "Navigation" refers to a service that allows users to receive route guidance to their destination in an autonomous vehicle.

[1594] "Tourist information" refers to a service that provides information about tourist spots and local areas that can be seen from an autonomous vehicle while the user is traveling.

[1595] "Entertainment" refers to services that provide entertainment such as music, video, and interaction that users can enjoy in their autonomous vehicles.

[1596] "Pricing" refers to the process or method for determining the amount a user must pay when using an AI avatar or a service within an autonomous vehicle.

[1597] "Payment Processing" refers to the process by which a User pays for the Service and the method by which such payment is verified and recorded.

[1598] To implement this invention, we provide a system that allows users to interact with AI avatars of celebrities in self-driving vehicles. Specific embodiments of this system are described below.

[1599] User Registration and Authentication

[1600] First, a user accesses the system and registers by providing input data such as name, email address, and password. The terminal validates this input data and sends it to the server in the appropriate format. The server stores the received data and returns a message to the terminal indicating successful user registration. The user can then use the system.

[1601] AI avatar generation for celebrities

[1602] The user uses a form within the system to enter profile information such as the celebrity's name, photo, voice sample, and biography. The device receives this information, checks the required fields, and then sends it to the server. The server analyzes the received information and passes it to a generative AI model to generate a realistic AI avatar of the celebrity. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device then displays a preview of the AI ​​avatar to the user along with a message of success.

[1603] Start a conversation with an AI avatar

[1604] The user clicks the Start Conversation button to have a conversation with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the AI ​​avatar, and the AI ​​avatar generates an initial greeting message. This generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data, generates a response for the AI ​​avatar, and sends it back to the device. The device displays or plays this to the user. This achieves an interactive dialogue between the user and the AI ​​avatar.

[1605] Providing services inside autonomous vehicles

[1606] Inside the autonomous vehicle, the user wears a head-mounted display and can interact with an AI avatar to receive navigation, tourist information, and entertainment services. In the navigation service, the user sets a destination and the AI ​​avatar provides directions. In addition, in the tourist information function, the AI ​​avatar provides tourist information for the areas the vehicle passes through. In the entertainment function, the AI ​​avatar provides entertainment such as music and videos to the user.

[1607] Pricing and Payment

[1608] The user operates the pricing plan screen and selects options such as usage time and price. This selection data is sent from the terminal to the server, which calculates the fee and displays the payment page on the terminal. When the user enters payment information and completes the payment, the terminal sends a confirmation to the server. The server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan.

[1609] Specific examples

[1610] For example, if a user generates an AI avatar of a famous actor and asks the AI ​​avatar to navigate to "Tokyo Tower" in a self-driving vehicle, the AI ​​avatar will begin providing directions and information about tourist spots they will pass along the way. Entertainment features such as playing favorite music to make the journey more comfortable are also provided. An example of a prompt sentence would be "generate ai avatar for celebrity actor with bio..." and the generative AI model would be able to generate an actor's avatar.

[1611] This system will further enrich the user experience, making travel time in an autonomous vehicle more comfortable and meaningful.

[1612] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1613] Step 1:

[1614] A user accesses the system and registers by entering their name, email address, and password. The terminal receives this input data and performs validation. Once validation is complete, the terminal sends the data to the server. The server stores the received data and returns a message to the terminal indicating successful user registration. The input for this step is the name, email address, and password, and the output is a message indicating successful user registration.

[1615] Step 2:

[1616] The user enters the celebrity's profile information, such as their name, photo, voice sample, and biography, into a form within the system. The device receives this information, checks the required fields, and then sends it to the server. The server analyzes the received information and passes it to a generative AI model to generate a realistic AI avatar of the celebrity. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device then displays a preview of the AI ​​avatar to the user along with a message of success. The input of this step is the celebrity's profile information, and the output is a preview of the generated AI avatar.

[1617] Step 3:

[1618] The user clicks the Start Conversation button to have a conversation with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the AI ​​avatar, and the AI ​​avatar generates an initial greeting message. This generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data and generates a response for the AI ​​avatar, which is sent back to the device. The device displays or plays this to the user. The input of this step is the user's response, and the output is the AI ​​avatar's response.

[1619] Step 4:

[1620] Inside the autonomous vehicle, the user wears a head-mounted display and receives navigation, tourist information, and entertainment services through interactions with an AI avatar. When the user sets a destination, the device sends this information to the server. The server calculates a navigation route based on the destination and has the AI ​​avatar provide directions. The tourist information function also generates tourist information for the areas the vehicle passes through, which the AI ​​avatar provides to the user. For the entertainment function, the server plays selected music and video content. The inputs to this step are the destination setting and entertainment selection, and the outputs are route information, tourist information, and entertainment content.

[1621] Step 5:

[1622] The user operates the pricing plan screen and selects options such as usage time and price. This selection data is sent from the terminal to the server, which calculates the fee and then displays the payment page on the terminal. When the user enters payment information and completes the payment, the terminal sends a confirmation to the server. The server verifies and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan. The input to this step is the pricing plan selection data and payment information, and the output is a payment success message.

[1623] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1624] This invention provides a B2C web platform that allows users to easily interact with AI avatars of celebrities. In particular, this system is equipped with an emotion engine that recognizes users' emotions and can generate responses according to the user's emotions. Specific embodiments of this system are described below.

[1625] User Registration and Authentication

[1626] A user first accesses the system and enters information such as name, email address, and password on the new registration screen. The terminal receives this input data and validates that all required fields have been entered. Once validation is complete, the terminal sends the data to the server. The server stores the received data and returns a registration success message to the terminal. This registers the user in the system and they can begin using it.

[1627] AI avatar generation for celebrities

[1628] The user enters the celebrity's profile information, such as their name, photo, voice sample, and biography, into a form within the system. The device receives this information and validates it for completeness. After validation, the device sends this data to the server. The server analyzes the received information and passes it to the AI ​​generation model. The AI ​​generation model generates a realistic AI avatar of the celebrity. This avatar can respond in the form of text, voice, image, or video. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device displays a preview of the AI ​​avatar to the user along with a message of success.

[1629] Start a conversation with an AI avatar

[1630] The user clicks the Start Conversation button to converse with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the selected AI avatar and generates an initial greeting message. The generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data and generates a response for the AI ​​avatar. This response is sent back to the device, which displays or plays it back to the user. This achieves an interactive conversation between the user and the AI ​​avatar.

[1631] Emotion Engine Operation

[1632] The system is equipped with an emotion engine that recognizes the user's emotions. When the user provides input in the form of text, voice, image, or video, the device sends this data to the emotion engine. The emotion engine analyzes the input data and recognizes the user's emotional state. For example, it identifies emotions such as "happy" if the user is happy, or "sad" if the user is sad. The emotion engine then sends the recognized emotion data to the server. The server generates a response for the AI ​​avatar based on the emotion data, and the response is delivered in a content and tone that matches the user's emotion.

[1633] Pricing and Payment

[1634] The user operates the pricing plan screen and selects the usage time and price options. For example, plans include 30 minutes for 500 yen or 1 hour for 1,000 yen. The terminal sends the selected data to the server. The server calculates the fee and displays the payment page on the terminal. When the user enters the payment information and completes the payment, the terminal sends confirmation to the server. The server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan.

[1635] Specific examples

[1636] For example, suppose a user registers in the system under the name "Yamada Taro" and generates an AI avatar of a celebrity named "Tanaka Minako." The user enters their profile information and checks a preview of the generated avatar. Next, after selecting a pricing plan and completing payment, a conversation with Tanaka Minako's AI avatar begins. The user asks questions via text or voice, and the AI ​​avatar responds individually. Furthermore, the emotion engine recognizes the user's emotions based on their input and generates responses accordingly, resulting in a more intimate and adapted conversation. In this way, users can easily enjoy interactive interactions with celebrities.

[1637] The embodiments of the present invention allow users to interact with realistic AI avatars of celebrities in a variety of ways, while keeping psychological and economic hurdles low, and receiving responses that correspond to their emotions.

[1638] The processing flow will be explained below.

[1639] User Registration and Authentication

[1640] Step 1:

[1641] The user accesses the new registration screen and enters registration information such as name, email address, and password.

[1642] Step 2:

[1643] The terminal receives the entered information and validates that all required fields have been entered.

[1644] Step 3:

[1645] The terminal sends the data that has passed validation to the server.

[1646] Step 4:

[1647] The server receives the submitted data and creates a new user record in the database.

[1648] Step 5:

[1649] The server returns a successful response to the terminal.

[1650] Step 6:

[1651] The terminal receives the response and displays a "Registration successful" message to the user.

[1652] AI avatar generation for celebrities

[1653] Step 1:

[1654] A user enters profile information such as the celebrity's name, photo, voice sample, and biography.

[1655] Step 2:

[1656] The terminal receives the entered information and validates it to ensure there are no missing details.

[1657] Step 3:

[1658] The device sends the validated data to the server.

[1659] Step 4:

[1660] The server analyzes the received data and passes it to the AI ​​generation model.

[1661] Step 5:

[1662] The server's AI generative model uses the data to generate an AI avatar of the celebrity, which can respond in the form of text, voice, images, and video.

[1663] Step 6:

[1664] The server stores the generated AI avatar in a database and returns a response indicating successful generation to the device.

[1665] Step 7:

[1666] The device receives the response and displays a preview of the generated AI avatar to the user.

[1667] Start a conversation with an AI avatar

[1668] Step 1:

[1669] The user selects the AI ​​avatar they want to talk to and clicks the Start Conversation button.

[1670] Step 2:

[1671] The terminal sends a conversation initiation request to the server.

[1672] Step 3:

[1673] The server creates a conversation session with the selected AI avatar and generates an initial greeting message.

[1674] Step 4:

[1675] The server sends the generated initial message to the terminal.

[1676] Step 5:

[1677] The terminal displays a welcome message to the user.

[1678] Step 6:

[1679] The user enters a response by text or voice.

[1680] Step 7:

[1681] The terminal sends the user's input to the server.

[1682] Step 8:

[1683] The server analyzes the user's input data, and the emotion engine recognizes the user's emotions.

[1684] Step 9:

[1685] The emotion engine sends the emotion data to the server, which processes it so that the AI ​​avatar can generate a response according to the emotion.

[1686] Step 10:

[1687] The server sends the generated AI avatar's response to the device.

[1688] Step 11:

[1689] The terminal receives the response and displays or plays it back to the user, and this process is repeated to continue the interactive conversation.

[1690] Pricing and Payment

[1691] Step 1:

[1692] The user accesses the pricing plan screen and sees the available time and price options.

[1693] Step 2:

[1694] The user selects the plan they want and enters their payment information.

[1695] Step 3:

[1696] The terminal sends the selected plan and payment information to the server.

[1697] Step 4:

[1698] The server receives the transmitted data and executes the payment process in cooperation with the payment system.

[1699] Step 5:

[1700] The server checks the result of the payment process and returns a success or failure response to the terminal.

[1701] Step 6:

[1702] The terminal receives the result of the payment process and displays a message to the user saying "Payment completed." If the payment is successful, a message also appears stating that the user is authorized to start using the service.

[1703] Specific examples

[1704] Step 1:

[1705] For example, when a user registers a new account under the name "Yamada Taro," the steps of user registration and authentication are executed in order.

[1706] Step 2:

[1707] After completing registration, the user wants to generate an AI avatar for a celebrity named "Minako Tanaka." To do this, the user enters the celebrity's profile information into a form and executes the steps to generate the celebrity's AI avatar.

[1708] Step 3:

[1709] After the AI ​​avatar is generated and the user checks its preview, the user executes a series of steps to start a conversation with the AI ​​avatar, including a procedure in which the emotion engine recognizes the emotion when the user provides emotional input and generates an adapted response.

[1710] Step 4:

[1711] After the conversation ends, the user performs the steps of setting the price and paying for the usage time. Once payment is completed based on the selected plan, the system usage is officially terminated.

[1712] In this way, users can not only easily enjoy interactive conversations with AI avatars of celebrities, but also experience more intimate and adapted interactions by receiving responses based on their emotions.

[1713] Example 2

[1714] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1715] In recent years, advances in AI technology have led to an increasing demand for interactive dialogue systems. However, conventional dialogue systems often lack the ability to fully recognize user emotions and generate appropriate responses. As a result, they can only provide one-way information to users, resulting in a poor user experience. Furthermore, real-time responses are difficult to make for pricing and payment processing, requiring cumbersome procedures for users. To solve these problems, a system capable of recognizing user emotions in real time and generating adaptive responses is needed.

[1716] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1717] In this invention, the server includes means for receiving input data from a user and performing user registration, means for generating an AI avatar based on profile information of a celebrity, means for enabling conversation with the generated AI avatar, means for transmitting the input data to an emotion engine and recognizing the user's emotions, means for generating a response from the AI ​​avatar based on the recognized emotion data, and means for setting fees according to usage and performing payment processing.

[1718] This allows users to receive real-time emotional responses when using the system, resulting in a more personalized and interactive experience, as well as simplified pricing and payment processing, improving the user experience.

[1719] A "user" is a person who uses the system to register, interact, make payments, and perform other operations.

[1720] "Input Data" refers to information provided by a user to the system, including names, email addresses, passwords, celebrity profile information, text, audio, images, and video.

[1721] "Validation" is the process of checking whether the data entered by the user meets the system requirements.

[1722] The "server" is the central computer in the system that receives, stores, analyzes, and generates AI avatars from data entered by users.

[1723] A "terminal" is a device that a user uses to access the system and input and display data, including a PC, smartphone, tablet, etc.

[1724] An "AI avatar" is a virtual presence generated based on a celebrity's profile information and can respond to users in the form of text, voice, image, and / or video.

[1725] An "emotion engine" is a software component that analyzes user input data and recognizes the user's emotional state.

[1726] "Pricing" is the process of determining the time and price plan a user may select to use the system.

[1727] "Payment processing" refers to the process in which a user enters payment information based on the selected fee plan and actually pays the fee.

[1728] "Profile Information" is information associated with a public figure, such as name, photograph, voice sample, and biography.

[1729] A "generative AI model" is an artificial intelligence algorithm for generating AI avatars based on input data.

[1730] A "response" is a reply message generated by an AI avatar in response to user input, and can include text, audio, images, and video.

[1731] This invention provides a web platform that allows users to easily interact with AI avatars of celebrities. In particular, it is equipped with an emotion engine that can generate responses according to the user's emotions.

[1732] Overall system configuration

[1733] The system mainly includes the following components:

[1734] 1. User's device: a device such as a computer, smartphone, or tablet.

[1735] 2. Server: The central computer that stores and analyzes input data, generates AI avatars, and runs the emotion engine.

[1736] 3. Emotion Engine: A software component that recognizes the user's emotional state and generates a response based on it.

[1737] 4. Generative AI model: An artificial intelligence algorithm that generates AI avatars based on celebrity profile information.

[1738] User Registration and Authentication

[1739] 1. The user accesses the system and enters their name, email address, password, etc. on the new registration screen.

[1740] 2. The terminal receives the input data and validates that all required fields are entered.

[1741] 3. Once the validation is complete, the device sends the data to the server.

[1742] 4. The server stores the received data and returns a registration success message to the terminal.

[1743] 5. The terminal displays a registration success message to the user.

[1744] AI avatar generation for celebrities

[1745] 1. Users enter profile information such as the celebrity's name, photo, voice sample, and biography into a form within the system.

[1746] 2. The terminal receives this information and validates the input for any missing information.

[1747] 3. The device sends the data to the server.

[1748] 4. The server analyzes the received information and passes it to the generative AI model.

[1749] 5. The generative AI model generates realistic AI avatars of celebrities and stores them in a database.

[1750] 6. The server returns a creation success message to the terminal.

[1751] 7. The device will display a preview of the AI ​​avatar to the user along with a message that creation was successful.

[1752] Start a conversation with an AI avatar

[1753] 1. The user clicks the Start Conversation button to begin a conversation with the generated AI avatar.

[1754] 2. The device sends a request to the server.

[1755] 3. The server initiates a conversation session with the selected AI avatar and generates an initial greeting message and sends it to the device.

[1756] 4. The terminal displays an initial greeting message to the user.

[1757] 5. When the user responds with text or voice, the device sends this to the server.

[1758] 6. The server analyzes the data and generates a response for the AI ​​avatar.

[1759] 7. The server sends the response to the terminal, which displays or plays it back to the user.

[1760] Emotion Engine Operation

[1761] 1. When the user provides input in the form of text, voice, image, or video, the device sends this to the emotion engine.

[1762] 2. The emotion engine analyzes the input data and recognizes the user's emotional state.

[1763] 3. The emotion engine sends the recognized emotion data to the server.

[1764] 4. The server generates a response for the AI ​​avatar based on the emotion data.

[1765] 5. The server provides a response with content and tone that matches the user's emotions.

[1766] Pricing and Payment

[1767] 1. The user navigates to the pricing plan screen and selects usage time and price options.

[1768] 2. The device sends the selection data to the server.

[1769] 3. The server calculates the fee and displays the payment page on the terminal.

[1770] 4. Once the user enters their payment information and completes the payment, the terminal sends a confirmation to the server.

[1771] 5. The server confirms and saves the payment data and returns permission to start using the service to the device.

[1772] 6. The terminal will display a message that the payment was successful.

[1773] Specific examples

[1774] For example, suppose a user registers with the system under the name "Yamada Taro" and generates an AI avatar of a famous person named "Tanaka Minako." After selecting a pricing plan and completing payment, a conversation with Tanaka Minako's AI avatar begins. The user asks questions via text or voice, and the AI ​​avatar responds individually. Furthermore, the emotion engine recognizes the user's emotions based on their input and generates responses accordingly, resulting in a more intimate and adapted conversation.

[1775] Example prompt:

[1776] User: I want to register in the system

[1777] Device: Display new registration screen

[1778] User: Enter your name, email address, and password

[1779] Device: Sends data to server

[1780] Server: Saves the data and returns a registration success message to the device.

[1781] Device: Display a registration success message to the user

[1782] This embodiment of the present invention allows users to easily interact with realistic AI avatars of celebrities while minimizing psychological and economic barriers, and the emotion recognition function allows users to receive more personalized responses.

[1783] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1784] User Registration and Authentication

[1785] Step 1:

[1786] The user accesses the system and enters information such as name, email address, and password on the new registration screen.

[1787] Input: Name, Email Address, Password

[1788] Output: Input data

[1789] Step 2:

[1790] The terminal receives the entered data and validates that all required fields have been entered.

[1791] Input: Input data

[1792] Output: Validation result (success / failure)

[1793] Behavior: Checks whether the entered data is in the correct format.

[1794] Step 3:

[1795] Once the validation is complete, the terminal sends the data to the server.

[1796] Input: Data that has been successfully validated

[1797] Output: Data sent to the server

[1798] Step 4:

[1799] The server stores the received data and returns a registration success message to the terminal.

[1800] Input: Data sent to the server

[1801] Output: Registration successful message

[1802] What it does: Saves user information in a database.

[1803] Step 5:

[1804] The terminal displays a registration successful message to the user.

[1805] Input: Registration success message

[1806] Output: Shown to the user

[1807] AI avatar generation for celebrities

[1808] Step 1:

[1809] Users fill out a form within the system to enter profile information such as the celebrity's name, photo, voice sample, and biography.

[1810] Input: celebrity name, photo, voice sample, biography

[1811] Output: Input data

[1812] Step 2:

[1813] The terminal receives this information and validates the input for any missing information.

[1814] Input: Input data

[1815] Output: Validation result (success / failure)

[1816] Behavior: Checks whether all the input data is present.

[1817] Step 3:

[1818] The terminal transmits the data to the server.

[1819] Input: Data that has been successfully validated

[1820] Output: Data sent to the server

[1821] Step 4:

[1822] The server analyzes the received information and passes it to the generative AI model.

[1823] Input: Data sent to the server

[1824] Output: Input data to a generative AI model

[1825] Step 5:

[1826] The generative AI model generates realistic AI avatars of celebrities and stores them in a database.

[1827] Input: Input data to the generative AI model

[1828] Output: Generated AI avatar

[1829] Operation: Analyze using a model and generate an AI avatar.

[1830] Step 6:

[1831] The server returns a creation success message to the terminal.

[1832] Input: Generated AI avatar

[1833] Output: Creation successful message

[1834] Step 7:

[1835] The device will display a preview of the AI ​​avatar to the user along with a message that creation was successful.

[1836] Input: Generation success message, AI avatar preview

[1837] Output: Shown to the user

[1838] Start a conversation with an AI avatar

[1839] Step 1:

[1840] The user clicks the Start Conversation button to begin a conversation with the generated AI avatar.

[1841] Input: Click the Start Conversation button

[1842] Output: Conversation start request

[1843] Step 2:

[1844] The terminal sends a request to the server.

[1845] Input: Conversation start request

[1846] Output: Request sent to the server

[1847] Step 3:

[1848] The server initiates a conversation session with the selected AI avatar and generates an initial greeting message to send to the device.

[1849] Input: Conversation start request

[1850] Output: Initial greeting message

[1851] What it does: Manages the session and generates the initial message.

[1852] Step 4:

[1853] The terminal displays an initial greeting message to the user.

[1854] Input: Initial greeting message

[1855] Output: Shown to the user

[1856] Step 5:

[1857] When the user responds with text or voice, the device sends this to the server.

[1858] Input: Text or voice response

[1859] Output: Response data sent to the server

[1860] Step 6:

[1861] The server analyzes the data and generates a response for the AI ​​avatar.

[1862] Input: User response data

[1863] Output: The generated AI avatar's response

[1864] Behavior: Analyzes the received data and generates an appropriate response.

[1865] Step 7:

[1866] The server sends the response to the terminal, which displays or plays it back to the user.

[1867] Input: The response of the generated AI avatar

[1868] Output: Show or play to the user

[1869] Emotion Engine Operation

[1870] Step 1:

[1871] The user provides input in the form of text, audio, images, or video.

[1872] Input: Text, audio, image, and video input

[1873] Output: Input data

[1874] Step 2:

[1875] The device sends this data to the emotion engine.

[1876] Input: Input data

[1877] Output: Input data to the emotion engine

[1878] Step 3:

[1879] The emotion engine analyzes the input data and recognizes the user's emotional state.

[1880] Input: Input data to the emotion engine

[1881] Output: Recognized emotion data

[1882] How it works: Input data is analyzed using emotion recognition algorithms.

[1883] Step 4:

[1884] The emotion engine sends the recognized emotion data to the server.

[1885] Input: Recognized emotion data

[1886] Output: Emotion data sent to the server

[1887] Step 5:

[1888] The server generates responses for the AI ​​avatar based on the emotional data.

[1889] Input: Emotion data sent to the server

[1890] Output: Emotion-adapted AI avatar responses

[1891] Action: Generate a response based on the emotion data.

[1892] Step 6:

[1893] The server provides a response with content and tone that matches the user's emotions.

[1894] Input: Emotion-adaptive AI avatar responses

[1895] Output: Show or play to the user

[1896] Pricing and Payment

[1897] Step 1:

[1898] Users navigate through the pricing plan screen and select usage time and price options.

[1899] Input: Time and price options

[1900] Output: Selected data

[1901] Step 2:

[1902] The terminal transmits the selection data to the server.

[1903] Input:Selection data

[1904] Output: Data sent to the server

[1905] Step 3:

[1906] The server performs the billing calculation.

[1907] Input: Data sent to the server

[1908] Output: Charge calculation results

[1909] How it works: Calculates charges based on time and price.

[1910] Step 4:

[1911] The server displays a payment page on the terminal.

[1912] Input: Fee calculation result

[1913] Output: Payment page

[1914] Step 5:

[1915] The user enters payment information and completes the payment.

[1916] Input: Payment information

[1917] Output: Payment completion data

[1918] Step 6:

[1919] The terminal sends a confirmation to the server.

[1920] Input: Payment completion data

[1921] Output: Payment confirmation request

[1922] Step 7:

[1923] The server verifies and stores the payment data.

[1924] Input: Payment confirmation request

[1925] Output: Confirmation completed message

[1926] What it does: Stores and verifies payment data.

[1927] Step 8:

[1928] The server returns permission to start using the device.

[1929] Input: Confirmation completion message

[1930] Output: Permission to start using

[1931] Step 9:

[1932] The terminal will display a message that the payment was successful.

[1933] Input: Permission to start using

[1934] Output: Payment successful message

[1935] (Application example 2)

[1936] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1937] Modern factories require efficient sharing of skills among technicians and engineers and rapid problem-solving. However, receiving real-time on-site training is difficult, posing a significant barrier, especially for new or inexperienced staff. Furthermore, there is a lack of emotion-based feedback, which creates challenges in terms of work efficiency and mental health. Therefore, there is a need for a system that provides technical assistance and appropriate feedback through emotion recognition within factories.

[1938] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means including an emotion engine that analyzes voice data from factory staff and robots, means for generating a response of an AI avatar based on the analysis results of the emotion engine, and means for generating an AI avatar based on the profile information of the engineer. This allows for real-time technical support and feedback according to the staff's emotions.

[1939] "User" means any person or entity that registers, accesses, and operates using the System.

[1940] "Input data" refers to information such as text, audio, images, or video that a user provides to a system.

[1941] "User registration" is the process by which a new user enters their information into the system and obtains the right to use the system.

[1942] An "engineer" is an individual who has a high level of expertise or skill in a particular field.

[1943] "Profile Information" is individual information that may include a person's name, photo, voice sample, biography, etc.

[1944] An "AI avatar" is a digital character that resembles a specific person and is generated using AI technology.

[1945] A "conversation" is an interaction between a user and an AI avatar via text, voice, images, or video.

[1946] "Pricing" is the process of determining the costs and plans required to use the system.

[1947] "Payment processing" refers to the procedures and operations required for users to pay system usage fees.

[1948] An "emotion engine" is an AI technology that analyzes user input data and identifies their emotional state.

[1949] "Analysis" is the process of examining input data in detail and understanding its content and meaning.

[1950] "Generating a response" is the process by which a system creates an appropriate reply to input from a user.

[1951] "Factory staff" refers to employees and personnel working on the manufacturing floor.

[1952] A "robot" is an automated mechanical device that is programmed to perform specific tasks.

[1953] A "server" is a computer system that stores, processes data, and provides services to other devices on a network.

[1954] A system for realizing this invention will now be described in detail. The system is composed of a series of components including a user, a terminal, a server, and an AI avatar.

[1955] First, a user uses a terminal to register and access the system. The terminal receives input data (e.g., name, email address, password), validates them, and sends them to the server. The server stores the received data and sends a registration success message to the terminal.

[1956] The next phase is to generate an AI avatar based on the engineer's profile information. The user enters the person's name, photo, voice sample, and career information into a form on the device. The device checks for missing information and sends it to the server. The server analyzes the information and generates an AI avatar based on a generative AI model (e.g., GPT-4). This AI avatar can respond in the form of text, voice, image, or video. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device displays a preview of the AI ​​avatar to the user along with a message of success.

[1957] The user can have an interactive conversation with the generated AI avatar. When the user clicks the conversation start button on the device, the device sends a request to the server. The server starts the conversation session, generates an initial greeting message, and sends it to the device. The user's text and voice responses are sent from the device to the server, and the server generates responses for the AI ​​avatar and sends them back to the device.

[1958] Furthermore, the system incorporates an emotion engine that recognizes emotions from user input data. It identifies the emotional state (e.g., "joy" or "sadness") and transmits it to the server. The server then generates a response for the AI ​​avatar based on the emotional data, providing appropriate feedback according to the user's emotions.

[1959] When installed on factory staff and robots, this system can also be used as a tool to improve factory work efficiency. Factory staff can talk to an AI avatar of a technician in real time through smart glasses or a robot and receive technical support. This is expected to help solve problems during production and improve efficiency.

[1960] Specific examples

[1961] When a factory line engineer needs to fix a malfunction in the electrical system, he calls up an AI avatar of "Technician A" through smart glasses. The interaction goes as follows:

[1962] Engineer: "Technician A, the light switch isn't working. What should I do?"

[1963] Technician A AI: "Check the circuit first. Don't worry, you can do it."

[1964] Prompt Sentence Examples

[1965] If an electrical system malfunction occurs on a factory production line, provide advice on how to troubleshoot the circuit, including encouraging impatient engineers to stay calm.

[1966] This allows the invention to provide real-time technical assistance and emotion-recognition-based feedback to prioritize and improve efficiency and effectiveness in factories and other workplaces.

[1967] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1968] Step 1:

[1969] The server receives input data from the user (name, email address, password). The device validates this data, ensuring all required fields are filled in, and sends the data to the server. The server stores the data and returns a registration success message to the device.

[1970] Step 2:

[1971] The user uses the device to input the technician's profile information (name, photo, voice sample, and resume). The device receives this information, validates it for any missing information, and then sends the data to the server. The server analyzes the received data and generates an AI avatar using a generative AI model.

[1972] Step 3:

[1973] The server saves the generated AI avatar in a database and returns a preview of the AI ​​avatar along with a message confirming the creation to the device. The device displays this preview to the user, who can then click the Start Conversation button to begin the conversation.

[1974] Step 4:

[1975] The device sends the user's conversation start request to the server, which starts a conversation session between the AI ​​avatar and the user, generates an initial greeting message, and sends it to the device, which then displays the greeting message to the user.

[1976] Step 5:

[1977] The user enters a response via text or voice, and the device sends this response data to the server, which analyzes the data and generates a response from the AI ​​avatar. This response is then sent back to the device, which displays or plays it back to the user.

[1978] Step 6:

[1979] The device sends the user's input data (text, voice, image, video) to the emotion engine, which analyzes this data and recognizes the emotional state (e.g., "joy," "sadness," etc.). The emotional data is then sent to the server.

[1980] Step 7:

[1981] The server generates a response from the AI ​​avatar based on the emotional data received from the emotion engine. This response is created with content and tone that matches the user's emotion and is sent to the device. The device then displays or plays the response to the user based on this emotion.

[1982] Step 8:

[1983] The user selects a pricing plan and enters payment information through the terminal. The terminal sends this data to the server. The server calculates the fee and generates a payment page that is displayed on the terminal. Once the user completes the payment, the server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user indicating that payment was successful, and the user can begin using the service based on the selected plan.

[1984] This completes the entire processing flow, and the interactive conversation between the user and the AI ​​avatar continues.

[1985] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1986] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1987] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1988] [Fourth embodiment]

[1989] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1990] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1991] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1992] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1993] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1994] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1995] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1996] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1997] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1998] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1999] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2000] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2001] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2002] This invention provides a B2C web platform that allows users to easily interact with AI avatars of celebrities. This system allows users to easily converse with AI avatars of celebrities and offers flexibility in terms of time and price. Specific embodiments of this system are described below.

[2003] User Registration and Authentication

[2004] A user first accesses the system and enters information such as name, email address, and password on the new registration screen. The terminal receives this input data and performs validation. Once validation is complete, the terminal sends the data to the server. The server stores the received data and returns a registration success message to the terminal. This registers the user in the system and they can begin using it.

[2005] AI avatar generation for celebrities

[2006] The user enters the celebrity's profile information, such as their name, photo, voice sample, and biography, into a form within the system. The device receives this information and verifies the required fields. After verification, the device sends this data to the server. The server analyzes the received information and passes it to the AI ​​generation model. The AI ​​generation model generates a realistic AI avatar of the celebrity. This avatar is designed to respond in the form of text, voice, image, or video. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device displays a preview of the AI ​​avatar to the user along with a message of success.

[2007] Start a conversation with an AI avatar

[2008] The user clicks the Start Conversation button to converse with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the AI ​​avatar, and the AI ​​avatar generates an initial greeting message. The generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data and generates a response for the AI ​​avatar. This response is sent back to the device, which displays or plays it back to the user. This achieves an interactive conversation between the user and the AI ​​avatar.

[2009] Pricing and Payment

[2010] The user operates the pricing plan screen and selects the usage time and price options. For example, plans include 30 minutes for 500 yen or 1 hour for 1,000 yen. The terminal sends the selected data to the server. The server calculates the fee and displays the payment page on the terminal. When the user enters the payment information and completes the payment, the terminal sends confirmation to the server. The server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan.

[2011] Specific examples

[2012] For example, suppose a user registers in the system under the name "Yamada Taro" and generates an AI avatar of a famous person named "Tanaka Minako." The user enters their profile information and checks a preview of the generated avatar. Next, after selecting a pricing plan and completing payment, a conversation with Tanaka Minako's AI avatar begins. The user asks questions via text or voice, and the AI ​​avatar responds individually to them. In this way, users can easily enjoy interactive interactions with famous people.

[2013] The embodiments of the present invention allow users to interact with real AI avatars of celebrities in a variety of ways while keeping psychological and economic hurdles low.

[2014] The processing flow will be explained below.

[2015] User Registration and Authentication

[2016] Step 1:

[2017] The user accesses the new registration screen and enters registration information such as name, email address, and password.

[2018] Step 2:

[2019] The terminal receives the entered information and validates that all required fields have been entered.

[2020] Step 3:

[2021] The terminal sends the data that has passed validation to the server.

[2022] Step 4:

[2023] The server receives the submitted data and creates a new user record in the database.

[2024] Step 5:

[2025] The server returns a successful response to the terminal.

[2026] Step 6:

[2027] The terminal receives the response and displays a "Registration successful" message to the user.

[2028] AI avatar generation for celebrities

[2029] Step 1:

[2030] A user enters profile information such as the celebrity's name, photo, voice sample, and biography.

[2031] Step 2:

[2032] The terminal receives the entered information and validates it to ensure there are no missing details.

[2033] Step 3:

[2034] The device sends the validated data to the server.

[2035] Step 4:

[2036] The server analyzes the received data and passes it to the AI ​​generation model.

[2037] Step 5:

[2038] The server's AI generative model uses the data to generate an AI avatar of the celebrity, which can respond in the form of text, voice, images, and video.

[2039] Step 6:

[2040] The server stores the generated AI avatar in a database and returns a response indicating successful generation to the device.

[2041] Step 7:

[2042] The device receives the response and displays a preview of the generated AI avatar to the user.

[2043] Start a conversation with an AI avatar

[2044] Step 1:

[2045] The user selects the AI ​​avatar they want to talk to and clicks the Start Conversation button.

[2046] Step 2:

[2047] The terminal sends a conversation initiation request to the server.

[2048] Step 3:

[2049] The server creates a conversation session with the selected AI avatar and generates an initial greeting message.

[2050] Step 4:

[2051] The server sends the generated initial message to the terminal.

[2052] Step 5:

[2053] The terminal displays a welcome message to the user.

[2054] Step 6:

[2055] The user enters a response by text or voice.

[2056] Step 7:

[2057] The terminal sends the user's input to the server.

[2058] Step 8:

[2059] The server receives the user's input data and processes it to generate a response from the AI ​​avatar.

[2060] Step 9:

[2061] The server sends the generated AI avatar's response to the device.

[2062] Step 10:

[2063] The terminal receives the response and displays or plays it back to the user, and this process is repeated to continue the interactive conversation.

[2064] Pricing and Payment

[2065] Step 1:

[2066] The user accesses the pricing plan screen and sees the available time and price options.

[2067] Step 2:

[2068] The user selects the plan they want and enters their payment information.

[2069] Step 3:

[2070] The terminal sends the selected plan and payment information to the server.

[2071] Step 4:

[2072] The server receives the transmitted data and executes the payment process in cooperation with the payment system.

[2073] Step 5:

[2074] The server checks the result of the payment process and returns a success or failure response to the terminal.

[2075] Step 6:

[2076] The terminal receives the result of the payment process and displays a message to the user saying "Payment completed." If the payment is successful, a message also appears stating that the user is authorized to start using the service.

[2077] Example 1

[2078] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2079] Although systems exist that allow users to easily interact with celebrity avatars, the process of user registration, entering profile information, and starting a conversation is cumbersome, and the pricing and payment processes are also complicated, making it difficult for users to use. Another problem is that the process for generating AI avatars is unclear, and the quality of responses cannot be guaranteed. It is necessary to resolve these issues and enable users to use the system intuitively and smoothly.

[2080] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2081] In this invention, the server includes means for receiving input data from a user and performing user registration, means for generating an AI avatar based on the celebrity's profile information, means for enabling conversation with the generated AI avatar, means for setting fees according to usage and processing payments, means for validating the input data and transmitting it to the server in an appropriate format, means for starting a conversation session and generating an initial greeting message, and means for analyzing the user's response data and generating a response for the AI ​​avatar. This allows users to easily use the system and smoothly interact with the celebrity's AI avatar.

[2082] "Input data" refers to information that users enter into the system, such as names, email addresses, passwords, and celebrity profile information.

[2083] "User registration" is the process in which a user provides information such as name, email address, and password to use the system, and the system receives and stores that information.

[2084] "Profile information" refers to information necessary to generate an AI avatar, such as a celebrity's name, photo, voice sample, and biography.

[2085] An "AI avatar" is an artificially intelligent character that has the appearance, voice, and personality of a famous person, created using a generative AI model.

[2086] A "conversation session" is the process in which a user and an AI avatar communicate with each other through text and voice.

[2087] "Pricing" refers to the process by which a user selects a pricing plan when using a conversation service with an AI avatar.

[2088] "Payment processing" refers to the process of entering payment information and completing payment based on the rate plan selected by the user.

[2089] Validation is the process of ensuring that the data entered by a user into a system is accurate and meets the required format and conditions.

[2090] The "server" is the central control unit of the system, a computer device that receives and stores data from users, generates AI avatars, and manages conversation sessions.

[2091] A "generative AI model" is an artificial intelligence algorithm that generates realistic AI avatars of celebrities based on input profile information.

[2092] A "prompt" is a text or voice message that a user enters as a question or request to an AI avatar.

[2093] "Proper format" means data formatted in a way that allows the server to parse and process the data correctly.

[2094] An "initial greeting message" is the first message generated by an AI avatar and displayed to the user at the start of a conversation session.

[2095] "Response data" refers to the answers and reactions generated by an AI avatar in response to user input.

[2096] The present invention provides a system for providing a web platform that allows users to easily interact with AI avatars of celebrities. Hereinafter, the embodiments of the present invention will be described in detail.

[2097] User Registration and Authentication

[2098] A user accesses the system through a web browser and enters information such as name, email address, and password on the new registration screen. This input data is first validated on the terminal. If validation is successful, the terminal sends the data to the server, which saves it in a database. Once saving is complete, a registration success message is returned to the terminal, and the user is able to access the system.

[2099] AI avatar generation for celebrities

[2100] The user enters profile information, such as the celebrity's name, photo, voice sample, and biography, into a form within the system. The device verifies the required fields of the entered information and sends it to the server. The server analyzes the received profile information and passes it to a generative AI model. The generative AI model uses, for example, GPT-3 or a core image recognition model. The generative AI model generates a realistic AI avatar of the celebrity and stores it in a database on the server. A preview of the AI ​​avatar is returned to the device along with a message indicating generation was successful, and the user can view it.

[2101] As a specific example, if you want to generate an AI avatar for a famous person called "Taro Yamada," you can enter their name, photo, voice sample, and biography, and then check a preview of the generated avatar.

[2102] Start a conversation with an AI avatar

[2103] To converse with the generated AI avatar, the user clicks the Start Conversation button. The device sends this request to the server, which then initiates the conversation session. During this process, the AI ​​avatar generates an initial greeting message and sends it to the device. When the user responds with text or voice, the device sends the response data to the server, which analyzes the data and generates the next response. This response is then sent back to the device and displayed or played back to the user.

[2104] As an example of a specific prompt, if you ask the AI ​​avatar, "Tell me about your recent activities," the AI ​​avatar will generate an appropriate response.

[2105] Pricing and Payment

[2106] The user selects the usage time and price options on the pricing plan screen. For example, they can choose a plan such as 500 yen for 30 minutes or 1,000 yen for 1 hour. The device sends the selected plan data to the server, which calculates the fee and displays the payment page. Once the user enters their payment information and completes the payment, a confirmation of successful payment is sent to the server, and the payment data is confirmed and saved. The user can then begin using the service based on the selected plan.

[2107] For example, if a user selects a 30-minute plan and completes payment with a credit card, a payment success message will be displayed. In this way, the user can smoothly use the service through the system.

[2108] This invention is a system that allows users to interact with AI avatars of real celebrities in a variety of ways while keeping psychological and financial hurdles low.

[2109] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2110] Step 1:

[2111] A user accesses the system through a web browser and enters their name, email address, and password on the new registration screen.

[2112] Input: The user enters their name, email address, and password.

[2113] Specific operation: The user opens a browser, enters information on the registration screen, and clicks the submit button.

[2114] Step 2:

[2115] The terminal receives the data in the input form and performs validation.

[2116] Input: Name, email address, and password entered by the user.

[2117] Data processing: Check the contents of the input data on the terminal (check whether it is in the correct format).

[2118] Output: Validation result (pass / fail).

[2119] What happens: The JavaScript code on the device checks the input data and displays an error message if there is an error.

[2120] Step 3:

[2121] If the validation is successful, the terminal transmits the data to the server.

[2122] Input: Name, email address, and password data that passes validation.

[2123] Data processing: None.

[2124] Output: HTTP request (POST request) from the terminal to the server.

[2125] Specific operation: Data is sent from the terminal to the server.

[2126] Step 4:

[2127] The server stores the received registration data in a database.

[2128] Input: Name, Email Address, Password data.

[2129] Data processing: Saving to a database.

[2130] Output: User information stored in the database.

[2131] Specific operation: On the server side, the registration data is inserted into the database using an SQL query.

[2132] Step 5:

[2133] When the server has completed saving the data in the database, it returns a registration success message to the terminal.

[2134] Input: Successful result of saving to database.

[2135] Data processing: Generate a registration success message.

[2136] Output: HTTP response to the device.

[2137] Specific operation: The server sends a registration success message as an HTTP response.

[2138] Step 6:

[2139] The terminal receives a registration success message from the server and displays it to the user.

[2140] Input: Registration success message from the server.

[2141] Data processing: None.

[2142] Output: Message to display to the user.

[2143] Specific behavior: A message such as "Registration successful" will appear in the browser.

[2144] Step 7:

[2145] Users fill out a form within the system and enter profile information such as the celebrity's name (e.g., "Yamada Taro"), photo, voice sample, and biography.

[2146] Input: celebrity name, photo, voice sample, biographical data.

[2147] What happens: The user enters information in the browser and uploads photos and audio files.

[2148] Step 8:

[2149] The terminal checks the required fields of the entered information and sends it to the server.

[2150] Input: Profile information entered.

[2151] Data processing: Check required fields.

[2152] Output: Verified profile information.

[2153] Specific operation: JavaScript code on the terminal checks the required fields and sends them to the server after confirmation is complete.

[2154] Step 9:

[2155] The server analyzes the received profile information and passes it to the generative AI model.

[2156] Input: Verified profile information.

[2157] Data processing: Analyzing information and converting it into an input format for generative AI models.

[2158] Output: The input data to a generative AI model.

[2159] Specific operation: The server-side program receives the profile information and calls the AI ​​model's API.

[2160] Step 10:

[2161] The generative AI model generates a realistic AI avatar and stores it in a database on the server.

[2162] Input: Parsed profile information.

[2163] Data processing: Generation of AI avatars.

[2164] Output: Generated AI avatar data.

[2165] How it works: The generative AI model learns images and voices of celebrities, creates avatars, and stores them in a database.

[2166] Step 11:

[2167] The server returns a preview of the AI ​​avatar to the device along with a message that creation was successful.

[2168] Input: Data for the generated AI avatar.

[2169] Data processing: Generate a generation success message.

[2170] Output: HTTP response to the device.

[2171] Specific operation: The server sends a generation success message and a preview image as an HTTP response.

[2172] Step 12:

[2173] The device will display a preview of the AI ​​avatar to the user along with a message that creation was successful.

[2174] Input: A success message and a preview image from the server.

[2175] Data processing: None.

[2176] Output: Message and preview image displayed to the user.

[2177] Specific behavior: A preview of the AI ​​avatar will be displayed in the browser.

[2178] Step 13:

[2179] The user clicks the Start Conversation button to have a conversation with the generated AI avatar.

[2180] Input: User clicks.

[2181] Specific action: The user clicks the "Start conversation" button.

[2182] Step 14:

[2183] The terminal sends this request to the server, which then initiates the conversation session.

[2184] Input: A conversation initiation request.

[2185] Data processing: Initializing a conversation session.

[2186] Output: Initial message generation.

[2187] Specific operation: An HTTP request is sent from the terminal to the server, and a conversation session is prepared on the server side.

[2188] Step 15:

[2189] The server sends an initial greeting message generated by the AI ​​avatar to the device, which then displays it to the user.

[2190] Input: An initial greeting message from the AI ​​avatar.

[2191] Data processing: None.

[2192] Output: Message to display to the user.

[2193] Specific operation: The server generates an initial greeting message and sends it as an HTTP response. The device displays it in the browser.

[2194] Step 16:

[2195] When the user responds with text or voice, the terminal sends this response data to the server.

[2196] Input: User text or voice data.

[2197] What happens: The user enters text or records a voice message and clicks the send button.

[2198] Step 17:

[2199] The server analyzes the received data and generates a response for the AI ​​avatar.

[2200] Input: User text or voice data.

[2201] Data processing: data analysis, response generation.

[2202] Output: The generated response data.

[2203] How it works: On the server side, the AI ​​model analyzes the user's input and generates an appropriate response.

[2204] Step 18:

[2205] The server sends the generated response to the terminal, which displays or plays it back to the user.

[2206] Input: The generated response data.

[2207] Data processing: None.

[2208] Output: A message displayed or audio played to the user.

[2209] Specific operation: The server sends the response as an HTTP response, and the device displays it in the browser or plays it as audio.

[2210] Step 19:

[2211] Users select usage time and price options on the pricing plan screen.

[2212] Input: Price plan selection data.

[2213] Specific behavior: The user selects an option on the pricing plan screen and clicks the confirm button.

[2214] Step 20:

[2215] The terminal transmits the selected plan data to the server, which calculates the fee and displays the payment page.

[2216] Input: Selected rate plan data.

[2217] Data processing: calculation of fees.

[2218] Output: Payment page display data.

[2219] Specific operation: Fee calculation is performed on the server side, and payment page data is returned as an HTTP response.

[2220] Step 21:

[2221] The user enters payment information and completes the payment, which the terminal sends to the server.

[2222] Input: Payment information.

[2223] Specific behavior: The user enters credit card information and clicks the pay button.

[2224] Step 22:

[2225] The server verifies the payment data and returns permission to start using the service to the terminal.

[2226] Input: Payment information.

[2227] Data processing: Payment verification.

[2228] Output: Message that permission to start using is granted.

[2229] Specific operation: The payment confirmation process is performed on the server side, and a success message is returned as an HTTP response.

[2230] Step 23:

[2231] The terminal displays a payment success message to the user, and the user begins using services based on the plan.

[2232] Input: Payment success message.

[2233] Data processing: None.

[2234] Output: Message to display to the user.

[2235] Specific operation: A message such as "Payment successful" will be displayed on the browser, and the user can start using the service.

[2236] (Application example 1)

[2237] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2238] Conventional navigation and entertainment systems in autonomous vehicles have provided a poor user experience and limited interaction. Furthermore, the lack of services such as tourist information prevented the enjoyment and convenience of the ride from improving. Furthermore, the lack of a system that easily enabled interaction with celebrities prevented many users from getting an engaging experience. To address these issues, a system that enriches the user experience, enables real-time interaction, and can also provide tourist information and entertainment is needed.

[2239] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2240] In this invention, the server includes means for receiving input data from a user and performing user registration, means for generating an AI avatar based on profile information of a celebrity, means for enabling conversation with the generated AI avatar, and means for providing services such as navigation, tourist information, and entertainment within the self-driving vehicle using the generated AI avatar. This allows users to have an interactive experience within the self-driving vehicle and enjoy a service that integrates navigation, tourist information, and entertainment.

[2241] "User" refers to a person who uses this system to interact with an AI avatar or receive services within an autonomous vehicle.

[2242] "Input Data" means information, including name, email address, password, and other required details, that a User provides to the System for purposes of registration, authentication, instructions, etc.

[2243] A "celebrity" is someone who is generally well-known and recognized by many people, including famous actors, athletes, singers, etc.

[2244] "Profile Information" refers to detailed information about a celebrity, such as their name, photo, voice sample, and biography.

[2245] An "AI avatar" is an artificial intelligence model created based on the profile information of a celebrity, and refers to a virtual person who can converse and interact with users in the form of text, voice, image, video, etc.

[2246] "Navigation" refers to a service that allows users to receive route guidance to their destination in an autonomous vehicle.

[2247] "Tourist information" refers to a service that provides information about tourist spots and local areas that can be seen from an autonomous vehicle while the user is traveling.

[2248] "Entertainment" refers to services that provide entertainment such as music, video, and interaction that users can enjoy in their autonomous vehicles.

[2249] "Pricing" refers to the process or method for determining the amount a user must pay when using an AI avatar or a service within an autonomous vehicle.

[2250] "Payment Processing" refers to the process by which a User pays for the Service and the method by which such payment is verified and recorded.

[2251] To implement this invention, we provide a system that allows users to interact with AI avatars of celebrities in self-driving vehicles. Specific embodiments of this system are described below.

[2252] User Registration and Authentication

[2253] First, a user accesses the system and registers by providing input data such as name, email address, and password. The terminal validates this input data and sends it to the server in the appropriate format. The server stores the received data and returns a message to the terminal indicating successful user registration. The user can then use the system.

[2254] AI avatar generation for celebrities

[2255] The user uses a form within the system to enter profile information such as the celebrity's name, photo, voice sample, and biography. The device receives this information, checks the required fields, and then sends it to the server. The server analyzes the received information and passes it to a generative AI model to generate a realistic AI avatar of the celebrity. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device then displays a preview of the AI ​​avatar to the user along with a message of success.

[2256] Start a conversation with an AI avatar

[2257] The user clicks the Start Conversation button to have a conversation with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the AI ​​avatar, and the AI ​​avatar generates an initial greeting message. This generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data, generates a response for the AI ​​avatar, and sends it back to the device. The device displays or plays this to the user. This achieves an interactive dialogue between the user and the AI ​​avatar.

[2258] Providing services inside autonomous vehicles

[2259] Inside the autonomous vehicle, the user wears a head-mounted display and can interact with an AI avatar to receive navigation, tourist information, and entertainment services. In the navigation service, the user sets a destination and the AI ​​avatar provides directions. In addition, in the tourist information function, the AI ​​avatar provides tourist information for the areas the vehicle passes through. In the entertainment function, the AI ​​avatar provides entertainment such as music and videos to the user.

[2260] Pricing and Payment

[2261] The user operates the pricing plan screen and selects options such as usage time and price. This selection data is sent from the terminal to the server, which calculates the fee and displays the payment page on the terminal. When the user enters payment information and completes the payment, the terminal sends a confirmation to the server. The server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan.

[2262] Specific examples

[2263] For example, if a user generates an AI avatar of a famous actor and asks the AI ​​avatar to navigate to "Tokyo Tower" in a self-driving vehicle, the AI ​​avatar will begin providing directions and information about tourist spots they will pass along the way. Entertainment features such as playing favorite music to make the journey more comfortable are also provided. An example of a prompt sentence would be "generate ai avatar for celebrity actor with bio..." and the generative AI model would be able to generate an actor's avatar.

[2264] This system will further enrich the user experience, making travel time in an autonomous vehicle more comfortable and meaningful.

[2265] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2266] Step 1:

[2267] A user accesses the system and registers by entering their name, email address, and password. The terminal receives this input data and performs validation. Once validation is complete, the terminal sends the data to the server. The server stores the received data and returns a message to the terminal indicating successful user registration. The input for this step is the name, email address, and password, and the output is a message indicating successful user registration.

[2268] Step 2:

[2269] The user enters the celebrity's profile information, such as their name, photo, voice sample, and biography, into a form within the system. The device receives this information, checks the required fields, and then sends it to the server. The server analyzes the received information and passes it to a generative AI model to generate a realistic AI avatar of the celebrity. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device then displays a preview of the AI ​​avatar to the user along with a message of success. The input of this step is the celebrity's profile information, and the output is a preview of the generated AI avatar.

[2270] Step 3:

[2271] The user clicks the Start Conversation button to have a conversation with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the AI ​​avatar, and the AI ​​avatar generates an initial greeting message. This generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data and generates a response for the AI ​​avatar, which is sent back to the device. The device displays or plays this to the user. The input of this step is the user's response, and the output is the AI ​​avatar's response.

[2272] Step 4:

[2273] Inside the autonomous vehicle, the user wears a head-mounted display and receives navigation, tourist information, and entertainment services through interactions with an AI avatar. When the user sets a destination, the device sends this information to the server. The server calculates a navigation route based on the destination and has the AI ​​avatar provide directions. The tourist information function also generates tourist information for the areas the vehicle passes through, which the AI ​​avatar provides to the user. For the entertainment function, the server plays selected music and video content. The inputs to this step are the destination setting and entertainment selection, and the outputs are route information, tourist information, and entertainment content.

[2274] Step 5:

[2275] The user operates the pricing plan screen and selects options such as usage time and price. This selection data is sent from the terminal to the server, which calculates the fee and then displays the payment page on the terminal. When the user enters payment information and completes the payment, the terminal sends a confirmation to the server. The server verifies and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan. The input to this step is the pricing plan selection data and payment information, and the output is a payment success message.

[2276] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2277] This invention provides a B2C web platform that allows users to easily interact with AI avatars of celebrities. In particular, this system is equipped with an emotion engine that recognizes users' emotions and can generate responses according to the user's emotions. Specific embodiments of this system are described below.

[2278] User Registration and Authentication

[2279] A user first accesses the system and enters information such as name, email address, and password on the new registration screen. The terminal receives this input data and validates that all required fields have been entered. Once validation is complete, the terminal sends the data to the server. The server stores the received data and returns a registration success message to the terminal. This registers the user in the system and they can begin using it.

[2280] AI avatar generation for celebrities

[2281] The user enters the celebrity's profile information, such as their name, photo, voice sample, and biography, into a form within the system. The device receives this information and validates it for completeness. After validation, the device sends this data to the server. The server analyzes the received information and passes it to the AI ​​generation model. The AI ​​generation model generates a realistic AI avatar of the celebrity. This avatar can respond in the form of text, voice, image, or video. The generated AI avatar is stored in a database, and a message of success is returned to the device. The device displays a preview of the AI ​​avatar to the user along with a message of success.

[2282] Start a conversation with an AI avatar

[2283] The user clicks the Start Conversation button to converse with the generated AI avatar. The device sends this request to the server. The server starts a conversation session with the selected AI avatar and generates an initial greeting message. The generated initial message is sent to the device, which displays it to the user. When the user responds with text or voice, the device sends this response to the server. The server analyzes the received data and generates a response for the AI ​​avatar. This response is sent back to the device, which displays or plays it back to the user. This achieves an interactive conversation between the user and the AI ​​avatar.

[2284] Emotion Engine Operation

[2285] The system is equipped with an emotion engine that recognizes the user's emotions. When the user provides input in the form of text, voice, image, or video, the device sends this data to the emotion engine. The emotion engine analyzes the input data and recognizes the user's emotional state. For example, it identifies emotions such as "happy" if the user is happy, or "sad" if the user is sad. The emotion engine then sends the recognized emotion data to the server. The server generates a response for the AI ​​avatar based on the emotion data, and the response is delivered in a content and tone that matches the user's emotion.

[2286] Pricing and Payment

[2287] The user operates the pricing plan screen and selects the usage time and price options. For example, plans include 30 minutes for 500 yen or 1 hour for 1,000 yen. The terminal sends the selected data to the server. The server calculates the fee and displays the payment page on the terminal. When the user enters the payment information and completes the payment, the terminal sends confirmation to the server. The server confirms and saves the payment data and returns permission to start using the service to the terminal. The terminal displays a message to the user that payment was successful, and the user can then start using the service based on the selected plan.

[2288] Specific examples

[2289] For example, suppose a user registers in the system under the name "Yamada Taro" and generates an AI avatar of a celebrity named "Tanaka Minako." The user enters their profile information and checks a preview of the generated avatar. Next, after selecting a pricing plan and completing payment, a conversation with Tanaka Minako's AI avatar begins. The user asks questions via text or voice, and the AI ​​avatar responds individually. Furthermore, the emotion engine recognizes the user's emotions based on their input and generates responses accordingly, resulting in a more intimate and adapted conversation. In this way, users can easily enjoy interactive interactions with celebrities.

[2290] The embodiments of the present invention allow users to interact with realistic AI avatars of celebrities in a variety of ways, while keeping psychological and economic hurdles low, and receiving responses that correspond to their emotions.

[2291] The processing flow will be explained below.

[2292] User Registration and Authentication

[2293] Step 1:

[2294] The user accesses the new registration screen and enters registration information such as name, email address, and password.

[2295] Step 2:

[2296] The terminal receives the entered information and validates that all required fields have been entered.

[2297] Step 3:

[2298] The terminal sends the data that has passed validation to the server.

[2299] Step 4:

[2300] The server receives the submitted data and creates a new user record in the database.

[2301] Step 5:

[2302] The server returns a successful response to the terminal.

[2303] Step 6:

[2304] The terminal receives the response and displays a "Registration successful" message to the user.

[2305] AI avatar generation for celebrities

[2306] Step 1:

[2307] A user enters profile information such as the celebrity's name, photo, voice sample, and biography.

[2308] Step 2:

[2309] The terminal receives the entered information and validates it to ensure there are no missing details.

[2310] Step 3:

[2311] The device sends the validated data to the server.

[2312] Step 4:

[2313] The server analyzes the received data and passes it to the AI ​​generation model.

[2314] Step 5:

[2315] The server's AI generative model uses the data to generate an AI avatar of the celebrity, which can respond in the form of text, voice, images, and video.

[2316] Step 6:

[2317] The server stores the generated AI avatar in a database and returns a response indicating successful generation to the device.

[2318] Step 7:

[2319] The device receives the response and displays a preview of the generated AI avatar to the user.

[2320] Start a conversation with an AI avatar

[2321] Step 1:

[2322] The user selects the AI ​​avatar they want to talk to and clicks the Start Conversation button.

[2323] Step 2:

[2324] The terminal sends a conversation initiation request to the server.

[2325] Step 3:

[2326] The server creates a conversation session with the selected AI avatar and generates an initial greeting message.

[2327] Step 4:

[2328] The server sends the generated initial message to the terminal.

[2329] Step 5:

[2330] The terminal displays a welcome message to the user.

[2331] Step 6:

[2332] The user enters a response by text or voice.

[2333] Step 7:

[2334] The terminal sends the user's input to the server.

[2335] Step 8:

[2336] The server analyzes the user's input data, and the emotion engine recognizes the user's emotions.

[2337] Step 9:

[2338] The emotion engine sends the emotion data to the server, which processes it so that the AI ​​avatar can generate a response according to the emotion.

[2339] Step 10:

[2340] The server sends the generated AI avatar's response to the device.

[2341] Step 11:

[2342] The terminal receives the response and displays or plays it back to the user, and this process is repeated to continue the interactive conversation.

[2343] Pricing and Payment

[2344] Step 1:

[2345] The user accesses the pricing plan screen and sees the available time and price options.

[2346] Step 2:

[2347] The user selects the plan they want and enters their payment information.

[2348] Step 3:

[2349] The terminal sends the selected plan and payment information to the server.

[2350] Step 4:

[2351] The server receives the transmitted data and executes the payment process in cooperation with the payment system.

[2352] Step 5:

[2353] The server checks the result of the payment process and returns a success or failure response to the terminal.

[2354] Step 6:

[2355] The terminal receives the result of the payment process and displays a message to the user saying "Payment completed." If the payment is successful, a message also appears stating that the user is authorized to start using the service.

[2356] Specific examples

[2357] Step 1:

[2358] For example, when a user registers a new account under the name "Yamada Taro," the steps of user registration and authentication are executed in order.

[2359] Step 2:

[2360] After completing registration, the user wants to generate an AI avatar for a celebrity named "Minako Tanaka." To do this, the user enters the celebrity's profile information into a form and executes the steps to generate the celebrity's AI avatar.

[2361] Step 3:

[2362] After the AI ​​avatar is generated and the user checks its preview, the user executes a series of steps to start a conversation with the AI ​​avatar, including a procedure in which the emotion engine recognizes the emotion when the user provides emotional input and generates an adapted response.

[2363] Step 4:

[2364] After the conversation ends, the user performs the steps of setting the price and paying for the usage time. Once payment is completed based on the selected plan, the system usage is officially terminated.

[2365] In this way, users can not only easily enjoy interactive conversations with AI avatars of celebrities, but also experience more intimate and adapted interactions by receiving responses based on their emotions.

[2366] Example 2

[2367] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2368] In recent years, advances in AI technology have led to an increasing demand for interactive dialogue systems. However, conventional dialogue systems often lack the ability to fully recognize user emotions and generate appropriate responses. As a result, they can only provide one-way information to users, resulting in a poor user experience. Furthermore, real-time responses are difficult to make for pricing and payment processing, requiring cumbersome procedures for users. To solve these problems, a system capable of recognizing user emotions in real time and generating adaptive responses is needed.

[2369] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2370] In this invention, the server includes means for receiving input data from a user and performing user registration, means for generating an AI avatar based on profile information of a celebrity, means for enabling conversation with the generated AI avatar, means for transmitting the input data to an emotion engine and recognizing the user's emotions, means for generating a response from the AI ​​avatar based on the recognized emotion data, and means for setting fees according to usage and performing payment processing.

[2371] This allows users to receive real-time emotional responses when using the system, resulting in a more personalized and interactive experience, as well as simplified pricing and payment processing, improving the user experience.

[2372] A "user" is a person who uses the system to register, interact, make payments, and perform other operations.

[2373] "Input Data" refers to information provided by a user to the system, including names, email addresses, passwords, celebrity profile information, text, audio, images, and video.

[2374] "Validation" is the process of checking whether the data entered by the user meets the system requirements.

[2375] The "server" is the central computer in the system that receives, stores, analyzes, and generates AI avatars from data entered by users.

[2376] A "terminal" is a device that a user uses to access the system and input and display data, including a PC, smartphone, tablet, etc.

[2377] An "AI avatar" is a virtual presence generated based on a celebrity's profile information and can respond to users in the form of text, voice, image, and / or video.

[2378] An "emotion engine" is a software component that analyzes user input data and recognizes the user's emotional state.

[2379] "Pricing" is the process of determining the time and price plan a user may select to use the system.

[2380] "Payment processing" refers to the process in which a user enters payment information based on the selected fee plan and actually pays the fee.

[2381] "Profile Information" is information associated with a public figure, such as name, photograph, voice sample, and biography.

[2382] A "generative AI model" is an artificial intelligence algorithm for generating AI avatars based on input data.

[2383] A "response" is a reply message generated by an AI avatar in response to user input, and can include text, audio, images, and video....

Claims

1. means for receiving input data from a user and performing user registration; A method for generating AI avatars based on the profile information of celebrities, A means to enable conversation with the generated AI avatar; a means for setting usage-based pricing and processing payments; A system including:

2. 10. The system of claim 1, further comprising means for the AI ​​avatar to generate responses in the form of text, audio, images, or video in conversation with the user.

3. 10. The system of claim 1, further comprising means for validating user input data and transmitting it to the server in an appropriate format.

Images