System

Abstract

A system is provided.SOLUTION: A system comprising: a user terminal for inputting personal profile information; a server for receiving the profile information and generating an avatar by a generative model; a user terminal having means for displaying information of the generated avatar and presenting the information to a user; a server for analyzing a dialogue for communicating with the avatar; a server for generating a travel plan based on a desire of the user; and a server for providing real-time support during the travel.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, feelings of loneliness and inferiority are on the rise, and for individuals who enjoy solo activities (solo activities), comparisons with others and feelings of loneliness can become a psychological burden. For example, frequently seeing the activities of others on social media can trigger feelings of inferiority about one's own activities. Furthermore, many individuals find it difficult to improve themselves through solo activities. In this situation, there is a need for a system that allows individuals to enjoy solo activities in a positive way and reduce feelings of loneliness. [Means for solving the problem]

[0005] The present invention solves these problems by providing a system that includes a user terminal for inputting personal profile information, a server that receives the profile information and generates an avatar using a generative model, a user terminal with a means for displaying and presenting the generated avatar information to the user, a server that analyzes dialogue for communicating with the avatar, a server that generates a travel plan based on the user's preferences, a server that has a means for transmitting the generated travel plan to the user terminal, and a server that provides real-time support during the travel. This system allows users to plan and execute activities with the generated avatar, improve themselves, and enjoy solo activities in a positive way. Furthermore, real-time support provided by AI allows users to engage in activities with peace of mind, reducing feelings of loneliness.

[0006] A "user terminal" is a computer device used by an individual to input and display data, and includes personal computers, smartphones, and the like.

[0007] "Profile information" is personal information entered by the user, and includes information such as age, gender, interests, hobbies, and special skills.

[0008] A "server" is a computer system that processes data sent from a user terminal and provides the necessary responses and services.

[0009] A "generative model" is a machine learning model or AI algorithm that generates avatars and responses based on input data.

[0010] An "avatar" is a digital character generated based on user input, and acts as a support for communication and activities.

[0011] A "natural language processing module" is a software component for analyzing a user's message and generating an appropriate response.

[0012] A "travel plan" is a proposal that includes a travel itinerary and activities planned based on the user's wishes.

[0013] "Real-time support" refers to information and advice provided immediately to users who are active, including traffic information and tourist spot information. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] The present invention relates to a system for enabling individuals to plan, improve themselves, and engage in solo activities with generated avatars, including a user terminal, a server, a generative model, a natural language processing module, and a travel plan generation module.

[0036] Avatar generation

[0037] A user first uses a user device to enter their profile information. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user's device and presented to the user.

[0038] Communicating with avatars

[0039] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server. The server uses a natural language processing module to analyze the user's message and generate an appropriate response. This response is then sent back to the user's device and displayed.

[0040] Generate a travel plan

[0041] Users can create travel plans together with their avatars. The user inputs their desired travel destinations and activities and sends this information from the user's device to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user's device. The user can review this proposal and make any necessary changes.

[0042] Travel support

[0043] Users can receive real-time support while traveling. For example, when a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate the optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided.

[0044] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. During an actual trip, the server provides real-time traffic information, allowing the user to enjoy solo activities with peace of mind.

[0045] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[0046] The processing flow will be explained below.

[0047] Avatar generation

[0048] Step 1:

[0049] The user opens a screen on the user terminal to input profile information for avatar generation, including age, gender, interests, hobbies, and special skills.

[0050] Step 2:

[0051] The device generates a request to send the entered profile information to the server. The data to be sent is constructed in JSON format and sent via POST to the specified API endpoint on the server.

[0052] Step 3:

[0053] The server analyzes the received profile information and inputs it into a generative model. The profiling module organizes the data and generates an avatar using the generative AI model.

[0054] Step 4:

[0055] The server returns the generated avatar data to the device, generating a JSON response containing the avatar image, attribute information, and other related data.

[0056] Step 5:

[0057] The device displays the avatar information received from the server to the user, showing the avatar's image and attribute information on the screen and providing customization options as needed.

[0058] Step 6:

[0059] The user checks the presented avatar, and if he / she wishes to customize it, he / she sends the information to the server again to update the avatar.

[0060] Communicating with avatars

[0061] Step 1:

[0062] The user opens a chat screen to interact with the avatar and enters a message such as "Hello."

[0063] Step 2:

[0064] The terminal generates a request to send the user's message to the server by sending a POST request containing the message data to the server.

[0065] Step 3:

[0066] The server passes the received message to a natural language processing module for analysis. The NLP (natural language processing) module analyzes the intent and content of the message and generates an appropriate response.

[0067] Step 4:

[0068] The server sends the generated response to the terminal. It generates a JSON response containing the response message and sends it to the user's terminal.

[0069] Step 5:

[0070] The device will display the response message received from the server, which will be displayed on the chat screen as a message from the avatar.

[0071] Step 6:

[0072] The user sees the avatar's response and continues the dialogue if desired, and the cycle repeats each time the user types a new message.

[0073] Generate a travel plan

[0074] Step 1:

[0075] The user enters the travel plan creation mode and inputs the places they want to go and the activities they want to do. For example, they input their wish to "watch a sporting event in Tokyo."

[0076] Step 2:

[0077] The device generates a request to send the user's input to the server. It constructs JSON data containing the desired content and sends a POST request to the server.

[0078] Step 3:

[0079] The server analyzes the user's request and retrieves relevant travel information from the database. It also executes a database query to retrieve information about sporting events taking place in Tokyo.

[0080] Step 4:

[0081] The server generates a travel plan based on the acquired information. The travel plan generation module creates a travel plan including dates, locations, means of transportation, etc.

[0082] Step 5:

[0083] The server sends the generated travel plan to the device. It also generates a JSON response containing the plan details and sends it to the user's device.

[0084] Step 6:

[0085] The terminal displays the travel plan received from the server to the user, showing the plan details on the screen and providing options to modify it if necessary.

[0086] Step 7:

[0087] The user reviews the proposed itinerary and modifies it as necessary. If the user makes any changes, the information is sent back to the server, and the itinerary is updated.

[0088] Travel support

[0089] Step 1:

[0090] The user enters a mode for receiving support during the actual trip, entering a request such as "Please tell me how to get to today's game" before leaving.

[0091] Step 2:

[0092] The device generates a request to send the user's request to the server, constructs a JSON containing the request data, and sends a POST request to the server.

[0093] Step 3:

[0094] The server analyzes the current traffic conditions in real time and generates an optimal route by querying traffic information APIs and map data.

[0095] Step 4:

[0096] The server sends the generated travel route and advice to the device, and generates a JSON response containing transportation instructions and sends it to the user's device.

[0097] Step 5:

[0098] The device displays the route information received from the server to the user, along with avatar messages about the route and important points to note.

[0099] Step 6:

[0100] The user then takes action based on the provided information, travels to the destination using the route provided, and enjoys the trip.

[0101] Example 1

[0102] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0103] In recent years, there has been a demand for tools that allow individuals to engage in self-improvement and solo activities without feeling lonely, but existing systems lack sufficient support. Specifically, they lack comprehensive support to alleviate the anxiety and complex planning that users may experience when working alone. To address this, it is necessary to provide a customizable support system that meets the individual needs of each user.

[0104] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0105] In this invention, the server includes a processing means for receiving personal profile information and generating an avatar using a generative model, a means for returning and displaying information about the generated avatar to a user terminal, a natural language processing means for analyzing user messages to communicate with the avatar, a travel plan generation means for generating a travel plan based on the user's wishes, a means for transmitting the generated travel plan to the user terminal, and a means for providing real-time support during the trip, thereby enabling users to make plans with avatars tailored to their individual needs and to engage in self-improvement and solo activities efficiently and with peace of mind.

[0106] A "user terminal" is a device that allows a user to input information and check the generated avatar and travel plan.

[0107] "Profile information" is information that identifies an individual, such as the user's age, gender, interests, hobbies, and special skills.

[0108] A "generative model" is an artificial intelligence model that generates an avatar based on input profile information.

[0109] An "avatar" is a virtual character that is generated based on a user's profile information.

[0110] "Means" is a general expression that refers to a device or module for realizing a specific function.

[0111] The "natural language processing means" is a module for analyzing messages from users during communication and generating appropriate responses.

[0112] The "travel plan generation means" is a module for planning travel destinations and activities based on the user's wishes.

[0113] The "real-time support means" is a module for providing information and guidance to users immediately while they are traveling.

[0114] "Server" refers to a device that processes, generates, analyzes, and transmits and receives data.

[0115] The present invention relates to a system for supporting individuals in making plans with generated avatars, for self-improvement, and for solo activities, and includes a user terminal, a server, a generative model, a natural language processing module, and a travel plan generation module.

[0116] Avatar generation

[0117] First, a user enters their profile information using a user device. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user device and presented to the user.

[0118] As a specific example, if the user is a 28-year-old male whose hobby is watching sports, when this information is input, the server generates an avatar of a character who is a 28-year-old male who likes watching sports.

[0119] Communicating with avatars

[0120] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server. The server uses a natural language processing module to analyze the user's message and generate an appropriate response. This response is then sent back to the user's device and displayed.

[0121] As a concrete example, when a user sends a message to an avatar saying "Hello, let's decide where to travel," the server generates a response saying "Where do you want to go?" which is sent back to the user terminal.

[0122] Generate a travel plan

[0123] Users can create travel plans together with their avatars. The user inputs their desired travel destinations and activities and sends this information from the user's device to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user's device. The user can review this proposal and make any necessary changes.

[0124] As a specific example, if a user inputs "I want to watch a sporting event in Tokyo," the server will generate an appropriate travel plan and suggest it to the user.

[0125] Travel support

[0126] Users can receive real-time support while traveling. For example, when a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate the optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided.

[0127] As a concrete example, when a user requests, "How do I get to today's game?", the server generates the optimal route and provides it to the user.

[0128] The system uses a generative AI model to generate an avatar based on the user's profile information, and supports communication between the user and the avatar through natural language processing using prompt sentences. It also uses a travel plan generation module to provide travel plans based on the user's preferences and provides real-time travel support, allowing users to enjoy solo activities with peace of mind.

[0129] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0130] Step 1:

[0131] The user uses the user terminal to input their profile information (age, gender, interests, hobbies, special skills, etc.). The input information is specific information such as age: 28, gender: male, hobby: watching sports, etc.

[0132] Step 2:

[0133] The device sends the entered profile information to the server. Specifically, the device sends the profile information to the server in JSON format using an HTTPS POST request. The input of this request is the profile information entered by the user, and the output is the information sent to the server.

[0134] Step 3:

[0135] The server generates an avatar using a generative AI model based on the received profile information. Specifically, the server inputs the profile information into the generative AI model and processes the data to generate the avatar. The input is the profile information, and the output is the generated avatar information.

[0136] Step 4:

[0137] The server returns the generated avatar information to the user device and presents it. Specifically, the server returns the avatar information to the user device in JSON format, and the device displays it. The input is the generated avatar information, and the output is transmission to the user device and display.

[0138] Step 5:

[0139] The user opens a chat screen to interact with the generated avatar and inputs a message. Specifically, the user inputs a message such as "Hello, let's decide on a travel destination," and presses the "Send" button. The input is the user's message.

[0140] Step 6:

[0141] The user terminal sends the message entered by the user to the server. Specifically, the terminal sends an HTTPS POST request to the server and sends the user's message in JSON format. The input is the user's message, and the output is what is sent to the server.

[0142] Step 7:

[0143] The server analyzes the received message using a natural language processing module. Specifically, the server analyzes the message using an NLP library and extracts the user's intent. The input is the user's message, and the output is the analysis result.

[0144] Step 8:

[0145] The server generates an appropriate response based on the analysis results and sends it back to the user device. Specifically, the server generates a response using a generative AI model and sends it to the user device in JSON format. The input is the analysis results, and the output is the generated response.

[0146] Step 9:

[0147] The user terminal receives the response from the server and displays it on the chat screen. Specifically, the terminal displays the response message and presents it to the user. The input is the response message from the server, and the output is the display on the terminal.

[0148] Step 10:

[0149] The user inputs their desired travel destinations and activities into the avatar and requests the creation of a travel plan. Specifically, the user inputs "I want to watch a sporting event in Tokyo" and presses the "Submit" button. The input is the user's travel preferences.

[0150] Step 11:

[0151] The terminal sends the user's travel wishes to the server. Specifically, the terminal sends an HTTPS POST request and sends the travel wishes to the server in JSON format. The input is the user's travel wishes, and the output is what is sent to the server.

[0152] Step 12:

[0153] The server uses the travel plan generation module to create a travel plan based on the user's preferences. Specifically, the server plans travel destinations and activities based on the user's preferences and processes the information. The input is the user's travel preferences, and the output is the generated travel plan.

[0154] Step 13:

[0155] The server sends the generated travel plan to the user's device. Specifically, the server returns the travel plan to the user's device in JSON format and proposes it to the user. The input is the generated travel plan, and the output is the transmission to the user's device.

[0156] Step 14:

[0157] The user checks the generated travel plan and modifies it if necessary. Specifically, the user checks the plan and re-enters it if any modifications are necessary. The input is the modified travel plan, and the output is resubmission.

[0158] Step 15:

[0159] While traveling, the user inputs a request for real-time support. Specifically, the user inputs "Please tell me how to get to today's game" into the terminal and presses the "Send" button. The input is a support request.

[0160] Step 16:

[0161] The device sends the user's support request to the server. Specifically, the device sends an HTTPS POST request and sends the request to the server in JSON format. The input is the support request, and the output is the transmission to the server.

[0162] Step 17:

[0163] The server generates optimal routes and information by referencing traffic information APIs and other databases. Specifically, the server calls external APIs to calculate traffic information and routes. The inputs are support requests and traffic information data, and the output is optimal route information.

[0164] Step 18:

[0165] The server sends the generated support information to the user's device. Specifically, the server returns the optimal route information to the user's device in JSON format. The input is the optimal route information, and the output is the information sent to the device.

[0166] Step 19:

[0167] The device displays support information to the user as an avatar message. Specifically, the device displays optimal route information on the chat screen and presents it to the user. The input is support information, and the output is the display on the device.

[0168] (Application example 1)

[0169] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0170] Previous systems supporting self-improvement and solo activities have not been able to fully alleviate the anxiety and loneliness that users feel when engaging in activities alone. Furthermore, they lacked product recommendations tailored to each user's individual interests and preferences, nor did they offer integrated management of virtual and physical stores. As a result, the user experience did not improve, leading to problems of low user satisfaction. In particular, the lack of purchasing assistance and real-time support in the virtual environment meant that user convenience was not fully realized.

[0171] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0172] In this invention, the server includes means for receiving personal profile information and generating an avatar using a generative model, means for recommending products based on the user's preferences using the avatar, means for displaying information about the recommended products on the user's terminal, and means for integrated management of the real store and the virtual store. This allows users to engage in self-improvement and solo activities with peace of mind, and further improves convenience through product recommendations tailored to individual preferences and integrated management of the virtual store and the real store.

[0173] A "user terminal" is a device that allows an individual to input profile information, interact with an avatar, and display recommended product information.

[0174] A "server" is a device or system that generates an avatar based on profile information sent by a user and performs processes such as dialogue analysis using natural language processing and travel plan generation.

[0175] A "generative model" is an algorithm or data model used to generate an avatar based on a user's profile information.

[0176] An "avatar" is a virtual character generated based on an individual's profile information, and assists the user in conversations and product recommendations.

[0177] "Dialogue analysis" is the process of analyzing messages entered by users and generating appropriate responses.

[0178] A "travel plan" is a detailed plan or proposal for a trip that is generated based on the user's wishes.

[0179] "Real-time support" is a function that aims to provide immediate and appropriate information and assistance for ongoing user activities.

[0180] "Product recommendation" is the process of suggesting appropriate products based on a user's preferences and profile information.

[0181] A "virtual store" is a virtual store that operates on the Internet, where users can browse and purchase products.

[0182] "Physical store" means a physical store where users can view and purchase products on-site.

[0183] "Integrated management" is the process of centrally managing inventory information and sales data from virtual and physical stores.

[0184] The present invention provides a system for individuals to use a generated avatar to recommend products and plan travel itineraries, and engage in self-improvement and solo activities. The system includes a user terminal, a server, a generative AI model, a natural language processing module, and a product recommendation module.

[0185] Use of user devices

[0186] First, a user enters their profile information using a user terminal. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. This information is then sent from the terminal to the server.

[0187] Avatar generation

[0188] The server uses a generative AI model based on the received profile information to generate an optimal avatar for each individual user, which is then sent back to the user's device and displayed on the screen.

[0189] Communicating with avatars

[0190] To interact with the generated avatar, the user opens a chat screen on their device. The message entered by the user is sent to the server, where a natural language processing module analyzes it and generates an appropriate response. This response is then sent back to the user's device and displayed on the chat screen.

[0191] Product recommendation

[0192] Users can enjoy shopping in a virtual store with their avatar. Based on the user's preferences and history data, the avatar recommends suitable products. The product recommendation module manages this process, and the recommended product information is displayed on the user's device.

[0193] Integrated management of virtual and physical stores

[0194] The server provides a function for centrally managing inventory information and sales data for both physical and virtual stores. This allows users to browse and purchase products in the virtual store through their avatars. Recommended products and inventory status are updated in real time.

[0195] Hardware and Software Configuration

[0196] Hardware: Smartphones, smart glasses, head-mounted displays. These devices provide the interface through which users interact with their avatars.

[0197] Software: Generative AI models (e.g., using TensorFlow, PyTorch), natural language processing modules (e.g., BERT, GPT-3), product recommendation modules, and communication APIs (e.g., RESTful APIs).

[0198] Description and examples

[0199] The server includes a means for receiving personal profile information and generating an avatar using a generative model, a means for recommending products based on the user's preferences using the avatar, a means for displaying information about the recommended products on the user's terminal, and a means for integrated management of the real store and the virtual store. This allows users to engage in self-improvement and solo activities with peace of mind, and further improves convenience through product recommendations tailored to individual preferences and integrated management of the virtual store and the real store.

[0200] As a concrete example, if a user launches an application on their smartphone and asks an avatar, "Tell me what sneakers you recommend," the avatar will refer to their past purchase history and current trend information and respond, "These new sneakers are popular."

[0201] Prompt Sentence Examples

[0202] "Male, 28 years old. I recently purchased athletic sneakers. I'd like some recommendations for new sneakers suitable for my upcoming training."

[0203] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0204] Step 1:

[0205] The user enters profile information. Personal information such as age, gender, interests, hobbies, and special skills is entered on the user's device and sent to the server.

[0206] Input: Personal information such as age, gender, interests, hobbies, and special skills

[0207] Output: Send profile information to server

[0208] Specific behavior: A user launches the application, enters profile information into a form, and clicks the submit button to send the information to the server.

[0209] Step 2:

[0210] The server generates an avatar using a generative AI model based on the received profile information, and sends the generated avatar information back to the user's device and displays it on the screen.

[0211] Input: Profile information

[0212] Output: Generated avatar data

[0213] Specific operation: The server inputs the received profile information into the generation AI model to generate an avatar, then sends the generated avatar data to the user's device and displays it on the device.

[0214] Step 3:

[0215] To interact with an avatar, a user opens a chat screen and enters a message. The message is sent from the user's device to the server, where a natural language processing module analyzes the message and generates an appropriate response. The generated response is then sent back to the user's device and displayed on the screen.

[0216] Input: User message

[0217] Output: The generated response

[0218] Specific operation: The user opens the chat screen, enters a text message, and presses the send button. The server analyzes the received message using a natural language processing module, generates a response from the avatar, and sends it back to the user's device.

[0219] Step 4:

[0220] The user requests a product recommendation from the avatar. Based on the user's preferences and history data, the product recommendation module selects appropriate products and sends the recommended product information to the user's device.

[0221] Input: User preferences and historical data

[0222] Output: Recommended product information

[0223] Specific operation: The user asks the avatar, "Please recommend me some products." The server uses the product recommendation module to select appropriate products based on the user's past purchase history and preferences, and sends that information to the user's device.

[0224] Step 5:

[0225] The server manages the virtual store and the physical store in an integrated manner, providing real-time inventory information and sales data from the physical store to users' devices, allowing them to make purchasing decisions based on this information.

[0226] Input: Inventory information and sales data for physical and virtual stores

[0227] Output: Integrated inventory information and sales data

[0228] Specific operation: The server manages inventory and sales data from both the virtual and physical stores, and keeps the data up to date. When a user selects a product they wish to purchase, the server provides current inventory information and assists in the purchasing process.

[0229] Step 6:

[0230] The server provides real-time support, instantly responding with relevant information in response to ongoing user activity, such as a user requesting "directions from my current location to the nearest store."

[0231] Input: User's current ongoing activity information and requests

[0232] Output: Appropriate real-time support information

[0233] Specific operation: When a user asks the avatar, "Tell me the way to the nearest store," the server calculates the optimal route based on the current location information and route data, and sends that information back to the user's device.

[0234] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0235] The present invention relates to a system for enabling individuals to plan, improve themselves, and engage in solo activities with generated avatars, including a user terminal, a server, a generative model, a natural language processing module, an emotion engine, and a travel plan generation module.

[0236] Avatar generation

[0237] A user first uses a user device to enter their profile information. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user's device and presented to the user.

[0238] Avatar communication and emotion recognition

[0239] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server, which uses a natural language processing module to analyze the user's message and generate an appropriate response.

[0240] Furthermore, the server utilizes an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's input message and facial expression data acquired from the facial recognition camera. Based on the analysis results, the avatar's response is tailored to the user's emotions. For example, if the user is feeling stressed, the avatar can select a comforting response.

[0241] Generate a travel plan

[0242] Users can create travel plans together with their avatars. The user inputs their desired travel destinations and activities and sends this information from the user's device to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user's device. The user can review this proposal and make any necessary changes.

[0243] Travel support and emotion recognition

[0244] Users can receive real-time support while traveling. For example, when a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate the optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided.

[0245] Furthermore, the emotion engine can monitor the user's emotional state while traveling and provide appropriate support. For example, if the user becomes lost and feels fear or anxiety, the emotion engine will recognize that emotion and the avatar will provide advice to help them calm down.

[0246] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. In an actual trip, the server provides real-time traffic information, and the emotion engine adjusts the avatar's responses based on the user's emotional state, allowing the user to enjoy solo activities with peace of mind.

[0247] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[0248] The processing flow will be explained below.

[0249] Avatar generation

[0250] Step 1:

[0251] The user opens a screen on the user terminal to input profile information for avatar generation, including age, gender, interests, hobbies, and special skills.

[0252] Step 2:

[0253] The device generates a request to send the entered profile information to the server. The data to be sent is constructed in JSON format and sent via POST to the specified API endpoint on the server.

[0254] Step 3:

[0255] The server analyzes the received profile information and inputs it into a generative model. The profiling module organizes the data and generates an avatar using the generative AI model.

[0256] Step 4:

[0257] The server returns the generated avatar data to the device, generating a JSON response containing the avatar image, attribute information, and other related data.

[0258] Step 5:

[0259] The device displays the avatar information received from the server to the user, showing the avatar's image and attribute information on the screen and providing customization options as needed.

[0260] Step 6:

[0261] The user checks the presented avatar, and if he / she wishes to customize it, he / she sends the information to the server again to update the avatar.

[0262] Avatar communication and emotion recognition

[0263] Step 1:

[0264] The user opens a chat screen to interact with the avatar and enters a message such as "Hello."

[0265] Step 2:

[0266] The terminal generates a request to send the user's message to the server by sending a POST request containing the message data to the server.

[0267] Step 3:

[0268] The server passes the received message to a natural language processing module for analysis. The NLP (natural language processing) module analyzes the intent and content of the message and generates an appropriate response.

[0269] Step 4:

[0270] The server sends the generated response to the terminal. It generates a JSON response containing the response message and sends it to the user's terminal.

[0271] Step 5:

[0272] The device will display the response message received from the server, which will be displayed on the chat screen as a message from the avatar.

[0273] Step 6:

[0274] The user sees the avatar's response and continues the dialogue if desired, and the cycle repeats each time the user types a new message.

[0275] Step 7:

[0276] The server passes the user's input message and facial expression data from a face recognition camera installed on the user's device to the emotion engine for analysis, which determines the user's emotional state.

[0277] Step 8:

[0278] The server adjusts the avatar's responses based on the emotion engine's analysis, for example generating a comforting response if the user is feeling stressed.

[0279] Generate a travel plan

[0280] Step 1:

[0281] The user enters the travel plan creation mode and inputs the places they want to go and the activities they want to do. For example, they input their wish to "watch a sporting event in Tokyo."

[0282] Step 2:

[0283] The device generates a request to send the user's input to the server. It constructs JSON data containing the desired content and sends a POST request to the server.

[0284] Step 3:

[0285] The server analyzes the user's request and retrieves relevant travel information from the database. It also executes a database query to retrieve information about sporting events taking place in Tokyo.

[0286] Step 4:

[0287] The server generates a travel plan based on the acquired information. The travel plan generation module creates a travel plan including dates, locations, means of transportation, etc.

[0288] Step 5:

[0289] The server sends the generated travel plan to the device. It also generates a JSON response containing the plan details and sends it to the user's device.

[0290] Step 6:

[0291] The terminal displays the travel plan received from the server to the user, showing the plan details on the screen and providing options to modify it if necessary.

[0292] Step 7:

[0293] The user reviews the proposed itinerary and modifies it as necessary. If the user makes any changes, the information is sent back to the server, and the itinerary is updated.

[0294] Travel support and emotion recognition

[0295] Step 1:

[0296] The user enters a mode for receiving support during the actual trip, entering a request such as "Please tell me how to get to today's game" before leaving.

[0297] Step 2:

[0298] The device generates a request to send the user's request to the server, constructs a JSON containing the request data, and sends a POST request to the server.

[0299] Step 3:

[0300] The server analyzes the current traffic conditions in real time and generates an optimal route by querying traffic information APIs and map data.

[0301] Step 4:

[0302] The server sends the generated travel route and advice to the device, and generates a JSON response containing transportation instructions and sends it to the user's device.

[0303] Step 5:

[0304] The device displays the route information received from the server to the user, along with avatar messages about the route and important points to note.

[0305] Step 6:

[0306] The user then takes action based on the provided information, travels to the destination using the route provided, and enjoys the trip.

[0307] Step 7:

[0308] The server monitors the user's emotional state during the trip and analyzes it using an emotion engine in a timely manner. If the user feels anxious or stressed, the server provides appropriate comfort and advice through the avatar.

[0309] Step 8:

[0310] The device displays responses and advice sent from the server to the user in real time, providing support so that the user can continue their activities with peace of mind.

[0311] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. In an actual trip, the server provides real-time traffic information, and the emotion engine adjusts the avatar's responses based on the user's emotional state, allowing the user to enjoy solo activities with peace of mind.

[0312] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[0313] Example 2

[0314] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0315] In modern society, it is important for individuals to enjoy solo activities while engaging in activities that match their interests and hobbies, while also improving themselves. However, traditional planning and information gathering can be time-consuming and laborious, and solo activities can sometimes be accompanied by feelings of loneliness and anxiety. Therefore, there is a growing need for a system that automatically provides optimal support to individual users, allowing them to plan and engage in activities with peace of mind.

[0316] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0317] In this invention, the server includes means for receiving profile information and generating an avatar using a generation AI model, means having a natural language processing module for analyzing dialogue for communicating with the avatar, and means having a travel plan generation module for generating a travel plan based on the user's wishes. This allows the user to communicate with the optimal avatar based on their profile information, efficiently plan activities according to their wishes, and enjoy safe and enjoyable solo activities.

[0318] A "user terminal" is a communication device operated by an individual, and is a device for inputting and displaying information.

[0319] A "server" is a central control device that receives information sent from user terminals, performs various processes, and then sends the information.

[0320] A "generative AI model" is an artificial intelligence algorithm that generates the optimal avatar based on a user's profile information.

[0321] A "natural language processing module" is a technology for analyzing a user's text message and generating an appropriate response.

[0322] An "emotion recognition engine" is a device that analyzes a user's message and facial expression data to recognize the user's emotional state and adjust the response.

[0323] The "travel plan generation module" is a function that automatically generates an appropriate travel plan based on the user's wishes.

[0324] "Profile information" is personal data such as the user's age, gender, interests, hobbies, and special skills.

[0325] An "avatar" is a virtual character that is generated based on a user's profile information and that communicates with the user.

[0326] "Real-time support" is a function that responds immediately to user requests and provides appropriate information and assistance in situations such as while traveling.

[0327] The present invention relates to a system for enabling individuals to plan, improve themselves, and engage in solo activities with a generated avatar, including a user terminal, a server, a generative AI model, a natural language processing module, an emotion recognition engine, and a travel plan generation module.

[0328] A user first uses a user device to enter their profile information. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative AI model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user's device and presented to the user.

[0329] The user opens a chat screen to interact with the generated avatar. The message entered by the user is sent from the user's device to the server. The server utilizes a natural language processing module to analyze the user's message and generate an appropriate response. The server then utilizes an emotion recognition engine to recognize the user's emotions. The emotion recognition engine analyzes the message entered by the user and facial expression data acquired from the facial recognition camera. Based on the analysis results, the avatar's response is adjusted to match the user's emotions. For example, if the user is feeling stressed, the avatar can select a comforting response.

[0330] Users can also create travel plans together with their avatars by inputting their desired travel destinations and activities. The user inputs the desired travel destinations and activities and sends them from the user terminal to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user terminal. The user can review the proposal and make any necessary changes.

[0331] Users can receive real-time support while traveling. For example, if a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate an optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided. Furthermore, the user's emotional state can be monitored during the trip, and the emotion recognition engine can provide appropriate support. For example, if a user becomes lost and feels fear or anxiety, the emotion recognition engine will recognize that emotion and the avatar will provide advice to help them calm down.

[0332] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. During an actual trip, the server provides real-time traffic information, and an emotion recognition engine adjusts the avatar's responses based on the user's emotional state, allowing the user to enjoy solo activities with peace of mind.

[0333] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[0334] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0335] Step 1:

[0336] The user enters profile information.

[0337] Input: The user inputs information such as age, gender, interests, hobbies, and special skills into the user terminal.

[0338] Data processing: The terminal formats the input data and sends it to the server.

[0339] Output: The profile information is sent to the server.

[0340] Specific operation: The user enters "28 years old, male, hobby is watching sports" and presses the send button.

[0341] Step 2:

[0342] The server generates the avatar.

[0343] Input: The server receives the profile information sent from the user terminal.

[0344] Data calculation: A generative AI model analyzes profile information and generates an avatar.

[0345] Output: The generated avatar data is sent to the server.

[0346] Specific operation: The server provides the generated AI model with information such as "28 years old, male, hobby is watching sports" and generates an avatar.

[0347] Step 3:

[0348] The server transmits the avatar information to the user terminal.

[0349] Input: Avatar data generated on the server.

[0350] Data processing: The server formats the avatar information and sends it to the user's device.

[0351] Output: Avatar information arrives on the user's device.

[0352] Specific operation: The server sends the generated avatar data in JSON format to the user device.

[0353] Step 4:

[0354] The user starts chatting with the avatar.

[0355] Input: The user types a chat message and presses the send button.

[0356] Data processing: The terminal sends the message data to the server.

[0357] Output: The user's message is sent to the server.

[0358] Specific operation: The user types "Hello" into the chat screen and presses the send button.

[0359] Step 5:

[0360] The server parses the message.

[0361] Input: User's message data to the server.

[0362] Data Computation: A natural language processing module analyzes the message and generates an appropriate response.

[0363] Output: Parsed results and response data are provided to the server.

[0364] Specific operation: The server passes the message "hello" to the natural language processing module, which parses it as a "greeting" and generates a response.

[0365] Step 6:

[0366] The server sends a response to the user terminal.

[0367] Input: Parsed results and response data to the server.

[0368] Data processing: The server formats the response data and sends it to the user terminal.

[0369] Output: A response message arrives at the user terminal.

[0370] Specific operation: The server sends the generated response "Hello! How are you today?" to the user terminal.

[0371] Step 7:

[0372] Emotion recognition on the server.

[0373] Input: User message data and facial expression data.

[0374] Data Calculation: An emotion recognition engine analyzes the message and facial expression data to determine the user's emotional state.

[0375] Output: The emotion recognition results are provided to the server.

[0376] Specific operation: The server analyzes messages such as "I'm not feeling very well today" and facial expression data from the camera using an emotion recognition engine.

[0377] Step 8:

[0378] The server coordinates the avatar's response.

[0379] Input: Emotion recognition results and response data.

[0380] Data processing: The server adjusts the response data based on the emotion recognition results.

[0381] Output: A tailored response message is generated.

[0382] What happens: The server generates a response based on the results of the emotion recognition engine: "You seem to be in a bad mood today. Is there anything I can help you with?"

[0383] Step 9:

[0384] The user inputs the travel destination and activity.

[0385] Input: The user inputs the desired travel destination and activity into the user terminal.

[0386] Data processing: The terminal sends the input data to the server.

[0387] Output: Travel destination and activity information is sent to the server.

[0388] Specific actions: The user enters "I want to watch a sporting event in Tokyo" and presses the send button.

[0389] Step 10:

[0390] The server generates the itinerary.

[0391] Input: Your desired travel destination and activity information sent to the server.

[0392] Data calculation: The travel plan generation module generates a travel plan based on the user's wishes.

[0393] Output: The generated itinerary is provided to the server.

[0394] Specific operation: The server uses the travel plan generation module to generate a travel plan such as "Watching a baseball game at Tokyo Dome, this weekend's plan."

[0395] Step 11:

[0396] The server transmits the travel plan to the user terminal.

[0397] Input: A server-generated itinerary.

[0398] Data processing: The server formats the travel plan and sends it to the user's terminal.

[0399] Output: The travel plan is delivered to the user's device.

[0400] Specific operation: The server sends the generated travel plan in JSON format to the user terminal.

[0401] Step 12:

[0402] Respond to requests during your trip.

[0403] Input: Users input support requests in real time.

[0404] Data processing: The terminal sends the request data to the server.

[0405] Output: The request is sent to the server.

[0406] Specific operation: The user types "Please tell me how to get to today's game" and submits it.

[0407] Step 13:

[0408] The server provides the appropriate information.

[0409] Input: The request data sent to the server.

[0410] Data calculation: The server references the traffic information API and generates optimal route information.

[0411] Output: The generated route information is sent to the user terminal.

[0412] Specific operation: The server uses the traffic information API to generate a "route from the nearest station to Tokyo Dome" and sends it to the user's device.

[0413] Step 14:

[0414] The server identifies the emotional state during the trip and tailors the response.

[0415] Input: User message data and facial expression data.

[0416] Data Calculation: An emotion recognition engine analyzes the message and facial expression data to determine the user's emotional state.

[0417] Output: Based on the emotion recognition results, a tailored response message is generated.

[0418] Specific behavior: The server uses an emotion recognition engine to provide advice such as "If you're lost and worried, maybe it would be a good idea to take a break at a nearby cafe" if the user feels fear or anxiety.

[0419] (Application example 2)

[0420] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0421] There is a need for systems that provide product recommendations and appropriate real-time support based on personal hobbies and interests through individually customized avatars. In particular, there is a need for methods that can reduce stress and anxiety users feel while shopping by analyzing the user's emotional state and providing appropriate responses. However, existing systems have limited functionality for generating avatars based on user profile information and are inferior in real-time support and emotion recognition, which leaves the user experience unsatisfactory.

[0422] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving personal profile information and generating an avatar using a generative model, means for suggesting products based on the user's interests and hobbies, and an emotion engine for analyzing the user's emotional state and adjusting appropriate responses. This enables users to receive personalized product information and enjoy real-time support through their individually customized avatars, thereby reducing stress and anxiety while shopping.

[0423] A "user terminal" is a device that allows an individual to enter profile information and communicate with an avatar.

[0424] "Profile information" is personal information such as the user's age, gender, interests, hobbies, and special skills.

[0425] The "server" is a central processing unit that processes information received from user terminals, generates avatars, analyzes dialogue and emotional states, suggests products, and provides real-time support.

[0426] A "generative model" is an algorithm for generating the optimal avatar based on a user's profile information.

[0427] An "avatar" is a virtual character that is generated based on the user's profile information and is used to communicate with the user.

[0428] "Communication" refers to conversations and message exchanges between a user and an avatar.

[0429] A "dialogue analysis server" is a server that analyzes messages entered by users and generates appropriate responses.

[0430] The "means for suggesting products" is an algorithm that suggests appropriate products based on the user's interests and hobbies.

[0431] The "emotion engine" is an engine that analyzes the user's emotional state from their messages and facial expressions and adjusts the avatar's response.

[0432] A "means for providing real-time support" is a system for providing immediate responses to user questions and requests.

[0433] The present invention provides a system for enabling individuals to shop with a generated avatar and receive appropriate support according to their emotional state. The system includes a user terminal, a server, a generative model, a natural language processing module, an emotion engine, and a product suggestion module.

[0434] 1. Enter your user profile

[0435] Users use smart glasses or smartphones to enter their profile information, which includes age, gender, interests, hobbies, special skills, etc. The entered information is then sent from the user terminal to the server.

[0436] 2. Avatar generation

[0437] The server uses a generative model based on the received profile information to generate an avatar that best suits the individual user. This avatar is then sent back to the user's device and displayed. For example, if a user is a 28-year-old woman who is interested in fashion, a personalized avatar will be generated based on that information.

[0438] 3. Avatar communication and emotion recognition

[0439] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server, which uses a natural language processing module to analyze the user's messages and generate appropriate responses.

[0440] Additionally, the system uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes messages typed by the user and facial expression data captured by the smart glasses' camera. Based on the analysis results, the avatar's response is adjusted. For example, if the user is feeling stressed, the avatar will make suggestions to help them relax.

[0441] 4. Product proposal

[0442] Based on the user's profile information and interests and hobbies derived from past interactions, the server uses a product suggestion module to suggest personalized products. For example, if a user says, "I'm looking for fashion items," the avatar will suggest fashion items that are appropriate for the season.

[0443] 5. Real-time support

[0444] While shopping, users can receive real-time support from the server. When a user types "Tell me about this product," the message is sent to the server. The server references the database, retrieves the appropriate product information, and returns it to the user. This information is displayed as an avatar message, allowing the user to make a purchasing decision based on the information provided.

[0445] For example, if a 28-year-old woman asks the avatar, "What do you recommend today?", the server will suggest appropriate fashion items based on the user's profile information. If the user is feeling stressed, the avatar will also suggest products that will help them relax.

[0446] Prompt Sentence Examples

[0447] User: "I'm a 28-year-old woman interested in fashion. Can you recommend some summer outfits?"

[0448] Model: "I'll suggest some fashion items. Let's start with avatar generation."

[0449] As described above, this system provides an environment where users can enjoy shopping with individually customized avatars and receive appropriate real-time support while reducing stress.

[0450] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0451] Step 1:

[0452] The user terminal inputs personal profile information (age, gender, interests, hobbies, special skills, etc.) and sends it to the server. This input information also includes the user's preferences and purchase list. The server receives this information.

[0453] Step 2:

[0454] The server uses a generative model based on the received profile information to generate the optimal avatar. Specifically, it compares the profile information with a database and selects and generates an appropriate avatar. The input to this process is the user's profile information, and the output is the generated avatar information.

[0455] Step 3:

[0456] The server returns information about the generated avatar to the user terminal, which then displays the avatar to the user. The user then checks the displayed avatar and begins a dialogue.

[0457] Step 4:

[0458] The user interacts with the generated avatar through a chat screen. Messages entered by the user are sent from the user's device to the server. This message is the input for processing, and the server analyzes the message using a natural language processing module to generate an appropriate response. The analysis results are output and sent back to the user's device.

[0459] Step 5:

[0460] The server simultaneously uses an emotion engine to analyze the user's input message and facial expression data to recognize the user's emotional state. The input of this process is the message and facial expression data, and the output is the analysis result of the emotional state. The avatar's response is adjusted according to the emotional state.

[0461] Step 6:

[0462] When a user requests an avatar to "search for fashion items," the server uses a product suggestion module based on profile information and past interaction data to suggest personalized products. The input information is the request and profile information, and the output is a list of suggested products.

[0463] Step 7:

[0464] When a user inputs a question about a product (e.g., "Tell me about this product"), the server immediately references the database and retrieves related product information. The input is the question, and the output is product information. The server returns the retrieved information to the user's device as an avatar message. The user makes a purchasing decision based on the information provided.

[0465] Step 8:

[0466] To support the user during their trip, the server monitors the user's emotional state in real time, and the avatar provides comforting messages and information as needed. The input of this process is the user's real-time messages and emotional data, and the output is a tailored response.

[0467] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0468] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0469] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0470] [Second embodiment]

[0471] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0472] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0473] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0474] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0475] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0476] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0477] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0478] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0479] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0480] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0481] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0482] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0483] The present invention relates to a system for enabling individuals to plan, improve themselves, and engage in solo activities with generated avatars, including a user terminal, a server, a generative model, a natural language processing module, and a travel plan generation module.

[0484] Avatar generation

[0485] A user first uses a user device to enter their profile information. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user's device and presented to the user.

[0486] Communicating with avatars

[0487] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server. The server uses a natural language processing module to analyze the user's message and generate an appropriate response. This response is then sent back to the user's device and displayed.

[0488] Generate a travel plan

[0489] Users can create travel plans together with their avatars. The user inputs their desired travel destinations and activities and sends this information from the user's device to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user's device. The user can review this proposal and make any necessary changes.

[0490] Travel support

[0491] Users can receive real-time support while traveling. For example, when a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate the optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided.

[0492] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. During an actual trip, the server provides real-time traffic information, allowing the user to enjoy solo activities with peace of mind.

[0493] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[0494] The processing flow will be explained below.

[0495] Avatar generation

[0496] Step 1:

[0497] The user opens a screen on the user terminal to input profile information for avatar generation, including age, gender, interests, hobbies, and special skills.

[0498] Step 2:

[0499] The device generates a request to send the entered profile information to the server. The data to be sent is constructed in JSON format and sent via POST to the specified API endpoint on the server.

[0500] Step 3:

[0501] The server analyzes the received profile information and inputs it into a generative model. The profiling module organizes the data and generates an avatar using the generative AI model.

[0502] Step 4:

[0503] The server returns the generated avatar data to the device, generating a JSON response containing the avatar image, attribute information, and other related data.

[0504] Step 5:

[0505] The device displays the avatar information received from the server to the user, showing the avatar's image and attribute information on the screen and providing customization options as needed.

[0506] Step 6:

[0507] The user checks the presented avatar, and if he / she wishes to customize it, he / she sends the information to the server again to update the avatar.

[0508] Communicating with avatars

[0509] Step 1:

[0510] The user opens a chat screen to interact with the avatar and enters a message such as "Hello."

[0511] Step 2:

[0512] The terminal generates a request to send the user's message to the server by sending a POST request containing the message data to the server.

[0513] Step 3:

[0514] The server passes the received message to a natural language processing module for analysis. The NLP (natural language processing) module analyzes the intent and content of the message and generates an appropriate response.

[0515] Step 4:

[0516] The server sends the generated response to the terminal. It generates a JSON response containing the response message and sends it to the user's terminal.

[0517] Step 5:

[0518] The device will display the response message received from the server, which will be displayed on the chat screen as a message from the avatar.

[0519] Step 6:

[0520] The user sees the avatar's response and continues the dialogue if desired, and the cycle repeats each time the user types a new message.

[0521] Generate a travel plan

[0522] Step 1:

[0523] The user enters the travel plan creation mode and inputs the places they want to go and the activities they want to do. For example, they input their wish to "watch a sporting event in Tokyo."

[0524] Step 2:

[0525] The device generates a request to send the user's input to the server. It constructs JSON data containing the desired content and sends a POST request to the server.

[0526] Step 3:

[0527] The server analyzes the user's request and retrieves relevant travel information from the database. It also executes a database query to retrieve information about sporting events taking place in Tokyo.

[0528] Step 4:

[0529] The server generates a travel plan based on the acquired information. The travel plan generation module creates a travel plan including dates, locations, means of transportation, etc.

[0530] Step 5:

[0531] The server sends the generated travel plan to the device. It also generates a JSON response containing the plan details and sends it to the user's device.

[0532] Step 6:

[0533] The terminal displays the travel plan received from the server to the user, showing the plan details on the screen and providing options to modify it if necessary.

[0534] Step 7:

[0535] The user reviews the proposed itinerary and modifies it as necessary. If the user makes any changes, the information is sent back to the server, and the itinerary is updated.

[0536] Travel support

[0537] Step 1:

[0538] The user enters a mode for receiving support during the actual trip, entering a request such as "Please tell me how to get to today's game" before leaving.

[0539] Step 2:

[0540] The device generates a request to send the user's request to the server, constructs a JSON containing the request data, and sends a POST request to the server.

[0541] Step 3:

[0542] The server analyzes the current traffic conditions in real time and generates an optimal route by querying traffic information APIs and map data.

[0543] Step 4:

[0544] The server sends the generated travel route and advice to the device, and generates a JSON response containing transportation instructions and sends it to the user's device.

[0545] Step 5:

[0546] The device displays the route information received from the server to the user, along with avatar messages about the route and important points to note.

[0547] Step 6:

[0548] The user then takes action based on the provided information, travels to the destination using the route provided, and enjoys the trip.

[0549] Example 1

[0550] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0551] In recent years, there has been a demand for tools that allow individuals to engage in self-improvement and solo activities without feeling lonely, but existing systems lack sufficient support. Specifically, they lack comprehensive support to alleviate the anxiety and complex planning that users may experience when working alone. To address this, it is necessary to provide a customizable support system that meets the individual needs of each user.

[0552] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0553] In this invention, the server includes a processing means for receiving personal profile information and generating an avatar using a generative model, a means for returning and displaying information about the generated avatar to a user terminal, a natural language processing means for analyzing user messages to communicate with the avatar, a travel plan generation means for generating a travel plan based on the user's wishes, a means for transmitting the generated travel plan to the user terminal, and a means for providing real-time support during the trip, thereby enabling users to make plans with avatars tailored to their individual needs and to engage in self-improvement and solo activities efficiently and with peace of mind.

[0554] A "user terminal" is a device that allows a user to input information and check the generated avatar and travel plan.

[0555] "Profile information" is information that identifies an individual, such as the user's age, gender, interests, hobbies, and special skills.

[0556] A "generative model" is an artificial intelligence model that generates an avatar based on input profile information.

[0557] An "avatar" is a virtual character that is generated based on a user's profile information.

[0558] "Means" is a general expression that refers to a device or module for realizing a specific function.

[0559] The "natural language processing means" is a module for analyzing messages from users during communication and generating appropriate responses.

[0560] The "travel plan generation means" is a module for planning travel destinations and activities based on the user's wishes.

[0561] The "real-time support means" is a module for providing information and guidance to users immediately while they are traveling.

[0562] "Server" refers to a device that processes, generates, analyzes, and transmits and receives data.

[0563] The present invention relates to a system for supporting individuals in making plans with generated avatars, for self-improvement, and for solo activities, and includes a user terminal, a server, a generative model, a natural language processing module, and a travel plan generation module.

[0564] Avatar generation

[0565] First, a user enters their profile information using a user device. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user device and presented to the user.

[0566] As a specific example, if the user is a 28-year-old male whose hobby is watching sports, when this information is input, the server generates an avatar of a character who is a 28-year-old male who likes watching sports.

[0567] Communicating with avatars

[0568] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server. The server uses a natural language processing module to analyze the user's message and generate an appropriate response. This response is then sent back to the user's device and displayed.

[0569] As a concrete example, when a user sends a message to an avatar saying "Hello, let's decide where to travel," the server generates a response saying "Where do you want to go?" which is sent back to the user terminal.

[0570] Generate a travel plan

[0571] Users can create travel plans together with their avatars. The user inputs their desired travel destinations and activities and sends this information from the user's device to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user's device. The user can review this proposal and make any necessary changes.

[0572] As a specific example, if a user inputs "I want to watch a sporting event in Tokyo," the server will generate an appropriate travel plan and suggest it to the user.

[0573] Travel support

[0574] Users can receive real-time support while traveling. For example, when a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate the optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided.

[0575] As a concrete example, when a user requests, "How do I get to today's game?", the server generates the optimal route and provides it to the user.

[0576] The system uses a generative AI model to generate an avatar based on the user's profile information, and supports communication between the user and the avatar through natural language processing using prompt sentences. It also uses a travel plan generation module to provide travel plans based on the user's preferences and provides real-time travel support, allowing users to enjoy solo activities with peace of mind.

[0577] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0578] Step 1:

[0579] The user uses the user terminal to input their profile information (age, gender, interests, hobbies, special skills, etc.). The input information is specific information such as age: 28, gender: male, hobby: watching sports, etc.

[0580] Step 2:

[0581] The device sends the entered profile information to the server. Specifically, the device sends the profile information to the server in JSON format using an HTTPS POST request. The input of this request is the profile information entered by the user, and the output is the information sent to the server.

[0582] Step 3:

[0583] The server generates an avatar using a generative AI model based on the received profile information. Specifically, the server inputs the profile information into the generative AI model and processes the data to generate the avatar. The input is the profile information, and the output is the generated avatar information.

[0584] Step 4:

[0585] The server returns the generated avatar information to the user device and presents it. Specifically, the server returns the avatar information to the user device in JSON format, and the device displays it. The input is the generated avatar information, and the output is transmission to the user device and display.

[0586] Step 5:

[0587] The user opens a chat screen to interact with the generated avatar and inputs a message. Specifically, the user inputs a message such as "Hello, let's decide on a travel destination," and presses the "Send" button. The input is the user's message.

[0588] Step 6:

[0589] The user terminal sends the message entered by the user to the server. Specifically, the terminal sends an HTTPS POST request to the server and sends the user's message in JSON format. The input is the user's message, and the output is what is sent to the server.

[0590] Step 7:

[0591] The server analyzes the received message using a natural language processing module. Specifically, the server analyzes the message using an NLP library and extracts the user's intent. The input is the user's message, and the output is the analysis result.

[0592] Step 8:

[0593] The server generates an appropriate response based on the analysis results and sends it back to the user device. Specifically, the server generates a response using a generative AI model and sends it to the user device in JSON format. The input is the analysis results, and the output is the generated response.

[0594] Step 9:

[0595] The user terminal receives the response from the server and displays it on the chat screen. Specifically, the terminal displays the response message and presents it to the user. The input is the response message from the server, and the output is the display on the terminal.

[0596] Step 10:

[0597] The user inputs their desired travel destinations and activities into the avatar and requests the creation of a travel plan. Specifically, the user inputs "I want to watch a sporting event in Tokyo" and presses the "Submit" button. The input is the user's travel preferences.

[0598] Step 11:

[0599] The terminal sends the user's travel wishes to the server. Specifically, the terminal sends an HTTPS POST request and sends the travel wishes to the server in JSON format. The input is the user's travel wishes, and the output is what is sent to the server.

[0600] Step 12:

[0601] The server uses the travel plan generation module to create a travel plan based on the user's preferences. Specifically, the server plans travel destinations and activities based on the user's preferences and processes the information. The input is the travel preferences, and the output is the generated travel plan.

[0602] Step 13:

[0603] The server sends the generated travel plan to the user's device. Specifically, the server returns the travel plan to the user's device in JSON format and proposes it to the user. The input is the generated travel plan, and the output is the transmission to the user's device.

[0604] Step 14:

[0605] The user checks the generated travel plan and modifies it if necessary. Specifically, the user checks the plan and re-enters it if any modifications are necessary. The input is the modified travel plan, and the output is resubmission.

[0606] Step 15:

[0607] While traveling, the user inputs a request for real-time support. Specifically, the user inputs "Please tell me how to get to today's game" into the terminal and presses the "Send" button. The input is a support request.

[0608] Step 16:

[0609] The device sends the user's support request to the server. Specifically, the device sends an HTTPS POST request and sends the request to the server in JSON format. The input is the support request, and the output is the transmission to the server.

[0610] Step 17:

[0611] The server generates optimal routes and information by referencing traffic information APIs and other databases. Specifically, the server calls external APIs to calculate traffic information and routes. The inputs are support requests and traffic information data, and the output is optimal route information.

[0612] Step 18:

[0613] The server sends the generated support information to the user's device. Specifically, the server returns the optimal route information to the user's device in JSON format. The input is the optimal route information, and the output is the information sent to the device.

[0614] Step 19:

[0615] The device displays support information to the user as an avatar message. Specifically, the device displays optimal route information on the chat screen and presents it to the user. The input is support information, and the output is the display on the device.

[0616] (Application example 1)

[0617] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0618] Previous systems supporting self-improvement and solo activities have not been able to fully alleviate the anxiety and loneliness that users feel when engaging in activities alone. Furthermore, they lacked product recommendations tailored to each user's individual interests and preferences, nor did they offer integrated management of virtual and physical stores. As a result, the user experience did not improve, leading to problems of low user satisfaction. In particular, the lack of purchasing assistance and real-time support in the virtual environment meant that user convenience was not fully realized.

[0619] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0620] In this invention, the server includes means for receiving personal profile information and generating an avatar using a generative model, means for recommending products based on the user's preferences using the avatar, means for displaying information about the recommended products on the user's terminal, and means for integrated management of the real store and the virtual store. This allows users to engage in self-improvement and solo activities with peace of mind, and further improves convenience through product recommendations tailored to individual preferences and integrated management of the virtual store and the real store.

[0621] A "user terminal" is a device that allows an individual to input profile information, interact with an avatar, and display recommended product information.

[0622] A "server" is a device or system that generates an avatar based on profile information sent by a user and performs processes such as dialogue analysis using natural language processing and travel plan generation.

[0623] A "generative model" is an algorithm or data model used to generate an avatar based on a user's profile information.

[0624] An "avatar" is a virtual character generated based on an individual's profile information, and assists the user in conversations and product recommendations.

[0625] "Dialogue analysis" is the process of analyzing messages entered by users and generating appropriate responses.

[0626] A "travel plan" is a detailed plan or proposal for a trip that is generated based on the user's wishes.

[0627] "Real-time support" is a function that aims to provide immediate and appropriate information and assistance for ongoing user activities.

[0628] "Product recommendation" is the process of suggesting appropriate products based on a user's preferences and profile information.

[0629] A "virtual store" is a virtual store that operates on the Internet, where users can browse and purchase products.

[0630] "Physical store" means a physical store where users can view and purchase products on-site.

[0631] "Integrated management" is the process of centrally managing inventory information and sales data from virtual and physical stores.

[0632] The present invention provides a system for individuals to use a generated avatar to recommend products and plan travel itineraries, and engage in self-improvement and solo activities. The system includes a user terminal, a server, a generative AI model, a natural language processing module, and a product recommendation module.

[0633] Use of user devices

[0634] First, a user enters their profile information using a user terminal. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. This information is then sent from the terminal to the server.

[0635] Avatar generation

[0636] The server uses a generative AI model based on the received profile information to generate an optimal avatar for each individual user, which is then sent back to the user's device and displayed on the screen.

[0637] Communicating with avatars

[0638] To interact with the generated avatar, the user opens a chat screen on their device. The message entered by the user is sent to the server, where a natural language processing module analyzes it and generates an appropriate response. This response is then sent back to the user's device and displayed on the chat screen.

[0639] Product recommendation

[0640] Users can enjoy shopping in a virtual store with their avatar. Based on the user's preferences and history data, the avatar recommends suitable products. The product recommendation module manages this process, and the recommended product information is displayed on the user's device.

[0641] Integrated management of virtual and physical stores

[0642] The server provides a function for centrally managing inventory information and sales data for both physical and virtual stores. This allows users to browse and purchase products in the virtual store through their avatars. Recommended products and inventory status are updated in real time.

[0643] Hardware and Software Configuration

[0644] Hardware: Smartphones, smart glasses, head-mounted displays. These devices provide the interface through which users interact with their avatars.

[0645] Software: Generative AI models (e.g., using TensorFlow, PyTorch), natural language processing modules (e.g., BERT, GPT-3), product recommendation modules, and communication APIs (e.g., RESTful APIs).

[0646] Description and examples

[0647] The server includes a means for receiving personal profile information and generating an avatar using a generative model, a means for recommending products based on the user's preferences using the avatar, a means for displaying information about the recommended products on the user's terminal, and a means for integrated management of the real store and the virtual store. This allows users to engage in self-improvement and solo activities with peace of mind, and further improves convenience through product recommendations tailored to individual preferences and integrated management of the virtual store and the real store.

[0648] As a concrete example, if a user launches an application on their smartphone and asks an avatar, "Tell me what sneakers you recommend," the avatar will refer to their past purchase history and current trend information and respond, "These new sneakers are popular."

[0649] Prompt Sentence Examples

[0650] "Male, 28 years old. I recently purchased athletic sneakers. I'd like some recommendations for new sneakers suitable for my upcoming training."

[0651] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0652] Step 1:

[0653] The user enters profile information. Personal information such as age, gender, interests, hobbies, and special skills is entered on the user's device and sent to the server.

[0654] Input: Personal information such as age, gender, interests, hobbies, and special skills

[0655] Output: Send profile information to server

[0656] Specific behavior: A user launches the application, enters profile information into a form, and clicks the submit button to send the information to the server.

[0657] Step 2:

[0658] The server generates an avatar using a generative AI model based on the received profile information, and sends the generated avatar information back to the user's device and displays it on the screen.

[0659] Input: Profile information

[0660] Output: Generated avatar data

[0661] Specific operation: The server inputs the received profile information into the generation AI model to generate an avatar, then sends the generated avatar data to the user's device and displays it on the device.

[0662] Step 3:

[0663] To interact with an avatar, a user opens a chat screen and enters a message. The message is sent from the user's device to the server, where a natural language processing module analyzes the message and generates an appropriate response. The generated response is then sent back to the user's device and displayed on the screen.

[0664] Input: User message

[0665] Output: The generated response

[0666] Specific operation: The user opens the chat screen, enters a text message, and presses the send button. The server analyzes the received message using a natural language processing module, generates a response from the avatar, and sends it back to the user's device.

[0667] Step 4:

[0668] The user requests a product recommendation from the avatar. Based on the user's preferences and history data, the product recommendation module selects appropriate products and sends the recommended product information to the user's device.

[0669] Input: User preferences and historical data

[0670] Output: Recommended product information

[0671] Specific operation: The user asks the avatar, "Please recommend me some products." The server uses the product recommendation module to select appropriate products based on the user's past purchase history and preferences, and sends that information to the user's device.

[0672] Step 5:

[0673] The server manages the virtual store and the physical store in an integrated manner, providing real-time inventory information and sales data from the physical store to users' devices, allowing them to make purchasing decisions based on this information.

[0674] Input: Inventory information and sales data for physical and virtual stores

[0675] Output: Integrated inventory information and sales data

[0676] Specific operation: The server manages inventory and sales data from both the virtual and physical stores, and keeps the data up to date. When a user selects a product they wish to purchase, the server provides current inventory information and assists in the purchasing process.

[0677] Step 6:

[0678] The server provides real-time support, instantly responding with relevant information in response to ongoing user activity, such as a user requesting "directions from my current location to the nearest store."

[0679] Input: User's current ongoing activity information and requests

[0680] Output: Appropriate real-time support information

[0681] Specific operation: When a user asks the avatar, "Tell me the way to the nearest store," the server calculates the optimal route based on the current location information and route data, and sends that information back to the user's device.

[0682] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0683] The present invention relates to a system for enabling individuals to plan, improve themselves, and engage in solo activities with generated avatars, including a user terminal, a server, a generative model, a natural language processing module, an emotion engine, and a travel plan generation module.

[0684] Avatar generation

[0685] A user first uses a user device to enter their profile information. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user's device and presented to the user.

[0686] Avatar communication and emotion recognition

[0687] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server, which uses a natural language processing module to analyze the user's message and generate an appropriate response.

[0688] Furthermore, the server utilizes an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's input message and facial expression data acquired from the facial recognition camera. Based on the analysis results, the avatar's response is tailored to the user's emotions. For example, if the user is feeling stressed, the avatar can select a comforting response.

[0689] Generate a travel plan

[0690] Users can create travel plans together with their avatars. The user inputs their desired travel destinations and activities and sends this information from the user's device to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user's device. The user can review this proposal and make any necessary changes.

[0691] Travel support and emotion recognition

[0692] Users can receive real-time support while traveling. For example, when a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate the optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided.

[0693] Furthermore, the emotion engine can monitor the user's emotional state while traveling and provide appropriate support. For example, if the user becomes lost and feels fear or anxiety, the emotion engine will recognize that emotion and the avatar will provide advice to help them calm down.

[0694] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. In an actual trip, the server provides real-time traffic information, and the emotion engine adjusts the avatar's responses based on the user's emotional state, allowing the user to enjoy solo activities with peace of mind.

[0695] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[0696] The processing flow will be explained below.

[0697] Avatar generation

[0698] Step 1:

[0699] The user opens a screen on the user terminal to input profile information for avatar generation, including age, gender, interests, hobbies, and special skills.

[0700] Step 2:

[0701] The device generates a request to send the entered profile information to the server. The data to be sent is constructed in JSON format and sent via POST to the specified API endpoint on the server.

[0702] Step 3:

[0703] The server analyzes the received profile information and inputs it into a generative model. The profiling module organizes the data and generates an avatar using the generative AI model.

[0704] Step 4:

[0705] The server returns the generated avatar data to the device, generating a JSON response containing the avatar image, attribute information, and other related data.

[0706] Step 5:

[0707] The device displays the avatar information received from the server to the user, showing the avatar's image and attribute information on the screen and providing customization options as needed.

[0708] Step 6:

[0709] The user checks the presented avatar, and if he / she wishes to customize it, he / she sends the information to the server again to update the avatar.

[0710] Avatar communication and emotion recognition

[0711] Step 1:

[0712] The user opens a chat screen to interact with the avatar and enters a message such as "Hello."

[0713] Step 2:

[0714] The terminal generates a request to send the user's message to the server by sending a POST request containing the message data to the server.

[0715] Step 3:

[0716] The server passes the received message to a natural language processing module for analysis. The NLP (natural language processing) module analyzes the intent and content of the message and generates an appropriate response.

[0717] Step 4:

[0718] The server sends the generated response to the terminal. It generates a JSON response containing the response message and sends it to the user's terminal.

[0719] Step 5:

[0720] The device will display the response message received from the server, which will be displayed on the chat screen as a message from the avatar.

[0721] Step 6:

[0722] The user sees the avatar's response and continues the dialogue if desired, and the cycle repeats each time the user types a new message.

[0723] Step 7:

[0724] The server passes the user's input message and facial expression data from a face recognition camera installed on the user's device to the emotion engine for analysis, which determines the user's emotional state.

[0725] Step 8:

[0726] The server adjusts the avatar's responses based on the emotion engine's analysis, for example generating a comforting response if the user is feeling stressed.

[0727] Generate a travel plan

[0728] Step 1:

[0729] The user enters the travel plan creation mode and inputs the places they want to go and the activities they want to do. For example, they input their wish to "watch a sporting event in Tokyo."

[0730] Step 2:

[0731] The device generates a request to send the user's input to the server. It constructs JSON data containing the desired content and sends a POST request to the server.

[0732] Step 3:

[0733] The server analyzes the user's request and retrieves relevant travel information from the database. It also executes a database query to retrieve information about sporting events taking place in Tokyo.

[0734] Step 4:

[0735] The server generates a travel plan based on the acquired information. The travel plan generation module creates a travel plan including dates, locations, means of transportation, etc.

[0736] Step 5:

[0737] The server sends the generated travel plan to the device. It also generates a JSON response containing the plan details and sends it to the user's device.

[0738] Step 6:

[0739] The terminal displays the travel plan received from the server to the user, showing the plan details on the screen and providing options to modify it if necessary.

[0740] Step 7:

[0741] The user reviews the proposed itinerary and modifies it as necessary. If the user makes any changes, the information is sent back to the server, and the itinerary is updated.

[0742] Travel support and emotion recognition

[0743] Step 1:

[0744] The user enters a mode for receiving support during the actual trip, entering a request such as "Please tell me how to get to today's game" before leaving.

[0745] Step 2:

[0746] The device generates a request to send the user's request to the server, constructs a JSON containing the request data, and sends a POST request to the server.

[0747] Step 3:

[0748] The server analyzes the current traffic conditions in real time and generates an optimal route by querying traffic information APIs and map data.

[0749] Step 4:

[0750] The server sends the generated travel route and advice to the device, and generates a JSON response containing transportation instructions and sends it to the user's device.

[0751] Step 5:

[0752] The device displays the route information received from the server to the user, along with avatar messages about the route and important points to note.

[0753] Step 6:

[0754] The user then takes action based on the provided information, travels to the destination using the route provided, and enjoys the trip.

[0755] Step 7:

[0756] The server monitors the user's emotional state during the trip and analyzes it using an emotion engine in a timely manner. If the user feels anxious or stressed, the server provides appropriate comfort and advice through the avatar.

[0757] Step 8:

[0758] The device displays responses and advice sent from the server to the user in real time, providing support so that the user can continue their activities with peace of mind.

[0759] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. In an actual trip, the server provides real-time traffic information, and the emotion engine adjusts the avatar's responses based on the user's emotional state, allowing the user to enjoy solo activities with peace of mind.

[0760] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[0761] Example 2

[0762] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0763] In modern society, it is important for individuals to enjoy solo activities while engaging in activities that match their interests and hobbies, while also improving themselves. However, traditional planning and information gathering can be time-consuming and laborious, and solo activities can sometimes be accompanied by feelings of loneliness and anxiety. Therefore, there is a growing need for a system that automatically provides optimal support to individual users, allowing them to plan and engage in activities with peace of mind.

[0764] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0765] In this invention, the server includes means for receiving profile information and generating an avatar using a generation AI model, means having a natural language processing module for analyzing dialogue for communicating with the avatar, and means having a travel plan generation module for generating a travel plan based on the user's wishes. This allows the user to communicate with the optimal avatar based on their profile information, efficiently plan activities according to their wishes, and enjoy safe and enjoyable solo activities.

[0766] A "user terminal" is a communication device operated by an individual, and is a device for inputting and displaying information.

[0767] A "server" is a central control device that receives information sent from user terminals, performs various processes, and then sends the information.

[0768] A "generative AI model" is an artificial intelligence algorithm that generates the optimal avatar based on a user's profile information.

[0769] A "natural language processing module" is a technology for analyzing a user's text message and generating an appropriate response.

[0770] An "emotion recognition engine" is a device that analyzes a user's message and facial expression data to recognize the user's emotional state and adjust the response.

[0771] The "travel plan generation module" is a function that automatically generates an appropriate travel plan based on the user's wishes.

[0772] "Profile information" is personal data such as the user's age, gender, interests, hobbies, and special skills.

[0773] An "avatar" is a virtual character that is generated based on a user's profile information and that communicates with the user.

[0774] "Real-time support" is a function that responds immediately to user requests and provides appropriate information and assistance in situations such as while traveling.

[0775] The present invention relates to a system for enabling individuals to plan, improve themselves, and engage in solo activities with a generated avatar, including a user terminal, a server, a generative AI model, a natural language processing module, an emotion recognition engine, and a travel plan generation module.

[0776] A user first uses a user device to enter their profile information. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative AI model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user's device and presented to the user.

[0777] The user opens a chat screen to interact with the generated avatar. The message entered by the user is sent from the user's device to the server. The server utilizes a natural language processing module to analyze the user's message and generate an appropriate response. The server then utilizes an emotion recognition engine to recognize the user's emotions. The emotion recognition engine analyzes the message entered by the user and facial expression data acquired from the facial recognition camera. Based on the analysis results, the avatar's response is adjusted to match the user's emotions. For example, if the user is feeling stressed, the avatar can select a comforting response.

[0778] Users can also create travel plans together with their avatars by inputting their desired travel destinations and activities. The user inputs the desired travel destinations and activities and sends them from the user terminal to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user terminal. The user can review the proposal and make any necessary changes.

[0779] Users can receive real-time support while traveling. For example, if a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate an optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided. Furthermore, the user's emotional state can be monitored during the trip, and the emotion recognition engine can provide appropriate support. For example, if a user becomes lost and feels fear or anxiety, the emotion recognition engine will recognize that emotion and the avatar will provide advice to help them calm down.

[0780] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. During an actual trip, the server provides real-time traffic information, and an emotion recognition engine adjusts the avatar's responses based on the user's emotional state, allowing the user to enjoy solo activities with peace of mind.

[0781] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[0782] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0783] Step 1:

[0784] The user enters profile information.

[0785] Input: The user inputs information such as age, gender, interests, hobbies, and special skills into the user terminal.

[0786] Data processing: The terminal formats the input data and sends it to the server.

[0787] Output: The profile information is sent to the server.

[0788] Specific operation: The user enters "28 years old, male, hobby is watching sports" and presses the send button.

[0789] Step 2:

[0790] The server generates the avatar.

[0791] Input: The server receives the profile information sent from the user terminal.

[0792] Data calculation: A generative AI model analyzes profile information and generates an avatar.

[0793] Output: The generated avatar data is sent to the server.

[0794] Specific operation: The server provides the generated AI model with information such as "28 years old, male, hobby is watching sports" and generates an avatar.

[0795] Step 3:

[0796] The server transmits the avatar information to the user terminal.

[0797] Input: Avatar data generated on the server.

[0798] Data processing: The server formats the avatar information and sends it to the user's device.

[0799] Output: Avatar information arrives on the user's device.

[0800] Specific operation: The server sends the generated avatar data in JSON format to the user device.

[0801] Step 4:

[0802] The user starts chatting with the avatar.

[0803] Input: The user types a chat message and presses the send button.

[0804] Data processing: The terminal sends the message data to the server.

[0805] Output: The user's message is sent to the server.

[0806] Specific operation: The user types "Hello" into the chat screen and presses the send button.

[0807] Step 5:

[0808] The server parses the message.

[0809] Input: User's message data to the server.

[0810] Data Computation: A natural language processing module analyzes the message and generates an appropriate response.

[0811] Output: Parsed results and response data are provided to the server.

[0812] Specific operation: The server passes the message "hello" to the natural language processing module, which parses it as a "greeting" and generates a response.

[0813] Step 6:

[0814] The server sends a response to the user terminal.

[0815] Input: Parsed results and response data to the server.

[0816] Data processing: The server formats the response data and sends it to the user terminal.

[0817] Output: A response message arrives at the user terminal.

[0818] Specific operation: The server sends the generated response "Hello! How are you today?" to the user terminal.

[0819] Step 7:

[0820] Emotion recognition on the server.

[0821] Input: User message data and facial expression data.

[0822] Data Calculation: An emotion recognition engine analyzes the message and facial expression data to determine the user's emotional state.

[0823] Output: The emotion recognition results are provided to the server.

[0824] Specific operation: The server analyzes messages such as "I'm not feeling very well today" and facial expression data from the camera using an emotion recognition engine.

[0825] Step 8:

[0826] The server coordinates the avatar's response.

[0827] Input: Emotion recognition results and response data.

[0828] Data processing: The server adjusts the response data based on the emotion recognition results.

[0829] Output: A tailored response message is generated.

[0830] What happens: The server generates a response based on the results of the emotion recognition engine: "You seem to be in a bad mood today. Is there anything I can help you with?"

[0831] Step 9:

[0832] The user inputs the travel destination and activity.

[0833] Input: The user inputs the desired travel destination and activity into the user terminal.

[0834] Data processing: The terminal sends the input data to the server.

[0835] Output: Travel destination and activity information is sent to the server.

[0836] Specific actions: The user enters "I want to watch a sporting event in Tokyo" and presses the send button.

[0837] Step 10:

[0838] The server generates the itinerary.

[0839] Input: Your desired travel destination and activity information sent to the server.

[0840] Data calculation: The travel plan generation module generates a travel plan based on the user's wishes.

[0841] Output: The generated itinerary is provided to the server.

[0842] Specific operation: The server uses the travel plan generation module to generate a travel plan such as "Watching a baseball game at Tokyo Dome, this weekend's plan."

[0843] Step 11:

[0844] The server transmits the travel plan to the user terminal.

[0845] Input: A server-generated itinerary.

[0846] Data processing: The server formats the travel plan and sends it to the user's terminal.

[0847] Output: The travel plan is delivered to the user's device.

[0848] Specific operation: The server sends the generated travel plan in JSON format to the user terminal.

[0849] Step 12:

[0850] Respond to requests during your trip.

[0851] Input: Users input support requests in real time.

[0852] Data processing: The terminal sends the request data to the server.

[0853] Output: The request is sent to the server.

[0854] Specific operation: The user types "Please tell me how to get to today's game" and submits it.

[0855] Step 13:

[0856] The server provides the appropriate information.

[0857] Input: The request data sent to the server.

[0858] Data calculation: The server references the traffic information API and generates optimal route information.

[0859] Output: The generated route information is sent to the user terminal.

[0860] Specific operation: The server uses the traffic information API to generate a "route from the nearest station to Tokyo Dome" and sends it to the user's device.

[0861] Step 14:

[0862] The server identifies the emotional state during the trip and tailors the response.

[0863] Input: User message data and facial expression data.

[0864] Data Calculation: An emotion recognition engine analyzes the message and facial expression data to determine the user's emotional state.

[0865] Output: Based on the emotion recognition results, a tailored response message is generated.

[0866] Specific behavior: The server uses an emotion recognition engine to provide advice such as "If you're lost and worried, maybe it would be a good idea to take a break at a nearby cafe" if the user feels fear or anxiety.

[0867] (Application example 2)

[0868] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0869] There is a need for systems that provide product recommendations and appropriate real-time support based on personal hobbies and interests through individually customized avatars. In particular, there is a need for methods that can reduce stress and anxiety users feel while shopping by analyzing the user's emotional state and providing appropriate responses. However, existing systems have limited functionality for generating avatars based on user profile information and are inferior in real-time support and emotion recognition, which leaves the user experience unsatisfactory.

[0870] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving personal profile information and generating an avatar using a generative model, means for suggesting products based on the user's interests and hobbies, and an emotion engine for analyzing the user's emotional state and adjusting appropriate responses. This enables users to receive personalized product information and enjoy real-time support through their individually customized avatars, thereby reducing stress and anxiety while shopping.

[0871] A "user terminal" is a device that allows an individual to enter profile information and communicate with an avatar.

[0872] "Profile information" is personal information such as the user's age, gender, interests, hobbies, and special skills.

[0873] The "server" is a central processing unit that processes information received from user terminals, generates avatars, analyzes dialogue and emotional states, suggests products, and provides real-time support.

[0874] A "generative model" is an algorithm for generating the optimal avatar based on a user's profile information.

[0875] An "avatar" is a virtual character that is generated based on the user's profile information and is used to communicate with the user.

[0876] "Communication" refers to conversations and message exchanges between a user and an avatar.

[0877] A "dialogue analysis server" is a server that analyzes messages entered by users and generates appropriate responses.

[0878] The "means for suggesting products" is an algorithm that suggests appropriate products based on the user's interests and hobbies.

[0879] The "emotion engine" is an engine that analyzes the user's emotional state from their messages and facial expressions and adjusts the avatar's response.

[0880] A "means for providing real-time support" is a system for providing immediate responses to user questions and requests.

[0881] The present invention provides a system for enabling individuals to shop with a generated avatar and receive appropriate support according to their emotional state. The system includes a user terminal, a server, a generative model, a natural language processing module, an emotion engine, and a product suggestion module.

[0882] 1. Enter your user profile

[0883] Users use smart glasses or smartphones to enter their profile information, which includes age, gender, interests, hobbies, special skills, etc. The entered information is then sent from the user terminal to the server.

[0884] 2. Avatar generation

[0885] The server uses a generative model based on the received profile information to generate an avatar that best suits the individual user. This avatar is then sent back to the user's device and displayed. For example, if a user is a 28-year-old woman who is interested in fashion, a personalized avatar will be generated based on that information.

[0886] 3. Avatar communication and emotion recognition

[0887] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server, which uses a natural language processing module to analyze the user's messages and generate appropriate responses.

[0888] Additionally, the system uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes messages typed by the user and facial expression data captured by the smart glasses' camera. Based on the analysis results, the avatar's response is adjusted. For example, if the user is feeling stressed, the avatar will make suggestions to help them relax.

[0889] 4. Product proposal

[0890] Based on the user's profile information and interests and hobbies derived from past interactions, the server uses a product suggestion module to suggest personalized products. For example, if a user says, "I'm looking for fashion items," the avatar will suggest fashion items that are appropriate for the season.

[0891] 5. Real-time support

[0892] While shopping, users can receive real-time support from the server. When a user types "Tell me about this product," the message is sent to the server. The server references the database, retrieves the appropriate product information, and returns it to the user. This information is displayed as an avatar message, allowing the user to make a purchasing decision based on the information provided.

[0893] For example, if a 28-year-old woman asks the avatar, "What do you recommend today?", the server will suggest appropriate fashion items based on the user's profile information. If the user is feeling stressed, the avatar will also suggest products that will help them relax.

[0894] Prompt Sentence Examples

[0895] User: "I'm a 28-year-old woman interested in fashion. Can you recommend some summer outfits?"

[0896] Model: "I'll suggest some fashion items. Let's start with avatar generation."

[0897] As described above, this system provides an environment where users can enjoy shopping with individually customized avatars and receive appropriate real-time support while reducing stress.

[0898] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0899] Step 1:

[0900] The user terminal inputs personal profile information (age, gender, interests, hobbies, special skills, etc.) and sends it to the server. This input information also includes the user's preferences and purchase list. The server receives this information.

[0901] Step 2:

[0902] The server uses a generative model based on the received profile information to generate the optimal avatar. Specifically, it compares the profile information with a database and selects and generates an appropriate avatar. The input to this process is the user's profile information, and the output is the generated avatar information.

[0903] Step 3:

[0904] The server returns information about the generated avatar to the user terminal, which then displays the avatar to the user. The user then checks the displayed avatar and begins a dialogue.

[0905] Step 4:

[0906] The user interacts with the generated avatar through a chat screen. Messages entered by the user are sent from the user's device to the server. This message is the input for processing, and the server analyzes the message using a natural language processing module to generate an appropriate response. The analysis results are output and sent back to the user's device.

[0907] Step 5:

[0908] The server simultaneously uses an emotion engine to analyze the user's input message and facial expression data to recognize the user's emotional state. The input of this process is the message and facial expression data, and the output is the analysis result of the emotional state. The avatar's response is adjusted according to the emotional state.

[0909] Step 6:

[0910] When a user requests an avatar to "search for fashion items," the server uses a product suggestion module based on profile information and past interaction data to suggest personalized products. The input information is the request and profile information, and the output is a list of suggested products.

[0911] Step 7:

[0912] When a user inputs a question about a product (e.g., "Tell me about this product"), the server immediately references the database and retrieves related product information. The input is the question, and the output is product information. The server returns the retrieved information to the user's device as an avatar message. The user makes a purchasing decision based on the information provided.

[0913] Step 8:

[0914] To support the user during their trip, the server monitors the user's emotional state in real time, and the avatar provides comforting messages and information as needed. The input of this process is the user's real-time messages and emotional data, and the output is a tailored response.

[0915] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0916] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0917] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0918] [Third embodiment]

[0919] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0920] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0921] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0922] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0923] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0924] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0925] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0926] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0927] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0928] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0929] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0930] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0931] The present invention relates to a system for enabling individuals to plan, improve themselves, and engage in solo activities with generated avatars, including a user terminal, a server, a generative model, a natural language processing module, and a travel plan generation module.

[0932] Avatar generation

[0933] A user first uses a user device to enter their profile information. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user's device and presented to the user.

[0934] Communicating with avatars

[0935] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server. The server uses a natural language processing module to analyze the user's message and generate an appropriate response. This response is then sent back to the user's device and displayed.

[0936] Generate a travel plan

[0937] Users can create travel plans together with their avatars. The user inputs their desired travel destinations and activities and sends this information from the user's device to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user's device. The user can review this proposal and make any necessary changes.

[0938] Travel support

[0939] Users can receive real-time support while traveling. For example, when a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate the optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided.

[0940] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. During an actual trip, the server provides real-time traffic information, allowing the user to enjoy solo activities with peace of mind.

[0941] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[0942] The processing flow will be explained below.

[0943] Avatar generation

[0944] Step 1:

[0945] The user opens a screen on the user terminal to input profile information for avatar generation, including age, gender, interests, hobbies, and special skills.

[0946] Step 2:

[0947] The device generates a request to send the entered profile information to the server. The data to be sent is constructed in JSON format and sent via POST to the specified API endpoint on the server.

[0948] Step 3:

[0949] The server analyzes the received profile information and inputs it into a generative model. The profiling module organizes the data and generates an avatar using the generative AI model.

[0950] Step 4:

[0951] The server returns the generated avatar data to the device, generating a JSON response containing the avatar image, attribute information, and other related data.

[0952] Step 5:

[0953] The device displays the avatar information received from the server to the user, showing the avatar's image and attribute information on the screen and providing customization options as needed.

[0954] Step 6:

[0955] The user checks the presented avatar, and if he / she wishes to customize it, he / she sends the information to the server again to update the avatar.

[0956] Communicating with avatars

[0957] Step 1:

[0958] The user opens a chat screen to interact with the avatar and enters a message such as "Hello."

[0959] Step 2:

[0960] The terminal generates a request to send the user's message to the server by sending a POST request containing the message data to the server.

[0961] Step 3:

[0962] The server passes the received message to a natural language processing module for analysis. The NLP (natural language processing) module analyzes the intent and content of the message and generates an appropriate response.

[0963] Step 4:

[0964] The server sends the generated response to the terminal. It generates a JSON response containing the response message and sends it to the user's terminal.

[0965] Step 5:

[0966] The device will display the response message received from the server, which will be displayed on the chat screen as a message from the avatar.

[0967] Step 6:

[0968] The user sees the avatar's response and continues the dialogue if desired, and the cycle repeats each time the user types a new message.

[0969] Generate a travel plan

[0970] Step 1:

[0971] The user enters the travel plan creation mode and inputs the places they want to go and the activities they want to do. For example, they input their wish to "watch a sporting event in Tokyo."

[0972] Step 2:

[0973] The device generates a request to send the user's input to the server. It constructs JSON data containing the desired content and sends a POST request to the server.

[0974] Step 3:

[0975] The server analyzes the user's request and retrieves relevant travel information from the database. It also executes a database query to retrieve information about sporting events taking place in Tokyo.

[0976] Step 4:

[0977] The server generates a travel plan based on the acquired information. The travel plan generation module creates a travel plan including dates, locations, means of transportation, etc.

[0978] Step 5:

[0979] The server sends the generated travel plan to the device. It also generates a JSON response containing the plan details and sends it to the user's device.

[0980] Step 6:

[0981] The terminal displays the travel plan received from the server to the user, showing the plan details on the screen and providing options to modify it if necessary.

[0982] Step 7:

[0983] The user reviews the proposed itinerary and modifies it as necessary. If the user makes any changes, the information is sent back to the server, and the itinerary is updated.

[0984] Travel support

[0985] Step 1:

[0986] The user enters a mode for receiving support during the actual trip, entering a request such as "Please tell me how to get to today's game" before leaving.

[0987] Step 2:

[0988] The device generates a request to send the user's request to the server, constructs a JSON containing the request data, and sends a POST request to the server.

[0989] Step 3:

[0990] The server analyzes the current traffic conditions in real time and generates an optimal route by querying traffic information APIs and map data.

[0991] Step 4:

[0992] The server sends the generated travel route and advice to the device, and generates a JSON response containing transportation instructions and sends it to the user's device.

[0993] Step 5:

[0994] The device displays the route information received from the server to the user, along with avatar messages about the route and important points to note.

[0995] Step 6:

[0996] The user then takes action based on the provided information, travels to the destination using the route provided, and enjoys the trip.

[0997] Example 1

[0998] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0999] In recent years, there has been a demand for tools that allow individuals to engage in self-improvement and solo activities without feeling lonely, but existing systems lack sufficient support. Specifically, they lack comprehensive support to alleviate the anxiety and complex planning that users may experience when working alone. To address this, it is necessary to provide a customizable support system that meets the individual needs of each user.

[1000] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1001] In this invention, the server includes a processing means for receiving personal profile information and generating an avatar using a generative model, a means for returning and displaying information about the generated avatar to a user terminal, a natural language processing means for analyzing user messages to communicate with the avatar, a travel plan generation means for generating a travel plan based on the user's wishes, a means for transmitting the generated travel plan to the user terminal, and a means for providing real-time support during the trip, thereby enabling users to make plans with avatars tailored to their individual needs and to engage in self-improvement and solo activities efficiently and with peace of mind.

[1002] A "user terminal" is a device that allows a user to input information and check the generated avatar and travel plan.

[1003] "Profile information" is information that identifies an individual, such as the user's age, gender, interests, hobbies, and special skills.

[1004] A "generative model" is an artificial intelligence model that generates an avatar based on input profile information.

[1005] An "avatar" is a virtual character that is generated based on a user's profile information.

[1006] "Means" is a general expression that refers to a device or module for realizing a specific function.

[1007] The "natural language processing means" is a module for analyzing messages from users during communication and generating appropriate responses.

[1008] The "travel plan generation means" is a module for planning travel destinations and activities based on the user's wishes.

[1009] The "real-time support means" is a module for providing information and guidance to users immediately while they are traveling.

[1010] "Server" refers to a device that processes, generates, analyzes, and transmits and receives data.

[1011] The present invention relates to a system for supporting individuals in making plans with generated avatars, for self-improvement, and for solo activities, and includes a user terminal, a server, a generative model, a natural language processing module, and a travel plan generation module.

[1012] Avatar generation

[1013] First, a user enters their profile information using a user device. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user device and presented to the user.

[1014] As a specific example, if the user is a 28-year-old male whose hobby is watching sports, when this information is input, the server generates an avatar of a character who is a 28-year-old male who likes watching sports.

[1015] Communicating with avatars

[1016] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server. The server uses a natural language processing module to analyze the user's message and generate an appropriate response. This response is then sent back to the user's device and displayed.

[1017] As a concrete example, when a user sends a message to an avatar saying "Hello, let's decide where to travel," the server generates a response saying "Where do you want to go?" which is sent back to the user terminal.

[1018] Generate a travel plan

[1019] Users can create travel plans together with their avatars. The user inputs their desired travel destinations and activities and sends this information from the user's device to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user's device. The user can review this proposal and make any necessary changes.

[1020] As a specific example, if a user inputs "I want to watch a sporting event in Tokyo," the server will generate an appropriate travel plan and suggest it to the user.

[1021] Travel support

[1022] Users can receive real-time support while traveling. For example, when a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate the optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided.

[1023] As a concrete example, when a user requests, "How do I get to today's game?", the server generates the optimal route and provides it to the user.

[1024] The system uses a generative AI model to generate an avatar based on the user's profile information, and supports communication between the user and the avatar through natural language processing using prompt sentences. It also uses a travel plan generation module to provide travel plans based on the user's preferences and provides real-time travel support, allowing users to enjoy solo activities with peace of mind.

[1025] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1026] Step 1:

[1027] The user uses the user terminal to input their profile information (age, gender, interests, hobbies, special skills, etc.). The input information is specific information such as age: 28, gender: male, hobby: watching sports, etc.

[1028] Step 2:

[1029] The device sends the entered profile information to the server. Specifically, the device sends the profile information to the server in JSON format using an HTTPS POST request. The input of this request is the profile information entered by the user, and the output is the information sent to the server.

[1030] Step 3:

[1031] The server generates an avatar using a generative AI model based on the received profile information. Specifically, the server inputs the profile information into the generative AI model and processes the data to generate the avatar. The input is the profile information, and the output is the generated avatar information.

[1032] Step 4:

[1033] The server returns the generated avatar information to the user device and presents it. Specifically, the server returns the avatar information to the user device in JSON format, and the device displays it. The input is the generated avatar information, and the output is transmission to the user device and display.

[1034] Step 5:

[1035] The user opens a chat screen to interact with the generated avatar and inputs a message. Specifically, the user inputs a message such as "Hello, let's decide on a travel destination," and presses the "Send" button. The input is the user's message.

[1036] Step 6:

[1037] The user terminal sends the message entered by the user to the server. Specifically, the terminal sends an HTTPS POST request to the server and sends the user's message in JSON format. The input is the user's message, and the output is what is sent to the server.

[1038] Step 7:

[1039] The server analyzes the received message using a natural language processing module. Specifically, the server analyzes the message using an NLP library and extracts the user's intent. The input is the user's message, and the output is the analysis result.

[1040] Step 8:

[1041] The server generates an appropriate response based on the analysis results and sends it back to the user device. Specifically, the server generates a response using a generative AI model and sends it to the user device in JSON format. The input is the analysis results, and the output is the generated response.

[1042] Step 9:

[1043] The user terminal receives the response from the server and displays it on the chat screen. Specifically, the terminal displays the response message and presents it to the user. The input is the response message from the server, and the output is the display on the terminal.

[1044] Step 10:

[1045] The user inputs their desired travel destinations and activities into the avatar and requests the creation of a travel plan. Specifically, the user inputs "I want to watch a sporting event in Tokyo" and presses the "Submit" button. The input is the user's travel preferences.

[1046] Step 11:

[1047] The terminal sends the user's travel wishes to the server. Specifically, the terminal sends an HTTPS POST request and sends the travel wishes to the server in JSON format. The input is the user's travel wishes, and the output is what is sent to the server.

[1048] Step 12:

[1049] The server uses the travel plan generation module to create a travel plan based on the user's preferences. Specifically, the server plans travel destinations and activities based on the user's preferences and processes the information. The input is the travel preferences, and the output is the generated travel plan.

[1050] Step 13:

[1051] The server sends the generated travel plan to the user's device. Specifically, the server returns the travel plan to the user's device in JSON format and proposes it to the user. The input is the generated travel plan, and the output is the transmission to the user's device.

[1052] Step 14:

[1053] The user checks the generated travel plan and modifies it if necessary. Specifically, the user checks the plan and re-enters it if any modifications are necessary. The input is the modified travel plan, and the output is resubmission.

[1054] Step 15:

[1055] While traveling, the user inputs a request for real-time support. Specifically, the user inputs "Please tell me how to get to today's game" into the terminal and presses the "Send" button. The input is a support request.

[1056] Step 16:

[1057] The device sends the user's support request to the server. Specifically, the device sends an HTTPS POST request and sends the request to the server in JSON format. The input is the support request, and the output is the transmission to the server.

[1058] Step 17:

[1059] The server generates optimal routes and information by referencing traffic information APIs and other databases. Specifically, the server calls external APIs to calculate traffic information and routes. The inputs are support requests and traffic information data, and the output is optimal route information.

[1060] Step 18:

[1061] The server sends the generated support information to the user's device. Specifically, the server returns the optimal route information to the user's device in JSON format. The input is the optimal route information, and the output is the information sent to the device.

[1062] Step 19:

[1063] The device displays support information to the user as an avatar message. Specifically, the device displays optimal route information on the chat screen and presents it to the user. The input is support information, and the output is the display on the device.

[1064] (Application example 1)

[1065] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1066] Previous systems supporting self-improvement and solo activities have not been able to fully alleviate the anxiety and loneliness that users feel when engaging in activities alone. Furthermore, they lacked product recommendations tailored to each user's individual interests and preferences, nor did they offer integrated management of virtual and physical stores. As a result, the user experience did not improve, leading to problems of low user satisfaction. In particular, the lack of purchasing assistance and real-time support in the virtual environment meant that user convenience was not fully realized.

[1067] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1068] In this invention, the server includes means for receiving personal profile information and generating an avatar using a generative model, means for recommending products based on the user's preferences using the avatar, means for displaying information about the recommended products on the user's terminal, and means for integrated management of the real store and the virtual store. This allows users to engage in self-improvement and solo activities with peace of mind, and further improves convenience through product recommendations tailored to individual preferences and integrated management of the virtual store and the real store.

[1069] A "user terminal" is a device that allows an individual to input profile information, interact with an avatar, and display recommended product information.

[1070] A "server" is a device or system that generates an avatar based on profile information sent by a user and performs processes such as dialogue analysis using natural language processing and travel plan generation.

[1071] A "generative model" is an algorithm or data model used to generate an avatar based on a user's profile information.

[1072] An "avatar" is a virtual character generated based on an individual's profile information, and assists the user in conversations and product recommendations.

[1073] "Dialogue analysis" is the process of analyzing messages entered by users and generating appropriate responses.

[1074] A "travel plan" is a detailed plan or proposal for a trip that is generated based on the user's wishes.

[1075] "Real-time support" is a function that aims to provide immediate and appropriate information and assistance for ongoing user activities.

[1076] "Product recommendation" is the process of suggesting appropriate products based on a user's preferences and profile information.

[1077] A "virtual store" is a virtual store that operates on the Internet, where users can browse and purchase products.

[1078] "Physical store" means a physical store where users can view and purchase products on-site.

[1079] "Integrated management" is the process of centrally managing inventory information and sales data from virtual and physical stores.

[1080] The present invention provides a system for individuals to use a generated avatar to recommend products and plan travel itineraries, and engage in self-improvement and solo activities. The system includes a user terminal, a server, a generative AI model, a natural language processing module, and a product recommendation module.

[1081] Use of user devices

[1082] First, a user enters their profile information using a user terminal. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. This information is then sent from the terminal to the server.

[1083] Avatar generation

[1084] The server uses a generative AI model based on the received profile information to generate an optimal avatar for each individual user, which is then sent back to the user's device and displayed on the screen.

[1085] Communicating with avatars

[1086] To interact with the generated avatar, the user opens a chat screen on their device. The message entered by the user is sent to the server, where a natural language processing module analyzes it and generates an appropriate response. This response is then sent back to the user's device and displayed on the chat screen.

[1087] Product recommendation

[1088] Users can enjoy shopping in a virtual store with their avatar. Based on the user's preferences and history data, the avatar recommends suitable products. The product recommendation module manages this process, and the recommended product information is displayed on the user's device.

[1089] Integrated management of virtual and physical stores

[1090] The server provides a function for centrally managing inventory information and sales data for both physical and virtual stores. This allows users to browse and purchase products in the virtual store through their avatars. Recommended products and inventory status are updated in real time.

[1091] Hardware and Software Configuration

[1092] Hardware: Smartphones, smart glasses, head-mounted displays. These devices provide the interface through which users interact with their avatars.

[1093] Software: Generative AI models (e.g., using TensorFlow, PyTorch), natural language processing modules (e.g., BERT, GPT-3), product recommendation modules, and communication APIs (e.g., RESTful APIs).

[1094] Description and examples

[1095] The server includes a means for receiving personal profile information and generating an avatar using a generative model, a means for recommending products based on the user's preferences using the avatar, a means for displaying information about the recommended products on the user's terminal, and a means for integrated management of the real store and the virtual store. This allows users to engage in self-improvement and solo activities with peace of mind, and further improves convenience through product recommendations tailored to individual preferences and integrated management of the virtual store and the real store.

[1096] As a concrete example, if a user launches an application on their smartphone and asks an avatar, "Tell me what sneakers you recommend," the avatar will refer to their past purchase history and current trend information and respond, "These new sneakers are popular."

[1097] Prompt Sentence Examples

[1098] "Male, 28 years old. I recently purchased athletic sneakers. I'd like some recommendations for new sneakers suitable for my upcoming training."

[1099] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1100] Step 1:

[1101] The user enters profile information. Personal information such as age, gender, interests, hobbies, and special skills is entered on the user's device and sent to the server.

[1102] Input: Personal information such as age, gender, interests, hobbies, and special skills

[1103] Output: Send profile information to server

[1104] Specific behavior: A user launches the application, enters profile information into a form, and clicks the submit button to send the information to the server.

[1105] Step 2:

[1106] The server generates an avatar using a generative AI model based on the received profile information, and sends the generated avatar information back to the user's device and displays it on the screen.

[1107] Input: Profile information

[1108] Output: Generated avatar data

[1109] Specific operation: The server inputs the received profile information into the generation AI model to generate an avatar, then sends the generated avatar data to the user's device and displays it on the device.

[1110] Step 3:

[1111] To interact with an avatar, a user opens a chat screen and enters a message. The message is sent from the user's device to the server, where a natural language processing module analyzes the message and generates an appropriate response. The generated response is then sent back to the user's device and displayed on the screen.

[1112] Input: User message

[1113] Output: The generated response

[1114] Specific operation: The user opens the chat screen, enters a text message, and presses the send button. The server analyzes the received message using a natural language processing module, generates a response from the avatar, and sends it back to the user's device.

[1115] Step 4:

[1116] The user requests a product recommendation from the avatar. Based on the user's preferences and history data, the product recommendation module selects appropriate products and sends the recommended product information to the user's device.

[1117] Input: User preferences and historical data

[1118] Output: Recommended product information

[1119] Specific operation: The user asks the avatar, "Please recommend me some products." The server uses the product recommendation module to select appropriate products based on the user's past purchase history and preferences, and sends that information to the user's device.

[1120] Step 5:

[1121] The server manages the virtual store and the physical store in an integrated manner, providing real-time inventory information and sales data from the physical store to users' devices, allowing them to make purchasing decisions based on this information.

[1122] Input: Inventory information and sales data for physical and virtual stores

[1123] Output: Integrated inventory information and sales data

[1124] Specific operation: The server manages inventory and sales data from both the virtual and physical stores, and keeps the data up to date. When a user selects a product they wish to purchase, the server provides current inventory information and assists in the purchasing process.

[1125] Step 6:

[1126] The server provides real-time support, instantly responding with relevant information in response to ongoing user activity, such as a user requesting "directions from my current location to the nearest store."

[1127] Input: User's current ongoing activity information and requests

[1128] Output: Appropriate real-time support information

[1129] Specific operation: When a user asks the avatar, "Tell me the way to the nearest store," the server calculates the optimal route based on the current location information and route data, and sends that information back to the user's device.

[1130] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1131] The present invention relates to a system for enabling individuals to plan, improve themselves, and engage in solo activities with generated avatars, including a user terminal, a server, a generative model, a natural language processing module, an emotion engine, and a travel plan generation module.

[1132] Avatar generation

[1133] A user first uses a user device to enter their profile information. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user's device and presented to the user.

[1134] Avatar communication and emotion recognition

[1135] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server, which uses a natural language processing module to analyze the user's message and generate an appropriate response.

[1136] Furthermore, the server utilizes an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's input message and facial expression data acquired from the facial recognition camera. Based on the analysis results, the avatar's response is tailored to the user's emotions. For example, if the user is feeling stressed, the avatar can select a comforting response.

[1137] Generate a travel plan

[1138] Users can create travel plans together with their avatars. The user inputs their desired travel destinations and activities and sends this information from the user's device to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user's device. The user can review this proposal and make any necessary changes.

[1139] Travel support and emotion recognition

[1140] Users can receive real-time support while traveling. For example, when a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate the optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided.

[1141] Furthermore, the emotion engine can monitor the user's emotional state while traveling and provide appropriate support. For example, if the user becomes lost and feels fear or anxiety, the emotion engine will recognize that emotion and the avatar will provide advice to help them calm down.

[1142] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. In an actual trip, the server provides real-time traffic information, and the emotion engine adjusts the avatar's responses based on the user's emotional state, allowing the user to enjoy solo activities with peace of mind.

[1143] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[1144] The processing flow will be explained below.

[1145] Avatar generation

[1146] Step 1:

[1147] The user opens a screen on the user terminal to input profile information for avatar generation, including age, gender, interests, hobbies, and special skills.

[1148] Step 2:

[1149] The device generates a request to send the entered profile information to the server. The data to be sent is constructed in JSON format and sent via POST to the specified API endpoint on the server.

[1150] Step 3:

[1151] The server analyzes the received profile information and inputs it into a generative model. The profiling module organizes the data and generates an avatar using the generative AI model.

[1152] Step 4:

[1153] The server returns the generated avatar data to the device, generating a JSON response containing the avatar image, attribute information, and other related data.

[1154] Step 5:

[1155] The device displays the avatar information received from the server to the user, showing the avatar's image and attribute information on the screen and providing customization options as needed.

[1156] Step 6:

[1157] The user checks the presented avatar, and if he / she wishes to customize it, he / she sends the information to the server again to update the avatar.

[1158] Avatar communication and emotion recognition

[1159] Step 1:

[1160] The user opens a chat screen to interact with the avatar and enters a message such as "Hello."

[1161] Step 2:

[1162] The terminal generates a request to send the user's message to the server by sending a POST request containing the message data to the server.

[1163] Step 3:

[1164] The server passes the received message to a natural language processing module for analysis. The NLP (natural language processing) module analyzes the intent and content of the message and generates an appropriate response.

[1165] Step 4:

[1166] The server sends the generated response to the terminal. It generates a JSON response containing the response message and sends it to the user's terminal.

[1167] Step 5:

[1168] The device will display the response message received from the server, which will be displayed on the chat screen as a message from the avatar.

[1169] Step 6:

[1170] The user sees the avatar's response and continues the dialogue if desired, and the cycle repeats each time the user types a new message.

[1171] Step 7:

[1172] The server passes the user's input message and facial expression data from a face recognition camera installed on the user's device to the emotion engine for analysis, which determines the user's emotional state.

[1173] Step 8:

[1174] The server adjusts the avatar's responses based on the emotion engine's analysis, for example generating a comforting response if the user is feeling stressed.

[1175] Generate a travel plan

[1176] Step 1:

[1177] The user enters the travel plan creation mode and inputs the places they want to go and the activities they want to do. For example, they input their wish to "watch a sporting event in Tokyo."

[1178] Step 2:

[1179] The device generates a request to send the user's input to the server. It constructs JSON data containing the desired content and sends a POST request to the server.

[1180] Step 3:

[1181] The server analyzes the user's request and retrieves relevant travel information from the database. It also executes a database query to retrieve information about sporting events taking place in Tokyo.

[1182] Step 4:

[1183] The server generates a travel plan based on the acquired information. The travel plan generation module creates a travel plan including dates, locations, means of transportation, etc.

[1184] Step 5:

[1185] The server sends the generated travel plan to the device. It also generates a JSON response containing the plan details and sends it to the user's device.

[1186] Step 6:

[1187] The terminal displays the travel plan received from the server to the user, showing the plan details on the screen and providing options to modify it if necessary.

[1188] Step 7:

[1189] The user reviews the proposed itinerary and modifies it as necessary. If the user makes any changes, the information is sent back to the server, and the itinerary is updated.

[1190] Travel support and emotion recognition

[1191] Step 1:

[1192] The user enters a mode for receiving support during the actual trip, entering a request such as "Please tell me how to get to today's game" before leaving.

[1193] Step 2:

[1194] The device generates a request to send the user's request to the server, constructs a JSON containing the request data, and sends a POST request to the server.

[1195] Step 3:

[1196] The server analyzes the current traffic conditions in real time and generates an optimal route by querying traffic information APIs and map data.

[1197] Step 4:

[1198] The server sends the generated travel route and advice to the device, and generates a JSON response containing transportation instructions and sends it to the user's device.

[1199] Step 5:

[1200] The device displays the route information received from the server to the user, along with avatar messages about the route and important points to note.

[1201] Step 6:

[1202] The user then takes action based on the provided information, travels to the destination using the route provided, and enjoys the trip.

[1203] Step 7:

[1204] The server monitors the user's emotional state during the trip and analyzes it using an emotion engine in a timely manner. If the user feels anxious or stressed, the server provides appropriate comfort and advice through the avatar.

[1205] Step 8:

[1206] The device displays responses and advice sent from the server to the user in real time, providing support so that the user can continue their activities with peace of mind.

[1207] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. In an actual trip, the server provides real-time traffic information, and the emotion engine adjusts the avatar's responses based on the user's emotional state, allowing the user to enjoy solo activities with peace of mind.

[1208] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[1209] Example 2

[1210] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1211] In modern society, it is important for individuals to enjoy solo activities while engaging in activities that match their interests and hobbies, while also improving themselves. However, traditional planning and information gathering can be time-consuming and laborious, and solo activities can sometimes be accompanied by feelings of loneliness and anxiety. Therefore, there is a growing need for a system that automatically provides optimal support to individual users, allowing them to plan and engage in activities with peace of mind.

[1212] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1213] In this invention, the server includes means for receiving profile information and generating an avatar using a generation AI model, means having a natural language processing module for analyzing dialogue for communicating with the avatar, and means having a travel plan generation module for generating a travel plan based on the user's wishes. This allows the user to communicate with the optimal avatar based on their profile information, efficiently plan activities according to their wishes, and enjoy safe and enjoyable solo activities.

[1214] A "user terminal" is a communication device operated by an individual, and is a device for inputting and displaying information.

[1215] A "server" is a central control device that receives information sent from user terminals, performs various processes, and then sends the information.

[1216] A "generative AI model" is an artificial intelligence algorithm that generates the optimal avatar based on a user's profile information.

[1217] A "natural language processing module" is a technology for analyzing a user's text message and generating an appropriate response.

[1218] An "emotion recognition engine" is a device that analyzes a user's message and facial expression data to recognize the user's emotional state and adjust the response.

[1219] The "travel plan generation module" is a function that automatically generates an appropriate travel plan based on the user's wishes.

[1220] "Profile information" is personal data such as the user's age, gender, interests, hobbies, and special skills.

[1221] An "avatar" is a virtual character that is generated based on a user's profile information and that communicates with the user.

[1222] "Real-time support" is a function that responds immediately to user requests and provides appropriate information and assistance in situations such as while traveling.

[1223] The present invention relates to a system for enabling individuals to plan, develop, and engage in solo activities with a generated avatar, including a user terminal, a server, a generative AI model, a natural language processing module, an emotion recognition engine, and a travel plan generation module.

[1224] A user first uses a user device to enter their profile information. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative AI model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user's device and presented to the user.

[1225] The user opens a chat screen to interact with the generated avatar. The message entered by the user is sent from the user's device to the server. The server utilizes a natural language processing module to analyze the user's message and generate an appropriate response. The server then utilizes an emotion recognition engine to recognize the user's emotions. The emotion recognition engine analyzes the message entered by the user and facial expression data acquired from the facial recognition camera. Based on the analysis results, the avatar's response is adjusted to match the user's emotions. For example, if the user is feeling stressed, the avatar can select a comforting response.

[1226] Users can also create travel plans together with their avatars by inputting their desired travel destinations and activities. The user inputs the desired travel destinations and activities and sends them from the user terminal to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user terminal. The user can review the proposal and make any necessary changes.

[1227] Users can receive real-time support while traveling. For example, if a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate an optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided. Furthermore, the user's emotional state can be monitored during the trip, and the emotion recognition engine can provide appropriate support. For example, if a user becomes lost and feels fear or anxiety, the emotion recognition engine will recognize that emotion and the avatar will provide advice to help them calm down.

[1228] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. During an actual trip, the server provides real-time traffic information, and an emotion recognition engine adjusts the avatar's responses based on the user's emotional state, allowing the user to enjoy solo activities with peace of mind.

[1229] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[1230] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1231] Step 1:

[1232] The user enters profile information.

[1233] Input: The user inputs information such as age, gender, interests, hobbies, and special skills into the user terminal.

[1234] Data processing: The terminal formats the input data and sends it to the server.

[1235] Output: The profile information is sent to the server.

[1236] Specific operation: The user enters "28 years old, male, hobby is watching sports" and presses the send button.

[1237] Step 2:

[1238] The server generates the avatar.

[1239] Input: The server receives the profile information sent from the user terminal.

[1240] Data calculation: A generative AI model analyzes profile information and generates an avatar.

[1241] Output: The generated avatar data is sent to the server.

[1242] Specific operation: The server provides the generated AI model with information such as "28 years old, male, hobby is watching sports" and generates an avatar.

[1243] Step 3:

[1244] The server transmits the avatar information to the user terminal.

[1245] Input: Avatar data generated on the server.

[1246] Data processing: The server formats the avatar information and sends it to the user's device.

[1247] Output: Avatar information arrives on the user's device.

[1248] Specific operation: The server sends the generated avatar data in JSON format to the user device.

[1249] Step 4:

[1250] The user starts chatting with the avatar.

[1251] Input: The user types a chat message and presses the send button.

[1252] Data processing: The terminal sends the message data to the server.

[1253] Output: The user's message is sent to the server.

[1254] Specific operation: The user types "Hello" into the chat screen and presses the send button.

[1255] Step 5:

[1256] The server parses the message.

[1257] Input: User's message data to the server.

[1258] Data Computation: A natural language processing module analyzes the message and generates an appropriate response.

[1259] Output: Parsed results and response data are provided to the server.

[1260] Specific operation: The server passes the message "hello" to the natural language processing module, which parses it as a "greeting" and generates a response.

[1261] Step 6:

[1262] The server sends a response to the user terminal.

[1263] Input: Parsed results and response data to the server.

[1264] Data processing: The server formats the response data and sends it to the user terminal.

[1265] Output: A response message arrives at the user terminal.

[1266] Specific operation: The server sends the generated response "Hello! How are you today?" to the user terminal.

[1267] Step 7:

[1268] Emotion recognition on the server.

[1269] Input: User message data and facial expression data.

[1270] Data Calculation: An emotion recognition engine analyzes the message and facial expression data to determine the user's emotional state.

[1271] Output: The emotion recognition results are provided to the server.

[1272] Specific operation: The server analyzes messages such as "I'm not feeling very well today" and facial expression data from the camera using an emotion recognition engine.

[1273] Step 8:

[1274] The server coordinates the avatar's response.

[1275] Input: Emotion recognition results and response data.

[1276] Data processing: The server adjusts the response data based on the emotion recognition results.

[1277] Output: A tailored response message is generated.

[1278] What happens: The server generates a response based on the results of the emotion recognition engine: "You seem to be in a bad mood today. Is there anything I can help you with?"

[1279] Step 9:

[1280] The user inputs the travel destination and activity.

[1281] Input: The user inputs the desired travel destination and activity into the user terminal.

[1282] Data processing: The terminal sends the input data to the server.

[1283] Output: Travel destination and activity information is sent to the server.

[1284] Specific actions: The user enters "I want to watch a sporting event in Tokyo" and presses the send button.

[1285] Step 10:

[1286] The server generates the itinerary.

[1287] Input: Your desired travel destination and activity information sent to the server.

[1288] Data calculation: The travel plan generation module generates a travel plan based on the user's wishes.

[1289] Output: The generated itinerary is provided to the server.

[1290] Specific operation: The server uses the travel plan generation module to generate a travel plan such as "Watching a baseball game at Tokyo Dome, this weekend's plan."

[1291] Step 11:

[1292] The server transmits the travel plan to the user terminal.

[1293] Input: A server-generated itinerary.

[1294] Data processing: The server formats the travel plan and sends it to the user's terminal.

[1295] Output: The travel plan is delivered to the user's device.

[1296] Specific operation: The server sends the generated travel plan in JSON format to the user terminal.

[1297] Step 12:

[1298] Respond to requests during your trip.

[1299] Input: Users input support requests in real time.

[1300] Data processing: The terminal sends the request data to the server.

[1301] Output: The request is sent to the server.

[1302] Specific operation: The user types "Please tell me how to get to today's game" and submits it.

[1303] Step 13:

[1304] The server provides the appropriate information.

[1305] Input: The request data sent to the server.

[1306] Data calculation: The server references the traffic information API and generates optimal route information.

[1307] Output: The generated route information is sent to the user terminal.

[1308] Specific operation: The server uses the traffic information API to generate a "route from the nearest station to Tokyo Dome" and sends it to the user's device.

[1309] Step 14:

[1310] The server identifies the emotional state during the trip and tailors the response.

[1311] Input: User message data and facial expression data.

[1312] Data Calculation: An emotion recognition engine analyzes the message and facial expression data to determine the user's emotional state.

[1313] Output: Based on the emotion recognition results, a tailored response message is generated.

[1314] Specific behavior: The server uses an emotion recognition engine to provide advice such as "If you're lost and worried, maybe it would be a good idea to take a break at a nearby cafe" if the user feels fear or anxiety.

[1315] (Application example 2)

[1316] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1317] There is a need for systems that provide product recommendations and appropriate real-time support based on personal hobbies and interests through individually customized avatars. In particular, there is a need for methods that can reduce stress and anxiety users feel while shopping by analyzing the user's emotional state and providing appropriate responses. However, existing systems have limited functionality for generating avatars based on user profile information and are inferior in real-time support and emotion recognition, which leaves the user experience unsatisfactory.

[1318] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving personal profile information and generating an avatar using a generative model, means for suggesting products based on the user's interests and hobbies, and an emotion engine for analyzing the user's emotional state and adjusting appropriate responses. This enables users to receive personalized product information and enjoy real-time support through their individually customized avatars, thereby reducing stress and anxiety while shopping.

[1319] A "user terminal" is a device that allows an individual to enter profile information and communicate with an avatar.

[1320] "Profile information" is personal information such as the user's age, gender, interests, hobbies, and special skills.

[1321] The "server" is a central processing unit that processes information received from user terminals, generates avatars, analyzes dialogue and emotional states, suggests products, and provides real-time support.

[1322] A "generative model" is an algorithm for generating the optimal avatar based on a user's profile information.

[1323] An "avatar" is a virtual character that is generated based on the user's profile information and is used to communicate with the user.

[1324] "Communication" refers to conversations and message exchanges between a user and an avatar.

[1325] A "dialogue analysis server" is a server that analyzes messages entered by users and generates appropriate responses.

[1326] The "means for suggesting products" is an algorithm that suggests appropriate products based on the user's interests and hobbies.

[1327] The "emotion engine" is an engine that analyzes the user's emotional state from their messages and facial expressions and adjusts the avatar's response.

[1328] A "means for providing real-time support" is a system for providing immediate responses to user questions and requests.

[1329] The present invention provides a system for enabling individuals to shop with a generated avatar and receive appropriate support according to their emotional state. The system includes a user terminal, a server, a generative model, a natural language processing module, an emotion engine, and a product suggestion module.

[1330] 1. Enter your user profile

[1331] Users use smart glasses or smartphones to enter their profile information, which includes age, gender, interests, hobbies, special skills, etc. The entered information is then sent from the user terminal to the server.

[1332] 2. Avatar generation

[1333] The server uses a generative model based on the received profile information to generate an avatar that best suits the individual user. This avatar is then sent back to the user's device and displayed. For example, if a user is a 28-year-old woman who is interested in fashion, a personalized avatar will be generated based on that information.

[1334] 3. Avatar communication and emotion recognition

[1335] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server, which uses a natural language processing module to analyze the user's messages and generate appropriate responses.

[1336] Additionally, the system uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes messages typed by the user and facial expression data captured by the smart glasses' camera. Based on the analysis results, the avatar's response is adjusted. For example, if the user is feeling stressed, the avatar will make suggestions to help them relax.

[1337] 4. Product proposal

[1338] Based on the user's profile information and interests and hobbies derived from past interactions, the server uses a product suggestion module to suggest personalized products. For example, if a user says, "I'm looking for fashion items," the avatar will suggest fashion items that are appropriate for the season.

[1339] 5. Real-time support

[1340] While shopping, users can receive real-time support from the server. When a user types "Tell me about this product," the message is sent to the server. The server references the database, retrieves the appropriate product information, and returns it to the user. This information is displayed as an avatar message, allowing the user to make a purchasing decision based on the information provided.

[1341] For example, if a 28-year-old woman asks the avatar, "What do you recommend today?", the server will suggest appropriate fashion items based on the user's profile information. If the user is feeling stressed, the avatar will also suggest products that will help them relax.

[1342] Prompt Sentence Examples

[1343] User: "I'm a 28-year-old woman interested in fashion. Can you recommend some summer outfits?"

[1344] Model: "I'll suggest some fashion items. Let's start with avatar generation."

[1345] As described above, this system provides an environment where users can enjoy shopping with individually customized avatars and receive appropriate real-time support while reducing stress.

[1346] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1347] Step 1:

[1348] The user terminal inputs personal profile information (age, gender, interests, hobbies, special skills, etc.) and sends it to the server. This input information also includes the user's preferences and purchase list. The server receives this information.

[1349] Step 2:

[1350] The server uses a generative model based on the received profile information to generate the optimal avatar. Specifically, it compares the profile information with a database and selects and generates an appropriate avatar. The input to this process is the user's profile information, and the output is the generated avatar information.

[1351] Step 3:

[1352] The server returns information about the generated avatar to the user terminal, which then displays the avatar to the user. The user then checks the displayed avatar and begins a dialogue.

[1353] Step 4:

[1354] The user interacts with the generated avatar through a chat screen. Messages entered by the user are sent from the user's device to the server. This message is the input for processing, and the server analyzes the message using a natural language processing module to generate an appropriate response. The analysis results are output and sent back to the user's device.

[1355] Step 5:

[1356] The server simultaneously uses an emotion engine to analyze the user's input message and facial expression data to recognize the user's emotional state. The input of this process is the message and facial expression data, and the output is the analysis result of the emotional state. The avatar's response is adjusted according to the emotional state.

[1357] Step 6:

[1358] When a user requests an avatar to "search for fashion items," the server uses a product suggestion module based on profile information and past interaction data to suggest personalized products. The input information is the request and profile information, and the output is a list of suggested products.

[1359] Step 7:

[1360] When a user inputs a question about a product (e.g., "Tell me about this product"), the server immediately references the database and retrieves related product information. The input is the question, and the output is product information. The server returns the retrieved information to the user's device as an avatar message. The user makes a purchasing decision based on the information provided.

[1361] Step 8:

[1362] To support the user during their trip, the server monitors the user's emotional state in real time, and the avatar provides comforting messages and information as needed. The input of this process is the user's real-time messages and emotional data, and the output is a tailored response.

[1363] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1364] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1365] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1366] [Fourth embodiment]

[1367] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1368] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1369] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1370] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1371] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1372] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1373] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1374] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1375] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1376] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1377] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1378] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1379] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1380] The present invention relates to a system for enabling individuals to plan, improve themselves, and engage in solo activities with generated avatars, including a user terminal, a server, a generative model, a natural language processing module, and a travel plan generation module.

[1381] Avatar generation

[1382] A user first uses a user device to enter their profile information. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user's device and presented to the user.

[1383] Communicating with avatars

[1384] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server. The server uses a natural language processing module to analyze the user's message and generate an appropriate response. This response is then sent back to the user's device and displayed.

[1385] Generate a travel plan

[1386] Users can create travel plans together with their avatars. The user inputs their desired travel destinations and activities and sends this information from the user's device to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user's device. The user can review this proposal and make any necessary changes.

[1387] Travel support

[1388] Users can receive real-time support while traveling. For example, when a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate the optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided.

[1389] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. During an actual trip, the server provides real-time traffic information, allowing the user to enjoy solo activities with peace of mind.

[1390] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[1391] The processing flow will be explained below.

[1392] Avatar generation

[1393] Step 1:

[1394] The user opens a screen on the user terminal to input profile information for avatar generation, including age, gender, interests, hobbies, and special skills.

[1395] Step 2:

[1396] The device generates a request to send the entered profile information to the server. The data to be sent is constructed in JSON format and sent via POST to the specified API endpoint on the server.

[1397] Step 3:

[1398] The server analyzes the received profile information and inputs it into a generative model. The profiling module organizes the data and generates an avatar using the generative AI model.

[1399] Step 4:

[1400] The server returns the generated avatar data to the device, generating a JSON response containing the avatar image, attribute information, and other related data.

[1401] Step 5:

[1402] The device displays the avatar information received from the server to the user, showing the avatar's image and attribute information on the screen and providing customization options as needed.

[1403] Step 6:

[1404] The user checks the presented avatar, and if he / she wishes to customize it, he / she sends the information to the server again to update the avatar.

[1405] Communicating with avatars

[1406] Step 1:

[1407] The user opens a chat screen to interact with the avatar and enters a message such as "Hello."

[1408] Step 2:

[1409] The terminal generates a request to send the user's message to the server by sending a POST request containing the message data to the server.

[1410] Step 3:

[1411] The server passes the received message to a natural language processing module for analysis. The NLP (natural language processing) module analyzes the intent and content of the message and generates an appropriate response.

[1412] Step 4:

[1413] The server sends the generated response to the terminal. It generates a JSON response containing the response message and sends it to the user's terminal.

[1414] Step 5:

[1415] The device will display the response message received from the server, which will be displayed on the chat screen as a message from the avatar.

[1416] Step 6:

[1417] The user sees the avatar's response and continues the dialogue if desired, and the cycle repeats each time the user types a new message.

[1418] Generate a travel plan

[1419] Step 1:

[1420] The user enters the travel plan creation mode and inputs the places they want to go and the activities they want to do. For example, they input their wish to "watch a sporting event in Tokyo."

[1421] Step 2:

[1422] The device generates a request to send the user's input to the server. It constructs JSON data containing the desired content and sends a POST request to the server.

[1423] Step 3:

[1424] The server analyzes the user's request and retrieves relevant travel information from the database. It also executes a database query to retrieve information about sporting events taking place in Tokyo.

[1425] Step 4:

[1426] The server generates a travel plan based on the acquired information. The travel plan generation module creates a travel plan including dates, locations, means of transportation, etc.

[1427] Step 5:

[1428] The server sends the generated travel plan to the device. It also generates a JSON response containing the plan details and sends it to the user's device.

[1429] Step 6:

[1430] The terminal displays the travel plan received from the server to the user, showing the plan details on the screen and providing options to modify it if necessary.

[1431] Step 7:

[1432] The user reviews the proposed itinerary and modifies it as necessary. If the user makes any changes, the information is sent back to the server, and the itinerary is updated.

[1433] Travel support

[1434] Step 1:

[1435] The user enters a mode for receiving support during the actual trip, entering a request such as "Please tell me how to get to today's game" before leaving.

[1436] Step 2:

[1437] The device generates a request to send the user's request to the server, constructs a JSON containing the request data, and sends a POST request to the server.

[1438] Step 3:

[1439] The server analyzes the current traffic conditions in real time and generates an optimal route by querying traffic information APIs and map data.

[1440] Step 4:

[1441] The server sends the generated travel route and advice to the device, and generates a JSON response containing transportation instructions and sends it to the user's device.

[1442] Step 5:

[1443] The device displays the route information received from the server to the user, along with avatar messages about the route and important points to note.

[1444] Step 6:

[1445] The user then takes action based on the provided information, travels to the destination using the route provided, and enjoys the trip.

[1446] Example 1

[1447] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1448] In recent years, there has been a demand for tools that allow individuals to engage in self-improvement and solo activities without feeling lonely, but existing systems lack sufficient support. Specifically, they lack comprehensive support to alleviate the anxiety and complex planning that users may experience when working alone. To address this, it is necessary to provide a customizable support system that meets the individual needs of each user.

[1449] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1450] In this invention, the server includes a processing means for receiving personal profile information and generating an avatar using a generative model, a means for returning and displaying information about the generated avatar to a user terminal, a natural language processing means for analyzing user messages to communicate with the avatar, a travel plan generation means for generating a travel plan based on the user's wishes, a means for transmitting the generated travel plan to the user terminal, and a means for providing real-time support during the trip, thereby enabling users to make plans with avatars tailored to their individual needs and to engage in self-improvement and solo activities efficiently and with peace of mind.

[1451] A "user terminal" is a device that allows a user to input information and check the generated avatar and travel plan.

[1452] "Profile information" is information that identifies an individual, such as the user's age, gender, interests, hobbies, and special skills.

[1453] A "generative model" is an artificial intelligence model that generates an avatar based on input profile information.

[1454] An "avatar" is a virtual character that is generated based on a user's profile information.

[1455] "Means" is a general expression that refers to a device or module for realizing a specific function.

[1456] The "natural language processing means" is a module for analyzing messages from users during communication and generating appropriate responses.

[1457] The "travel plan generation means" is a module for planning travel destinations and activities based on the user's wishes.

[1458] The "real-time support means" is a module for providing information and guidance to users immediately while they are traveling.

[1459] "Server" refers to a device that processes, generates, analyzes, and transmits and receives data.

[1460] The present invention relates to a system for supporting individuals in making plans with generated avatars, for self-improvement, and for solo activities, and includes a user terminal, a server, a generative model, a natural language processing module, and a travel plan generation module.

[1461] Avatar generation

[1462] First, a user enters their profile information using a user device. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user device and presented to the user.

[1463] As a specific example, if the user is a 28-year-old male whose hobby is watching sports, when this information is input, the server generates an avatar of a character who is a 28-year-old male who likes watching sports.

[1464] Communicating with avatars

[1465] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server. The server uses a natural language processing module to analyze the user's message and generate an appropriate response. This response is then sent back to the user's device and displayed.

[1466] As a concrete example, when a user sends a message to an avatar saying "Hello, let's decide where to travel," the server generates a response saying "Where do you want to go?" which is sent back to the user terminal.

[1467] Generate a travel plan

[1468] Users can create travel plans together with their avatars. The user inputs their desired travel destinations and activities and sends this information from the user's device to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user's device. The user can review this proposal and make any necessary changes.

[1469] As a specific example, if a user inputs "I want to watch a sporting event in Tokyo," the server will generate an appropriate travel plan and suggest it to the user.

[1470] Travel support

[1471] Users can receive real-time support while traveling. For example, when a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate the optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided.

[1472] As a concrete example, when a user requests, "How do I get to today's game?", the server generates the optimal route and provides it to the user.

[1473] The system uses a generative AI model to generate an avatar based on the user's profile information, and supports communication between the user and the avatar through natural language processing using prompt sentences. It also uses a travel plan generation module to provide travel plans based on the user's preferences and provides real-time travel support, allowing users to enjoy solo activities with peace of mind.

[1474] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1475] Step 1:

[1476] The user uses the user terminal to input their profile information (age, gender, interests, hobbies, special skills, etc.). The input information is specific information such as age: 28, gender: male, hobby: watching sports, etc.

[1477] Step 2:

[1478] The device sends the entered profile information to the server. Specifically, the device sends the profile information to the server in JSON format using an HTTPS POST request. The input of this request is the profile information entered by the user, and the output is the information sent to the server.

[1479] Step 3:

[1480] The server generates an avatar using a generative AI model based on the received profile information. Specifically, the server inputs the profile information into the generative AI model and processes the data to generate the avatar. The input is the profile information, and the output is the generated avatar information.

[1481] Step 4:

[1482] The server returns the generated avatar information to the user device and presents it. Specifically, the server returns the avatar information to the user device in JSON format, and the device displays it. The input is the generated avatar information, and the output is transmission to the user device and display.

[1483] Step 5:

[1484] The user opens a chat screen to interact with the generated avatar and inputs a message. Specifically, the user inputs a message such as "Hello, let's decide on a travel destination," and presses the "Send" button. The input is the user's message.

[1485] Step 6:

[1486] The user terminal sends the message entered by the user to the server. Specifically, the terminal sends an HTTPS POST request to the server and sends the user's message in JSON format. The input is the user's message, and the output is what is sent to the server.

[1487] Step 7:

[1488] The server analyzes the received message using a natural language processing module. Specifically, the server analyzes the message using an NLP library and extracts the user's intent. The input is the user's message, and the output is the analysis result.

[1489] Step 8:

[1490] The server generates an appropriate response based on the analysis results and sends it back to the user device. Specifically, the server generates a response using a generative AI model and sends it to the user device in JSON format. The input is the analysis results, and the output is the generated response.

[1491] Step 9:

[1492] The user terminal receives the response from the server and displays it on the chat screen. Specifically, the terminal displays the response message and presents it to the user. The input is the response message from the server, and the output is the display on the terminal.

[1493] Step 10:

[1494] The user inputs their desired travel destinations and activities into the avatar and requests the creation of a travel plan. Specifically, the user inputs "I want to watch a sporting event in Tokyo" and presses the "Submit" button. The input is the user's travel preferences.

[1495] Step 11:

[1496] The terminal sends the user's travel wishes to the server. Specifically, the terminal sends an HTTPS POST request and sends the travel wishes to the server in JSON format. The input is the user's travel wishes, and the output is what is sent to the server.

[1497] Step 12:

[1498] The server uses the travel plan generation module to create a travel plan based on the user's preferences. Specifically, the server plans travel destinations and activities based on the user's preferences and processes the information. The input is the travel preferences, and the output is the generated travel plan.

[1499] Step 13:

[1500] The server sends the generated travel plan to the user's device. Specifically, the server returns the travel plan to the user's device in JSON format and proposes it to the user. The input is the generated travel plan, and the output is the transmission to the user's device.

[1501] Step 14:

[1502] The user checks the generated travel plan and modifies it if necessary. Specifically, the user checks the plan and re-enters it if any modifications are necessary. The input is the modified travel plan, and the output is resubmission.

[1503] Step 15:

[1504] While traveling, the user inputs a request for real-time support. Specifically, the user inputs "Please tell me how to get to today's game" into the terminal and presses the "Send" button. The input is a support request.

[1505] Step 16:

[1506] The device sends the user's support request to the server. Specifically, the device sends an HTTPS POST request and sends the request to the server in JSON format. The input is the support request, and the output is the transmission to the server.

[1507] Step 17:

[1508] The server generates optimal routes and information by referencing traffic information APIs and other databases. Specifically, the server calls external APIs to calculate traffic information and routes. The inputs are support requests and traffic information data, and the output is optimal route information.

[1509] Step 18:

[1510] The server sends the generated support information to the user's device. Specifically, the server returns the optimal route information to the user's device in JSON format. The input is the optimal route information, and the output is the information sent to the device.

[1511] Step 19:

[1512] The device displays support information to the user as an avatar message. Specifically, the device displays optimal route information on the chat screen and presents it to the user. The input is support information, and the output is the display on the device.

[1513] (Application example 1)

[1514] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1515] Previous systems supporting self-improvement and solo activities have not been able to fully alleviate the anxiety and loneliness that users feel when engaging in activities alone. Furthermore, they lacked product recommendations tailored to each user's individual interests and preferences, nor did they offer integrated management of virtual and physical stores. As a result, the user experience did not improve, leading to problems of low user satisfaction. In particular, the lack of purchasing assistance and real-time support in the virtual environment meant that user convenience was not fully realized.

[1516] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1517] In this invention, the server includes means for receiving personal profile information and generating an avatar using a generative model, means for recommending products based on the user's preferences using the avatar, means for displaying information about the recommended products on the user's terminal, and means for integrated management of the real store and the virtual store. This allows users to engage in self-improvement and solo activities with peace of mind, and further improves convenience through product recommendations tailored to individual preferences and integrated management of the virtual store and the real store.

[1518] A "user terminal" is a device that allows an individual to input profile information, interact with an avatar, and display recommended product information.

[1519] A "server" is a device or system that generates an avatar based on profile information sent by a user and performs processes such as dialogue analysis using natural language processing and travel plan generation.

[1520] A "generative model" is an algorithm or data model used to generate an avatar based on a user's profile information.

[1521] An "avatar" is a virtual character generated based on an individual's profile information, and assists the user in conversations and product recommendations.

[1522] "Dialogue analysis" is the process of analyzing messages entered by users and generating appropriate responses.

[1523] A "travel plan" is a detailed plan or proposal for a trip that is generated based on the user's wishes.

[1524] "Real-time support" is a function that aims to provide immediate and appropriate information and assistance for ongoing user activities.

[1525] "Product recommendation" is the process of suggesting appropriate products based on a user's preferences and profile information.

[1526] A "virtual store" is a virtual store that operates on the Internet, where users can browse and purchase products.

[1527] "Physical store" means a physical store where users can view and purchase products on-site.

[1528] "Integrated management" is the process of centrally managing inventory information and sales data from virtual and physical stores.

[1529] The present invention provides a system for individuals to use a generated avatar to recommend products and plan travel itineraries, and engage in self-improvement and solo activities. The system includes a user terminal, a server, a generative AI model, a natural language processing module, and a product recommendation module.

[1530] Use of user devices

[1531] First, a user enters their profile information using a user terminal. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. This information is then sent from the terminal to the server.

[1532] Avatar generation

[1533] The server uses a generative AI model based on the received profile information to generate an optimal avatar for each individual user, which is then sent back to the user's device and displayed on the screen.

[1534] Communicating with avatars

[1535] To interact with the generated avatar, the user opens a chat screen on their device. The message entered by the user is sent to the server, where a natural language processing module analyzes it and generates an appropriate response. This response is then sent back to the user's device and displayed on the chat screen.

[1536] Product recommendation

[1537] Users can enjoy shopping in a virtual store with their avatar. Based on the user's preferences and history data, the avatar recommends suitable products. The product recommendation module manages this process, and the recommended product information is displayed on the user's device.

[1538] Integrated management of virtual and physical stores

[1539] The server provides a function for centrally managing inventory information and sales data for both physical and virtual stores. This allows users to browse and purchase products in the virtual store through their avatars. Recommended products and inventory status are updated in real time.

[1540] Hardware and Software Configuration

[1541] Hardware: Smartphones, smart glasses, head-mounted displays. These devices provide the interface through which users interact with their avatars.

[1542] Software: Generative AI models (e.g., using TensorFlow, PyTorch), natural language processing modules (e.g., BERT, GPT-3), product recommendation modules, and communication APIs (e.g., RESTful APIs).

[1543] Description and examples

[1544] The server includes a means for receiving personal profile information and generating an avatar using a generative model, a means for recommending products based on the user's preferences using the avatar, a means for displaying information about the recommended products on the user's terminal, and a means for integrated management of the real store and the virtual store. This allows users to engage in self-improvement and solo activities with peace of mind, and further improves convenience through product recommendations tailored to individual preferences and integrated management of the virtual store and the real store.

[1545] As a concrete example, if a user launches an application on their smartphone and asks an avatar, "Tell me what sneakers you recommend," the avatar will refer to their past purchase history and current trend information and respond, "These new sneakers are popular."

[1546] Prompt Sentence Examples

[1547] "Male, 28 years old. I recently purchased athletic sneakers. I'd like some recommendations for new sneakers suitable for my upcoming training."

[1548] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1549] Step 1:

[1550] The user enters profile information. Personal information such as age, gender, interests, hobbies, and special skills is entered on the user's device and sent to the server.

[1551] Input: Personal information such as age, gender, interests, hobbies, and special skills

[1552] Output: Send profile information to server

[1553] Specific behavior: A user launches the application, enters profile information into a form, and clicks the submit button to send the information to the server.

[1554] Step 2:

[1555] The server generates an avatar using a generative AI model based on the received profile information, and sends the generated avatar information back to the user's device and displays it on the screen.

[1556] Input: Profile information

[1557] Output: Generated avatar data

[1558] Specific operation: The server inputs the received profile information into the generation AI model to generate an avatar, then sends the generated avatar data to the user's device and displays it on the device.

[1559] Step 3:

[1560] To interact with an avatar, a user opens a chat screen and enters a message. The message is sent from the user's device to the server, where a natural language processing module analyzes the message and generates an appropriate response. The generated response is then sent back to the user's device and displayed on the screen.

[1561] Input: User message

[1562] Output: The generated response

[1563] Specific operation: The user opens the chat screen, enters a text message, and presses the send button. The server analyzes the received message using a natural language processing module, generates a response from the avatar, and sends it back to the user's device.

[1564] Step 4:

[1565] The user requests a product recommendation from the avatar. Based on the user's preferences and history data, the product recommendation module selects appropriate products and sends the recommended product information to the user's device.

[1566] Input: User preferences and historical data

[1567] Output: Recommended product information

[1568] Specific operation: The user asks the avatar, "Please recommend me some products." The server uses the product recommendation module to select appropriate products based on the user's past purchase history and preferences, and sends that information to the user's device.

[1569] Step 5:

[1570] The server manages the virtual store and the physical store in an integrated manner, providing real-time inventory information and sales data from the physical store to users' devices, allowing them to make purchasing decisions based on this information.

[1571] Input: Inventory information and sales data for physical and virtual stores

[1572] Output: Integrated inventory information and sales data

[1573] Specific operation: The server manages inventory and sales data from both the virtual and physical stores, and keeps the data up to date. When a user selects a product they wish to purchase, the server provides current inventory information and assists in the purchasing process.

[1574] Step 6:

[1575] The server provides real-time support, instantly responding with relevant information in response to ongoing user activity, such as a user requesting "directions from my current location to the nearest store."

[1576] Input: User's current ongoing activity information and requests

[1577] Output: Appropriate real-time support information

[1578] Specific operation: When a user asks the avatar, "Tell me the way to the nearest store," the server calculates the optimal route based on the current location information and route data, and sends that information back to the user's device.

[1579] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1580] The present invention relates to a system for enabling individuals to plan, improve themselves, and engage in solo activities with generated avatars, including a user terminal, a server, a generative model, a natural language processing module, an emotion engine, and a travel plan generation module.

[1581] Avatar generation

[1582] A user first uses a user device to enter their profile information. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user's device and presented to the user.

[1583] Avatar communication and emotion recognition

[1584] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server, which uses a natural language processing module to analyze the user's message and generate an appropriate response.

[1585] Furthermore, the server utilizes an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's input message and facial expression data acquired from the facial recognition camera. Based on the analysis results, the avatar's response is tailored to the user's emotions. For example, if the user is feeling stressed, the avatar can select a comforting response.

[1586] Generate a travel plan

[1587] Users can create travel plans together with their avatars. The user inputs their desired travel destinations and activities and sends this information from the user's device to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user's device. The user can review this proposal and make any necessary changes.

[1588] Travel support and emotion recognition

[1589] Users can receive real-time support while traveling. For example, when a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate the optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided.

[1590] Furthermore, the emotion engine can monitor the user's emotional state while traveling and provide appropriate support. For example, if the user becomes lost and feels fear or anxiety, the emotion engine will recognize that emotion and the avatar will provide advice to help them calm down.

[1591] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. In an actual trip, the server provides real-time traffic information, and the emotion engine adjusts the avatar's responses based on the user's emotional state, allowing the user to enjoy solo activities with peace of mind.

[1592] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[1593] The processing flow will be explained below.

[1594] Avatar generation

[1595] Step 1:

[1596] The user opens a screen on the user terminal to input profile information for avatar generation, including age, gender, interests, hobbies, and special skills.

[1597] Step 2:

[1598] The device generates a request to send the entered profile information to the server. The data to be sent is constructed in JSON format and sent via POST to the specified API endpoint on the server.

[1599] Step 3:

[1600] The server analyzes the received profile information and inputs it into a generative model. The profiling module organizes the data and generates an avatar using the generative AI model.

[1601] Step 4:

[1602] The server returns the generated avatar data to the device, generating a JSON response containing the avatar image, attribute information, and other related data.

[1603] Step 5:

[1604] The device displays the avatar information received from the server to the user, showing the avatar's image and attribute information on the screen and providing customization options as needed.

[1605] Step 6:

[1606] The user checks the presented avatar, and if he / she wishes to customize it, he / she sends the information to the server again to update the avatar.

[1607] Avatar communication and emotion recognition

[1608] Step 1:

[1609] The user opens a chat screen to interact with the avatar and enters a message such as "Hello."

[1610] Step 2:

[1611] The terminal generates a request to send the user's message to the server by sending a POST request containing the message data to the server.

[1612] Step 3:

[1613] The server passes the received message to a natural language processing module for analysis. The NLP (natural language processing) module analyzes the intent and content of the message and generates an appropriate response.

[1614] Step 4:

[1615] The server sends the generated response to the terminal. It generates a JSON response containing the response message and sends it to the user's terminal.

[1616] Step 5:

[1617] The device will display the response message received from the server, which will be displayed on the chat screen as a message from the avatar.

[1618] Step 6:

[1619] The user sees the avatar's response and continues the dialogue if desired, and the cycle repeats each time the user types a new message.

[1620] Step 7:

[1621] The server passes the user's input message and facial expression data from a face recognition camera installed on the user's device to the emotion engine for analysis, which determines the user's emotional state.

[1622] Step 8:

[1623] The server adjusts the avatar's responses based on the emotion engine's analysis, for example generating a comforting response if the user is feeling stressed.

[1624] Generate a travel plan

[1625] Step 1:

[1626] The user enters the travel plan creation mode and inputs the places they want to go and the activities they want to do. For example, they input their wish to "watch a sporting event in Tokyo."

[1627] Step 2:

[1628] The device generates a request to send the user's input to the server. It constructs JSON data containing the desired content and sends a POST request to the server.

[1629] Step 3:

[1630] The server analyzes the user's request and retrieves relevant travel information from the database. It also executes a database query to retrieve information about sporting events taking place in Tokyo.

[1631] Step 4:

[1632] The server generates a travel plan based on the acquired information. The travel plan generation module creates a travel plan including dates, locations, means of transportation, etc.

[1633] Step 5:

[1634] The server sends the generated travel plan to the device. It also generates a JSON response containing the plan details and sends it to the user's device.

[1635] Step 6:

[1636] The terminal displays the travel plan received from the server to the user, showing the plan details on the screen and providing options to modify it if necessary.

[1637] Step 7:

[1638] The user reviews the proposed itinerary and modifies it as necessary. If the user makes any changes, the information is sent back to the server, and the itinerary is updated.

[1639] Travel support and emotion recognition

[1640] Step 1:

[1641] The user enters a mode for receiving support during the actual trip, entering a request such as "Please tell me how to get to today's game" before leaving.

[1642] Step 2:

[1643] The device generates a request to send the user's request to the server, constructs a JSON containing the request data, and sends a POST request to the server.

[1644] Step 3:

[1645] The server analyzes the current traffic conditions in real time and generates an optimal route by querying traffic information APIs and map data.

[1646] Step 4:

[1647] The server sends the generated travel route and advice to the device, and generates a JSON response containing transportation instructions and sends it to the user's device.

[1648] Step 5:

[1649] The device displays the route information received from the server to the user, along with avatar messages about the route and important points to note.

[1650] Step 6:

[1651] The user then takes action based on the provided information, travels to the destination using the route provided, and enjoys the trip.

[1652] Step 7:

[1653] The server monitors the user's emotional state during the trip and analyzes it using an emotion engine in a timely manner. If the user feels anxious or stressed, the server provides appropriate comfort and advice through the avatar.

[1654] Step 8:

[1655] The device displays responses and advice sent from the server to the user in real time, providing support so that the user can continue their activities with peace of mind.

[1656] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. In an actual trip, the server provides real-time traffic information, and the emotion engine adjusts the avatar's responses based on the user's emotional state, allowing the user to enjoy solo activities with peace of mind.

[1657] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[1658] Example 2

[1659] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1660] In modern society, it is important for individuals to enjoy solo activities while engaging in activities that match their interests and hobbies, while also improving themselves. However, traditional planning and information gathering can be time-consuming and laborious, and solo activities can sometimes be accompanied by feelings of loneliness and anxiety. Therefore, there is a growing need for a system that automatically provides optimal support to individual users, allowing them to plan and engage in activities with peace of mind.

[1661] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1662] In this invention, the server includes means for receiving profile information and generating an avatar using a generation AI model, means having a natural language processing module for analyzing dialogue for communicating with the avatar, and means having a travel plan generation module for generating a travel plan based on the user's wishes. This allows the user to communicate with the optimal avatar based on their profile information, efficiently plan activities according to their wishes, and enjoy safe and enjoyable solo activities.

[1663] A "user terminal" is a communication device operated by an individual, and is a device for inputting and displaying information.

[1664] A "server" is a central control device that receives information sent from user terminals, performs various processes, and then sends the information.

[1665] A "generative AI model" is an artificial intelligence algorithm that generates the optimal avatar based on a user's profile information.

[1666] A "natural language processing module" is a technology for analyzing a user's text message and generating an appropriate response.

[1667] An "emotion recognition engine" is a device that analyzes a user's message and facial expression data to recognize the user's emotional state and adjust the response.

[1668] The "travel plan generation module" is a function that automatically generates an appropriate travel plan based on the user's wishes.

[1669] "Profile information" is personal data such as the user's age, gender, interests, hobbies, and special skills.

[1670] An "avatar" is a virtual character that is generated based on a user's profile information and that communicates with the user.

[1671] "Real-time support" is a function that responds immediately to user requests and provides appropriate information and assistance in situations such as while traveling.

[1672] The present invention relates to a system for enabling individuals to plan, improve themselves, and engage in solo activities with a generated avatar, including a user terminal, a server, a generative AI model, a natural language processing module, an emotion recognition engine, and a travel plan generation module.

[1673] A user first uses a user device to enter their profile information. The entered information includes personal information such as age, gender, interests, hobbies, and special skills. The device then sends this information to a server. The server then uses a generative AI model based on the received information to generate an avatar that is optimal for each individual user. This avatar is then sent back to the user's device and presented to the user.

[1674] The user opens a chat screen to interact with the generated avatar. The message entered by the user is sent from the user's device to the server. The server utilizes a natural language processing module to analyze the user's message and generate an appropriate response. The server then utilizes an emotion recognition engine to recognize the user's emotions. The emotion recognition engine analyzes the message entered by the user and facial expression data acquired from the facial recognition camera. Based on the analysis results, the avatar's response is adjusted to match the user's emotions. For example, if the user is feeling stressed, the avatar can select a comforting response.

[1675] Users can also create travel plans together with their avatars by inputting their desired travel destinations and activities. The user inputs the desired travel destinations and activities and sends them from the user terminal to the server. The server uses a travel plan generation module to create a travel plan based on the user's preferences and sends the information to the user terminal. The user can review the proposal and make any necessary changes.

[1676] Users can receive real-time support while traveling. For example, if a user inputs a request such as "How do I get to today's game?", the message is sent from the user's device to the server. The server references traffic information APIs and other data to generate an optimal route and sends it back to the user's device. This information is displayed as an avatar message, and the user can act based on the information provided. Furthermore, the user's emotional state can be monitored during the trip, and the emotion recognition engine can provide appropriate support. For example, if a user becomes lost and feels fear or anxiety, the emotion recognition engine will recognize that emotion and the avatar will provide advice to help them calm down.

[1677] As a concrete example, consider a scenario in which the user is a 28-year-old male who loves traveling and whose hobby is watching sports, and an avatar is being generated. The user enters profile information, and the server uses this information to generate an avatar of a character who is a 28-year-old male who loves watching sports. The user then sends the avatar a message saying, "Hello, let's decide on a travel destination." The server generates a response saying, "What kind of place do you want to go to?", which is sent back to the user's device. If the user enters, "I want to watch a sporting event in Tokyo," the server generates an appropriate travel plan and suggests it to the user. During an actual trip, the server provides real-time traffic information, and an emotion recognition engine adjusts the avatar's responses based on the user's emotional state, allowing the user to enjoy solo activities with peace of mind.

[1678] As described above, this system allows users to plan and engage in self-improvement and solo activities safely and efficiently with their avatars, allowing users to enjoy solo activities in a positive way and reducing feelings of loneliness.

[1679] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1680] Step 1:

[1681] The user enters profile information.

[1682] Input: The user inputs information such as age, gender, interests, hobbies, and special skills into the user terminal.

[1683] Data processing: The terminal formats the input data and sends it to the server.

[1684] Output: The profile information is sent to the server.

[1685] Specific operation: The user enters "28 years old, male, hobby is watching sports" and presses the send button.

[1686] Step 2:

[1687] The server generates the avatar.

[1688] Input: The server receives the profile information sent from the user terminal.

[1689] Data calculation: A generative AI model analyzes profile information and generates an avatar.

[1690] Output: The generated avatar data is sent to the server.

[1691] Specific operation: The server provides the generated AI model with information such as "28 years old, male, hobby is watching sports" and generates an avatar.

[1692] Step 3:

[1693] The server transmits the avatar information to the user terminal.

[1694] Input: Avatar data generated on the server.

[1695] Data processing: The server formats the avatar information and sends it to the user's device.

[1696] Output: Avatar information arrives on the user's device.

[1697] Specific operation: The server sends the generated avatar data in JSON format to the user device.

[1698] Step 4:

[1699] The user starts chatting with the avatar.

[1700] Input: The user types a chat message and presses the send button.

[1701] Data processing: The terminal sends the message data to the server.

[1702] Output: The user's message is sent to the server.

[1703] Specific operation: The user types "Hello" into the chat screen and presses the send button.

[1704] Step 5:

[1705] The server parses the message.

[1706] Input: User's message data to the server.

[1707] Data Computation: A natural language processing module analyzes the message and generates an appropriate response.

[1708] Output: Parsed results and response data are provided to the server.

[1709] Specific operation: The server passes the message "hello" to the natural language processing module, which parses it as a "greeting" and generates a response.

[1710] Step 6:

[1711] The server sends a response to the user terminal.

[1712] Input: Parsed results and response data to the server.

[1713] Data processing: The server formats the response data and sends it to the user terminal.

[1714] Output: A response message arrives at the user terminal.

[1715] Specific operation: The server sends the generated response "Hello! How are you today?" to the user terminal.

[1716] Step 7:

[1717] Emotion recognition on the server.

[1718] Input: User message data and facial expression data.

[1719] Data Calculation: An emotion recognition engine analyzes the message and facial expression data to determine the user's emotional state.

[1720] Output: The emotion recognition results are provided to the server.

[1721] Specific operation: The server analyzes messages such as "I'm not feeling very well today" and facial expression data from the camera using an emotion recognition engine.

[1722] Step 8:

[1723] The server coordinates the avatar's response.

[1724] Input: Emotion recognition results and response data.

[1725] Data processing: The server adjusts the response data based on the emotion recognition results.

[1726] Output: A tailored response message is generated.

[1727] What happens: The server generates a response based on the results of the emotion recognition engine: "You seem to be feeling down today. Is there anything I can help you with?"

[1728] Step 9:

[1729] The user inputs the travel destination and activity.

[1730] Input: The user inputs the desired travel destination and activity into the user terminal.

[1731] Data processing: The terminal sends the input data to the server.

[1732] Output: Travel destination and activity information is sent to the server.

[1733] Specific actions: The user enters "I want to watch a sporting event in Tokyo" and presses the send button.

[1734] Step 10:

[1735] The server generates the itinerary.

[1736] Input: Your desired travel destination and activity information sent to the server.

[1737] Data calculation: The travel plan generation module generates a travel plan based on the user's wishes.

[1738] Output: The generated itinerary is provided to the server.

[1739] Specific operation: The server uses the travel plan generation module to generate a travel plan such as "Watching a baseball game at Tokyo Dome, this weekend's plan."

[1740] Step 11:

[1741] The server transmits the travel plan to the user terminal.

[1742] Input: A server-generated itinerary.

[1743] Data processing: The server formats the travel plan and sends it to the user's terminal.

[1744] Output: The travel plan is delivered to the user's device.

[1745] Specific operation: The server sends the generated travel plan in JSON format to the user terminal.

[1746] Step 12:

[1747] Respond to requests during your trip.

[1748] Input: Users input support requests in real time.

[1749] Data processing: The terminal sends the request data to the server.

[1750] Output: The request is sent to the server.

[1751] Specific operation: The user types "Please tell me how to get to today's game" and submits it.

[1752] Step 13:

[1753] The server provides the appropriate information.

[1754] Input: The request data sent to the server.

[1755] Data calculation: The server references the traffic information API and generates optimal route information.

[1756] Output: The generated route information is sent to the user terminal.

[1757] Specific operation: The server uses the traffic information API to generate a "route from the nearest station to Tokyo Dome" and sends it to the user's device.

[1758] Step 14:

[1759] The server identifies the emotional state during the trip and tailors the response.

[1760] Input: User message data and facial expression data.

[1761] Data Calculation: An emotion recognition engine analyzes the message and facial expression data to determine the user's emotional state.

[1762] Output: Based on the emotion recognition results, a tailored response message is generated.

[1763] Specific behavior: The server uses an emotion recognition engine to provide advice such as "If you're lost and worried, maybe it would be a good idea to take a break at a nearby cafe" if the user feels fear or anxiety.

[1764] (Application example 2)

[1765] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1766] There is a need for systems that provide product recommendations and appropriate real-time support based on personal hobbies and interests through individually customized avatars. In particular, there is a need for methods that can reduce stress and anxiety users feel while shopping by analyzing the user's emotional state and providing appropriate responses. However, existing systems have limited functionality for generating avatars based on user profile information and are inferior in real-time support and emotion recognition, which leaves the user experience unsatisfactory.

[1767] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving personal profile information and generating an avatar using a generative model, means for suggesting products based on the user's interests and hobbies, and an emotion engine for analyzing the user's emotional state and adjusting appropriate responses. This enables users to receive personalized product information and enjoy real-time support through their individually customized avatars, thereby reducing stress and anxiety while shopping.

[1768] A "user terminal" is a device that allows an individual to enter profile information and communicate with an avatar.

[1769] "Profile information" is personal information such as the user's age, gender, interests, hobbies, and special skills.

[1770] The "server" is a central processing unit that processes information received from user terminals, generates avatars, analyzes dialogue and emotional states, suggests products, and provides real-time support.

[1771] A "generative model" is an algorithm for generating the optimal avatar based on a user's profile information.

[1772] An "avatar" is a virtual character that is generated based on the user's profile information and is used to communicate with the user.

[1773] "Communication" refers to conversations and message exchanges between a user and an avatar.

[1774] A "dialogue analysis server" is a server that analyzes messages entered by users and generates appropriate responses.

[1775] The "means for suggesting products" is an algorithm that suggests appropriate products based on the user's interests and hobbies.

[1776] The "emotion engine" is an engine that analyzes the user's emotional state from their messages and facial expressions and adjusts the avatar's response.

[1777] A "means for providing real-time support" is a system for providing immediate responses to user questions and requests.

[1778] The present invention provides a system for enabling individuals to shop with a generated avatar and receive appropriate support according to their emotional state. The system includes a user terminal, a server, a generative model, a natural language processing module, an emotion engine, and a product suggestion module.

[1779] 1. Enter your user profile

[1780] Users use smart glasses or smartphones to enter their profile information, which includes age, gender, interests, hobbies, special skills, etc. The entered information is then sent from the user terminal to the server.

[1781] 2. Avatar generation

[1782] The server uses a generative model based on the received profile information to generate an avatar that best suits the individual user. This avatar is then sent back to the user's device and displayed. For example, if a user is a 28-year-old woman who is interested in fashion, a personalized avatar will be generated based on that information.

[1783] 3. Avatar communication and emotion recognition

[1784] The user opens a chat screen to interact with the generated avatar. Messages entered by the user are sent from the user's device to the server, which uses a natural language processing module to analyze the user's messages and generate appropriate responses.

[1785] Additionally, the system uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes messages typed by the user and facial expression data captured by the smart glasses' camera. Based on the analysis results, the avatar's response is adjusted. For example, if the user is feeling stressed, the avatar will make suggestions to help them relax.

[1786] 4. Product proposal

[1787] Based on the user's profile information and interests and hobbies derived from past interactions, the server uses a product suggestion module to suggest personalized products. For example, if a user says, "I'm looking for fashion items," the avatar will suggest fashion items that are appropriate for the season.

[1788] 5. Real-time support

[1789] While shopping, users can receive real-time support from the server. When a user types "Tell me about this product," the message is sent to the server. The server references the database, retrieves the appropriate product information, and returns it to the user. This information is displayed as an avatar message, allowing the user to make a purchasing decision based on the information provided.

[1790] For example, if a 28-year-old woman asks the avatar, "What do you recommend today?", the server will suggest appropriate fashion items based on the user's profile information. If the user is feeling stressed, the avatar will also suggest products that will help them relax.

[1791] Prompt Sentence Examples

[1792] User: "I'm a 28-year-old woman interested in fashion. Can you recommend some summer outfits?"

[1793] Model: "I'll suggest some fashion items. Let's start with avatar generation."

[1794] As described above, this system provides an environment where users can enjoy shopping with individually customized avatars and receive appropriate real-time support while reducing stress.

[1795] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1796] Step 1:

[1797] The user terminal inputs personal profile information (age, gender, interests, hobbies, special skills, etc.) and sends it to the server. This input information also includes the user's preferences and purchase list. The server receives this information.

[1798] Step 2:

[1799] The server uses a generative model based on the received profile information to generate the optimal avatar. Specifically, it compares the profile information with a database and selects and generates an appropriate avatar. The input to this process is the user's profile information, and the output is the generated avatar information.

[1800] Step 3:

[1801] The server returns information about the generated avatar to the user terminal, which then displays the avatar to the user. The user then checks the displayed avatar and begins a dialogue.

[1802] Step 4:

[1803] The user interacts with the generated avatar through a chat screen. Messages entered by the user are sent from the user's device to the server. This message is the input for processing, and the server analyzes the message using a natural language processing module to generate an appropriate response. The analysis results are output and sent back to the user's device.

[1804] Step 5:

[1805] The server simultaneously uses an emotion engine to analyze the user's input message and facial expression data to recognize the user's emotional state. The input of this process is the message and facial expression data, and the output is the analysis result of the emotional state. The avatar's response is adjusted according to the emotional state.

[1806] Step 6:

[1807] When a user requests an avatar to "search for fashion items," the server uses a product suggestion module based on profile information and past interaction data to suggest personalized products. The input information is the request and profile information, and the output is a list of suggested products.

[1808] Step 7:

[1809] When a user inputs a question about a product (e.g., "Tell me about this product"), the server immediately references the database and retrieves related product information. The input is the question, and the output is product information. The server returns the retrieved information to the user's device as an avatar message. The user makes a purchasing decision based on the information provided.

[1810] Step 8:

[1811] To support the user during their trip, the server monitors the user's emotional state in real time, and the avatar provides comforting messages and information as needed. The input of this process is the user's real-time messages and emotional data, and the output is a tailored response.

[1812] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1813] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1814] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1815] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1816] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1817] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and...

Claims

1. a user terminal for inputting personal profile information; a server that receives the profile information and generates an avatar using a generative model; a user terminal having means for displaying information about the generated avatar and presenting it to a user; a server that analyzes a dialogue for communicating with the avatar; a server that generates a travel plan based on the user's preferences; a server having means for transmitting the generated travel plan to a user terminal; a server that provides real-time support during the trip; A system including:

2. The system of claim 1 , wherein the avatar is individually customizable based on user profile information.

3. The system of claim 1 , wherein the server includes a natural language processing module for analyzing messages of users in communication and generating appropriate responses.

Images