System

Abstract

A system is provided.SOLUTION: A system comprising: means for inputting information experienced by a user during a trip; means for sending the inputted information to a server; means for the server to collect the information and request a generated response to a generation AI; means for the generation AI to generate the response and return the response to the user through the server; means for generating a trip summary and an album based on the user's inputted information and response content; and means for providing the album to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Solo travel has the advantage of being able to travel at your own pace, but it can also feel very lonely because there is no one to share your experiences and emotions with. Furthermore, traveling with others takes away the freedom of solo travel, and posting travel memories on social media carries the risk of privacy and location information being leaked or sparking outrage. For this reason, there was a need for a system that would allow people to safely and freely share their travel memories and easily compile their travel history. [Means for solving the problem]

[0005] To solve this problem, the present invention provides the following means: a means for a user to input information about their experiences during a trip, a means for transmitting the input information to a server, and a means for the server to collect the information and request a generation AI to generate a response. The system also includes a means for returning the response generated by the generation AI to the user via the server, a means for generating a travel summary and album based on the user's input information and response, and a means for providing the generated album to the user. This allows users traveling alone to safely and freely share their memories and compile a record of their travels.

[0006] Furthermore, by including a means for setting a virtual travel companion character according to the user's selection and loading a response template according to the character setting, the user can have a realistic conversation experience. Also, by including a means for the user to input a question to determine the next action to take during the trip, and a means for passing the question to a generation AI to generate an appropriate answer and sending the answer to the user, the user can smoothly proceed with their actions at their travel destination.

[0007] A "user" is a person who uses the system to converse with virtual travel friends and share travel information.

[0008] "Information experienced during travel" refers to experiences and events that the user felt during the travel, and is information expressed in text or image format.

[0009] "Means" refers to a method, device, program, etc. used to realize a specific function in this system.

[0010] A "server" is a computer system that receives and processes information sent by users and requests the generation AI to generate a response.

[0011] "Generative AI" is an artificial intelligence system that automatically generates appropriate responses based on information entered by the user.

[0012] A "response" is a message or information that the generating AI returns in response to input from the user.

[0013] A "chatbot" is a program that receives information through conversation with a user and generates a response based on that information.

[0014] An "album" is an electronic document or digital book that compiles summaries and images of a user's travels.

[0015] A "download link" is a URL or web link that allows a user to obtain the generated album via the Internet.

[0016] A "virtual travel buddy" is a friend character simulated by a generative AI to share travel experiences with the user.

[0017] "Character" refers to the unique setting and personality of the virtual travel companion selected by the user. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] The present invention is a system called "virtual travel buddies" that can reduce the sense of loneliness felt by users traveling alone and allow them to freely share travel experiences. A specific embodiment of this system is described below.

[0040] Program processing and specific examples

[0041] 1. User Registration and Login

[0042] A user installs and launches an application. When using it for the first time, the user enters basic information such as name, email address, and password to create an account. The device sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[0043] 2. Selecting virtual travel companions

[0044] After logging in, the user opens a screen to select the character of their virtual travel buddy. For example, they can choose between an adventurous friend or a culturally knowledgeable friend. After selection, the device sends the character information to the server. The server stores this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the character settings.

[0045] 3. Sharing travel stories

[0046] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[0047] As a specific example, when a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[0048] 4. Real-time conversation and question answering

[0049] When deciding on their next move during their journey, the user inputs a question, and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. For example, in response to the question, "Where should we go next?", the generation AI generates the answer, "There's a beautiful garden nearby, so be sure to visit it," and sends it to the user via the server. The user then plans their next move based on this information.

[0050] 5. Travel summary and album creation

[0051] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[0052] Specifically, the system sends a response saying, "You had a great trip today. I'll make an album for you," and generates a digital album that compiles the chat history and images. This album is provided to the user as part of a memorable trip.

[0053] ---

[0054] In this way, the present invention utilizes generative AI to provide a system that allows solo travelers to freely share their memories and receive responses in real time, thereby reducing loneliness and allowing them to enjoy their trip with peace of mind without losing the benefits of solo travel.

[0055] The processing flow will be explained below.

[0056] User Registration and Login

[0057] Step 1:

[0058] The user installs and launches the application and selects the "New Registration" button from the home screen.

[0059] Step 2:

[0060] The user enters basic information such as name, email address, and password, which is then stored on the device.

[0061] Step 3:

[0062] The device sends the entered information to the server using the HTTPS protocol.

[0063] Step 4:

[0064] The server saves the received information in the database using SQL commands.

[0065] Step 5:

[0066] The server generates an authentication token and returns it to the device. The token is generated using JWT (Json Web Token).

[0067] Step 6:

[0068] The terminal stores the authentication token and keeps the user logged in.

[0069] Selecting virtual travel companions

[0070] Step 1:

[0071] After the user logs in, the virtual travel buddy character selection screen opens, and a list of characters is displayed.

[0072] Step 2:

[0073] The user selects a character and presses the "OK" button. The selected character information is saved on the device.

[0074] Step 3:

[0075] The device sends the selected character information to the server using an HTTP POST request.

[0076] Step 4:

[0077] The server saves the character selection information to the database using the INSERT SQL command.

[0078] Step 5:

[0079] The server determines the user's character settings and loads a response template based on those settings into the generation AI.

[0080] Sharing travel stories

[0081] Step 1:

[0082] Users can enter text or images of their travel experiences and send them to their virtual travel buddies using the app's chat interface.

[0083] Step 2:

[0084] The device transfers the input message and image data to the server using an HTTP POST request.

[0085] Step 3:

[0086] The server passes the received data to the generation AI and requests it to generate a response. Data transfer uses an API.

[0087] Step 4:

[0088] Generative AI analyzes the user's message and generates an appropriate response, using natural language processing technology.

[0089] Step 5:

[0090] The server sends the generated response to the terminal using an HTTP response.

[0091] Step 6:

[0092] Users receive responses and continue the conversation, enabling real-time shared experiences.

[0093] Real-time conversation and question answering

[0094] Step 1:

[0095] The user enters a question to determine the next action, using the in-app chat interface.

[0096] Step 2:

[0097] The device sends the user's question to the server using an HTTP POST request.

[0098] Step 3:

[0099] The server passes the question to the AI ​​generator and requests it to generate a response. Data is transferred using an API.

[0100] Step 4:

[0101] Generative AI analyzes questions and generates appropriate answers, using knowledge databases and search engines for analysis and generation.

[0102] Step 5:

[0103] The server sends the generated answer to the terminal using an HTTP response.

[0104] Step 6:

[0105] The user receives the answer and uses that information to plan their next steps, ensuring smooth travel.

[0106] Travel summary and album creation

[0107] Step 1:

[0108] The user sends a message to the chatbot requesting a "trip summary," using the in-app chat interface.

[0109] Step 2:

[0110] The device sends a request message to the server using an HTTP POST request.

[0111] Step 3:

[0112] The server collects the chat history and images sent using a database query.

[0113] Step 4:

[0114] The server passes the collected data to the AI ​​generator and requests it to summarize and generate an album. Data transfer is performed using an API.

[0115] Step 5:

[0116] Generative AI analyzes chat history and images to create text summaries and album pages, using machine learning algorithms for analysis and generation.

[0117] Step 6:

[0118] The server generates a download link for the created album to provide it to the user. The link generation is performed using a web service.

[0119] Step 7:

[0120] The server sends the download link to the device using an HTTP response.

[0121] Step 8:

[0122] The user receives a download link and downloads the generated album, which contains a summary of the trip and images.

[0123] Example 1

[0124] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0125] Traditionally, solo travelers have often felt lonely and had no one to share their travel experiences with, which often prevented them from fully enjoying their trip. They also had difficulty gathering information and making decisions during their trip. There is a need for a system that can solve these problems and help travelers enjoy their trips more while reducing feelings of loneliness.

[0126] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0127] In this invention, the server includes a means for inputting information about experiences during a trip, a means for transmitting the input information to the server, and a means for collecting the information and requesting a response from the generation AI. This allows the user to reduce feelings of loneliness and share their travel experiences. Furthermore, by sending questions to the generation AI and receiving appropriate responses in real time, the server facilitates decision-making during the trip. Furthermore, the server also includes a means for generating a summary and album of the trip based on the user's input information and responses, and providing them to the user, allowing the user to reminisce about their solo travel memories.

[0128] "User" refers to an individual who uses the system, primarily a traveler traveling alone.

[0129] "Terminal" refers to a computing device used by a user, such as a smartphone or tablet.

[0130] "Server" refers to a central processing unit that receives, processes, stores, and generates necessary responses from data sent by terminals.

[0131] "Generative AI" refers to an artificial intelligence model that analyzes information input by a user and generates an appropriate response based on that information.

[0132] An "authentication token" refers to secure authentication information that is returned from a server to a terminal to keep the user logged in.

[0133] "Database" refers to a system installed on a server for storing user information, character setting information, etc.

[0134] "Character" refers to a virtual person with various personalities and characteristics that a user selects as a virtual travel companion.

[0135] "Response template" refers to the basic pattern of the response that the generation AI generates based on the character of the virtual travel companion.

[0136] "Trip summary" refers to a summary of the trip that is generated based on the information entered by the user during the trip and the response from the server.

[0137] An "album" refers to a digital booklet that compiles images taken by the user during their trip and information entered by the user, and includes a summary of the trip generated by the generative AI.

[0138] "Question" refers to a textual inquiry that a user enters to determine their next action during their journey.

[0139] "Download link" refers to the web link provided by the server for the user to obtain the generated album.

[0140] "Application" refers to software that users install on their devices and use.

[0141] The present invention is a system called "virtual travel buddies" that can reduce the sense of loneliness felt by users traveling alone and allow users to freely share their travel experiences. A specific embodiment of this system is described below.

[0142] User Registration and Login

[0143] A user installs and launches an application on their smartphone or tablet. When using the application for the first time, the user creates an account by entering basic information such as their name, email address, and password. The device then sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[0144] Hardware and Software Used

[0145] Hardware: Smartphone or tablet

[0146] Software: iOS / Android applications, HTTP protocol, database systems (e.g., MySQL)

[0147] Specific examples

[0148] When a user creates an account under the name "John Smith" and signs in, the server stores John Smith's information in a database and sends an authentication token back to the terminal.

[0149] Selecting virtual travel companions

[0150] After logging in, the user opens a screen to select the character of their virtual travel buddy. For example, they can choose between an adventurous friend or a culturally knowledgeable friend. After selection, the device sends the character information to the server. The server saves this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the character settings.

[0151] Hardware and Software Used

[0152] Hardware: Smartphone or tablet

[0153] Software: Database management systems, generative AI (e.g., GPT-3)

[0154] Specific examples

[0155] When the user selects "adventurous friend," the server sets the friend as adventurous and has the generation AI load a response template appropriate for that character.

[0156] Sharing travel stories

[0157] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[0158] Hardware and Software Used

[0159] Hardware: Smartphone or tablet, cloud server

[0160] Software: Image analysis tools, generative AI (e.g., GPT-3)

[0161] Specific examples

[0162] When a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[0163] Real-time conversation and question answering

[0164] When a user decides on their next move during their journey, they input a question and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. The generated answer is sent to the user via the server, and the user uses this information to plan their next move.

[0165] Hardware and Software Used

[0166] Hardware: Smartphone or tablet, cloud server

[0167] Software: Generative AI (e.g., GPT-3)

[0168] Specific examples

[0169] When a user types, "Where should we go next?", the generating AI responds, "There's a beautiful garden nearby, so be sure to visit it," and sends this to the user via the server.

[0170] Travel summary and album creation

[0171] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests a generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[0172] Hardware and Software Used

[0173] Hardware: Smartphone or tablet, cloud server

[0174] Software: Generative AI (e.g., GPT-3)

[0175] Specific examples

[0176] The response is, "You had a great trip today. I'll make an album for you," and a digital album is generated that includes the chat history and photos. This album is then made available to the user as part of a memorable trip.

[0177] ---

[0178] In this way, the present invention utilizes generative AI to provide a system that allows solo travelers to freely share their memories and receive responses in real time, thereby reducing loneliness and allowing them to enjoy their trip with peace of mind without losing the benefits of solo travel.

[0179] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0180] Step 1: User Registration and Login

[0181] explanation

[0182] A user installs and launches an application on their smartphone or tablet. They create an account by entering basic information such as their name, email address, and password. The device sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[0183] Input and Output

[0184] Input: Name, Email Address, Password

[0185] Data processing: validation and storage of entered information

[0186] Output: Authentication token

[0187] Specific actions

[0188] A user creates an account under the name "John Smith," the server stores John Smith's information in a database, generates an authentication token, and sends it back to the terminal, which automatically logs the user in.

[0189] Step 2: Selecting virtual travel companions

[0190] explanation

[0191] After logging in, the user opens a screen to select a virtual travel buddy character. The user selects their preferred character from the provided options. The device sends the selected character information to the server. The server saves this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the set character.

[0192] Input and Output

[0193] Input: Character selection information

[0194] Data processing: Saving character information and loading templates

[0195] Output: Character settings confirmed

[0196] Specific actions

[0197] When the user selects "adventurous friend," the server stores this in a database and loads a response template based on the generated AI.

[0198] Step 3: Share your travel stories

[0199] explanation

[0200] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[0201] Input and Output

[0202] Input: Text and image information

[0203] Data processing: Analysis of input information and response generation

[0204] Output: The generated response

[0205] Specific actions

[0206] When a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the generation AI, which then generates a response saying, "That's a beautiful photo! What impressed you about the castle?" and returns it to the user via the server.

[0207] Step 4: Real-time conversation and question answering

[0208] explanation

[0209] When a user decides on their next move during their journey, they input a question and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. The generated answer is sent to the user via the server, and the user uses this information to plan their next move.

[0210] Input and Output

[0211] Input: Question text

[0212] Data processing: Question analysis and answer generation

[0213] Output: The generated answer

[0214] Specific actions

[0215] When a user types, "Where should we go next?", the generating AI responds, "There's a beautiful garden nearby, so be sure to visit it," and sends this to the user via the server.

[0216] Step 5: Summarize your trip and create an album

[0217] explanation

[0218] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[0219] Input and Output

[0220] Input: Bulk request

[0221] Data processing: Chat history and image collection, summarization, and album creation

[0222] Output: Download link

[0223] Specific actions

[0224] When a user types "Please summarize my trip," the server collects chat history and images and passes them to the AI ​​generator, which then generates a digital album with the response "Today was a great trip. I'll create an album for you," and the server provides the user with a download link.

[0225] (Application example 1)

[0226] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0227] In modern society, many people feel lonely when eating alone. In particular, when using food delivery services, there is a lack of experience enjoying a meal alone, making it difficult to obtain psychological satisfaction. Another problem is that when dining out, there are limited ways to obtain food reviews or advice on what dishes to try next.

[0228] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0229] In this invention, the server includes means for inputting information about the user's experience, means for transmitting the input information to the server, means for the server to collect the information and request a generated response from a generation AI, means for the generation AI to generate the response and return the response to the user via the server, means for generating a summary and an album based on the user's input information and response content, means for providing the album to the user, and means for sharing food delivery experiences as virtual gourmet friends and generating responses. This makes it possible to reduce loneliness even when dining alone through interactive interaction, thereby enriching the dining experience.

[0230] "User" means an individual who uses the system to input experience information and share their food delivery experience.

[0231] "Experience information" is data such as text and images related to travel and meals entered by the user.

[0232] A "server" is a centralized computer system that receives information sent by a user, requests a generation AI to generate a response, and sends it back to the user.

[0233] "Generative AI" is an artificial intelligence technology that generates appropriate responses based on information sent by the user.

[0234] A "response template" is a set of predetermined response patterns that the generation AI uses based on the character settings.

[0235] A "summary" is a document that compactly summarizes the information entered by the user and the contents of the conversation.

[0236] An "album" is a digital record of travel and dining experiences.

[0237] A "virtual gourmet friend" is a virtual character that shares the food delivery experience and responds to the user.

[0238] A "question" is a question that a user inputs into the system to determine the next action or recommendation.

[0239] An "answer" is the answer that the generation AI generates to a question.

[0240] This invention is a system called "Virtual Gourmet Friends" that enriches the food delivery experience and reduces loneliness. The system aims to provide a more enjoyable dining experience by allowing users to interact with virtual gourmet friends while enjoying food delivery and share their experiences.

[0241] System configuration

[0242] The system consists of the following main components:

[0243] User device: A device that is directly used by a user, such as a smartphone or tablet.

[0244] Server: A centralized computer system that works in conjunction with user devices to process data, request generation AI, and store and transmit data.

[0245] Generative AI model: An artificial intelligence technique that generates appropriate responses based on input from users.

[0246] Database: A system that stores data such as user information, experience information, and response templates.

[0247] System Operation

[0248] 1. User registration and login: When a user uses the system for the first time, they register by entering their name, email address, and password via their smartphone. The registration information is sent to the server and stored in the database. The user then enters their login information and obtains an authentication token to complete the login process.

[0249] 2. Selecting a virtual gourmet friend: After logging in, the user selects a character for their virtual gourmet friend on the system screen. For example, they can choose a friend who loves cooking or a friend who loves adventure. The selected character information is sent to the server and stored in the database. A response template is also loaded based on this information.

[0250] 3. Sharing food stories: Users can input their experiences using food delivery services as text and photos and send them to the system. For example, they can send a message like, "I had some amazing sushi delivered to me. I'll send you a photo too." This is sent to the server, and the AI ​​generates an appropriate response (e.g., "That sushi looks delicious! Where did you order it from?") and sends it back to the user.

[0251] 4. Question Answering: When a user inputs a question about their next meal or recommended dishes, the question is sent to the generation AI via the server. The generation AI generates an appropriate answer and sends it back to the user. For example, the response to the question "What's your recommended next dish?" may be "I recommend the pizza at a nearby restaurant."

[0252] 5. Meal summary and album generation: After a user has finished a meal experience, they can request an album to be generated that summarises the experience. Based on the chat history and images, the AI ​​generates a summary and album and provides it to the user. The user can then download the album using the download link.

[0253] This process allows users to interact with virtual gourmet friends while enjoying food delivery, reducing feelings of loneliness and allowing them to have a good time.

[0254] Specific examples

[0255] User: "I had some amazing sushi delivered. I'll send you a photo."

[0256] Generative AI: "That sushi looks delicious! Where did you order it from?"

[0257] In this way, the generating AI responds to the experience information entered by the user, making it possible to interact with virtual gourmet friends.

[0258] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0259] Step 1:

[0260] A user uses a smartphone to register by entering their name, email address, and password. The entered information is sent from the device to the server and stored in a database. When registration is successful, the server generates an authentication token and returns it to the device. Upon receiving this authentication token, the user can log in.

[0261] Step 2:

[0262] Once logged in, the user selects a character for their virtual gourmet friend. For example, options such as "friend who loves to cook" are displayed. Once the user selects a character, the device sends this information to the server. The server stores this character setting information in a database and asks the generative AI model to load a response template. The generative AI model loads the appropriate response template based on the selected character and makes it available for use.

[0263] Step 3:

[0264] A user orders food delivery and enters their dining experience using text and photos. For example, they might enter, "I had some great sushi delivered. I'll send you some photos." The device then sends this information to a server. The server then passes the received text and photos to a generative AI model, asking it to generate an appropriate response. The generative AI model analyzes the input and generates a response such as, "That sushi looks delicious! Where did you order it from?" This response is then returned to the user via the server.

[0265] Step 4:

[0266] The user inputs a question about the next dish or restaurant they should try. For example, "What's your next recommended dish?" The device sends the question to the server, which passes it on to the generative AI model. The generative AI model analyzes the question and generates an appropriate answer, such as "I recommend the pizza at a nearby restaurant." This answer is then sent back to the user via the server.

[0267] Step 5:

[0268] After the user finishes their dining experience, they request the creation of a summary and album. This request is sent from the user's device to the server. The server collects the chat history and images and asks the generative AI model to create a summary and album. The generative AI model analyzes the data and creates a summary and a digital album. This album is made available to the user via a download link provided via the server.

[0269] Step 6:

[0270] The user uses the download link to retrieve a digital album containing summaries and photos of their dining experiences, allowing them to reminisce about fond memories.

[0271] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0272] The present invention is a system called "Virtual Travel Buddy" that reduces the sense of loneliness felt by users traveling alone, allows users to freely share their travel experiences, recognizes the user's emotions, and adjusts responses accordingly. A specific embodiment of this system is described below.

[0273] Program processing and specific examples

[0274] 1. User Registration and Login

[0275] A user installs and launches an application. When using it for the first time, the user enters basic information such as name, email address, and password to create an account. The device sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[0276] 2. Selecting virtual travel companions

[0277] After logging in, the user opens a screen to select the character of their virtual travel buddy. For example, they can choose between an adventurous friend or a culturally knowledgeable friend. After selection, the device sends the character information to the server. The server stores this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the character settings.

[0278] 3. Sharing travel stories

[0279] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[0280] As a specific example, when a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[0281] 4. Real-time conversation and question answering

[0282] When deciding on their next move during their journey, the user inputs a question, and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. For example, in response to the question, "Where should we go next?", the generation AI generates the answer, "There's a beautiful garden nearby, so be sure to visit it," and sends it to the user via the server. The user then plans their next move based on this information.

[0283] 5. Travel summary and album creation

[0284] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[0285] Specifically, the system sends a response saying, "You had a great trip today. I'll make an album for you," and generates a digital album that compiles the chat history and images. This album is provided to the user as part of a memorable trip.

[0286] 6. Response adjustment using emotion engine

[0287] To further reflect the user's emotions during the journey, an emotion engine is built in. It recognizes emotions from the text information entered by the user. For example, if the message "Today was tiring but fun" is received, the emotion engine will extract the emotions of "tiredness" and "fun."

[0288] The server sends this emotional information to the AI ​​generator, which generates a response based on the emotion. The AI ​​generator generates a response such as, "It seems like you had a hard day today. But I'm glad you had fun. Shall we find a place to refresh yourself?" The server sends this response to the device, and the user receives it.

[0289] This enables interactions that are emotionally fulfilling for the user. For example, if a user inputs, "I felt a little lonely today," the server passes this information to the emotion engine and the generation AI, which then generates an encouraging response such as, "That was tough. But I'm sure you'll have a wonderful experience at your next location." This response is then returned to the user via the server.

[0290] In this way, the present invention utilizes generative AI and an emotion engine to provide a system that allows solo travelers to freely share their memories and receive reliable responses, thereby reducing loneliness without compromising the benefits of solo travel and providing an emotionally sensitive travel experience.

[0291] The processing flow will be explained below.

[0292] User Registration and Login

[0293] Step 1:

[0294] The user installs and launches the application and selects the "New Registration" button from the home screen.

[0295] Step 2:

[0296] The user enters basic information such as name, email address, and password, which is then stored on the device.

[0297] Step 3:

[0298] The device sends the entered information to the server using the HTTPS protocol.

[0299] Step 4:

[0300] The server saves the received information in the database using SQL commands.

[0301] Step 5:

[0302] The server generates an authentication token and returns it to the device. The token is generated using JWT (Json Web Token).

[0303] Step 6:

[0304] The terminal stores the authentication token and keeps the user logged in.

[0305] Selecting virtual travel companions

[0306] Step 1:

[0307] After the user logs in, the virtual travel buddy character selection screen opens, and a list of characters is displayed.

[0308] Step 2:

[0309] The user selects a character and presses the "OK" button. The selected character information is saved on the device.

[0310] Step 3:

[0311] The device sends the selected character information to the server using an HTTP POST request.

[0312] Step 4:

[0313] The server saves the character selection information to the database using the INSERT SQL command.

[0314] Step 5:

[0315] The server determines the user's character settings and loads a response template based on those settings into the generation AI.

[0316] Sharing travel stories

[0317] Step 1:

[0318] Users can enter text or images of their travel experiences and send them to their virtual travel buddies using the app's chat interface.

[0319] Step 2:

[0320] The device transfers the input message and image data to the server using an HTTP POST request.

[0321] Step 3:

[0322] The server passes the received data to the generation AI and requests it to generate a response. Data transfer uses an API.

[0323] Step 4:

[0324] Generative AI analyzes the user's message and generates an appropriate response, using natural language processing technology.

[0325] Step 5:

[0326] The server sends the generated response to the terminal using an HTTP response.

[0327] Step 6:

[0328] Users receive responses and continue the conversation, enabling real-time shared experiences.

[0329] Real-time conversation and question answering

[0330] Step 1:

[0331] The user enters a question to determine the next action, using the in-app chat interface.

[0332] Step 2:

[0333] The device sends the user's question to the server using an HTTP POST request.

[0334] Step 3:

[0335] The server passes the question to the AI ​​generator and requests it to generate a response. Data is transferred using an API.

[0336] Step 4:

[0337] Generative AI analyzes questions and generates appropriate answers, using knowledge databases and search engines for analysis and generation.

[0338] Step 5:

[0339] The server sends the generated answer to the terminal using an HTTP response.

[0340] Step 6:

[0341] The user receives the answer and uses that information to plan their next steps, ensuring smooth travel.

[0342] Travel summary and album creation

[0343] Step 1:

[0344] The user sends a message to the chatbot requesting a "trip summary," using the in-app chat interface.

[0345] Step 2:

[0346] The device sends a request message to the server using an HTTP POST request.

[0347] Step 3:

[0348] The server collects the chat history and images sent using a database query.

[0349] Step 4:

[0350] The server passes the collected data to the AI ​​generator and requests it to summarize and generate an album. Data transfer is performed using an API.

[0351] Step 5:

[0352] Generative AI analyzes chat history and images to create text summaries and album pages, using machine learning algorithms for analysis and generation.

[0353] Step 6:

[0354] The server generates a download link for the created album to provide it to the user. The link generation is performed using a web service.

[0355] Step 7:

[0356] The server sends the download link to the device using an HTTP response.

[0357] Step 8:

[0358] The user receives a download link and downloads the generated album, which contains a summary of the trip and images.

[0359] Response adjustment using emotion engine

[0360] Step 1:

[0361] When a user enters a text description of an experience they had during their trip, the emotion engine analyzes the text. For example, "Today was tiring, but it was a lot of fun."

[0362] Step 2:

[0363] The device sends the entered text to the server using an HTTP POST request.

[0364] Step 3:

[0365] The server passes the received text data to the emotion engine, which analyzes the emotions using natural language processing technology.

[0366] Step 4:

[0367] The emotion engine extracts the emotions of "fatigue" and "enjoyment" and passes that emotional data to the generation AI.

[0368] Step 5:

[0369] Based on the emotional data, the generative AI generates a response such as, "It seems like today was tough. But I'm glad you had fun. Shall we find a place to refresh again?"

[0370] Step 6:

[0371] The server sends the generated response to the terminal using an HTTP response.

[0372] Step 7:

[0373] The user receives the response and plans their next course of action. An emotionally sensitive response leaves the user feeling fulfilled.

[0374] Example 2

[0375] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0376] Solo travelers often feel lonely. It is difficult for them to freely share their travel experiences and emotions in real time and receive reliable responses based on their experiences. Furthermore, there is a lack of suitable tools for easily creating comprehensive summaries and albums at the end of a trip.

[0377] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for inputting information about the user's experiences during the trip; means for transmitting the input information to the server; means for the server to collect the information and request a generated response from a generation AI; means for the generation AI to generate the response and return the response to the user via the server; means for generating a travel summary and album based on the user's input information and response content; means for providing the album to the user; and means including an emotion engine for recognizing the user's emotions and adjusting the response. This allows solo travelers to reduce their sense of loneliness and receive reliable responses based on their emotions in real time. Furthermore, a comprehensive summary and album can be easily created and provided at the end of the trip.

[0378] A "user" is an individual who has registered to use the system and is actively traveling.

[0379] A "server" is a computer system that receives and processes information sent by users and requests the generation AI to generate a response.

[0380] "Terminal" means a device operated by a user, and is a device for inputting, sending, and receiving information.

[0381] "Generative AI" is an artificial intelligence technology that generates appropriate responses based on information entered by the user.

[0382] An "emotion engine" is a technology that recognizes emotions from the user's input text and allows the generative AI to generate a response that corresponds to the emotion.

[0383] A "virtual travel buddy" is a character selected by the user, who is a virtual friend who interacts with the user.

[0384] A "response template" is a dialogue template that is generated based on the character settings of the virtual travel companion.

[0385] An "album" is a digital record of a user's travel experiences and chat history, and is used to preserve travel memories.

[0386] The "trip summary" is information that the user puts together at the end of the trip, and provides a concise overview of the trip.

[0387] An "authentication token" is identification data generated by a server to allow a user to maintain a logged-in state.

[0388] The present invention is a "virtual travel buddy" system that reduces the sense of loneliness felt by users traveling alone, and recognizes the user's emotions and adjusts responses while freely sharing travel experiences. Specific embodiments for implementing this system are described below.

[0389] User Registration and Login

[0390] A user installs and launches a dedicated application on their mobile device. They create an account by entering basic information such as their name, email address, and password. The device sends this information to a server, which stores it in a database. An authentication token is generated and returned to the device, allowing the user to remain logged in.

[0391] Selecting virtual travel companions

[0392] After logging in, the user is presented with a screen to select a character for their virtual travel buddy. They can choose from multiple characters, such as an adventurous friend or a culturally knowledgeable friend. The selected character information is sent from the device to the server, which stores this information in a database. The server then loads a response template based on the selected character into the generated AI.

[0393] Sharing travel stories

[0394] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[0395] As a specific example, when a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[0396] Real-time conversation and question answering

[0397] When a user decides on their next move during their journey, they input a question. The device sends this question to the server, which passes it on to the generation AI. The generation AI generates an appropriate answer and sends it to the user via the server. For example, in response to the question, "Where should we go next?", the generation AI generates the answer, "There's a beautiful garden nearby, so be sure to visit it."

[0398] Travel summary and album creation

[0399] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[0400] Specifically, the system sends a response saying, "You had a great trip today. I'll make an album for you," and generates a digital album that compiles the chat history and images. This album is provided to the user as part of a memorable trip.

[0401] Response adjustment using emotion engine

[0402] An emotion engine is built in to reflect the user's emotions during the journey. Emotions are recognized from the text information entered by the user. For example, if the message "Today was tiring, but fun" is received, the emotion engine will extract the emotions of "tiredness" and "fun."

[0403] The server sends this emotional information to the AI, which then generates a response based on the emotion. The AI ​​generates a response such as, "It seems like you had a hard day today. But I'm glad you had fun. Shall we find a place to refresh yourself?" The server then sends this response to the device, where the user receives it.

[0404] As a specific example, if a user inputs "I felt a little lonely today," the server passes this information to the emotion engine and the generation AI, which then generates an encouraging response such as "That was tough, but I'm sure you'll have a wonderful experience at your next location." This response is then returned to the user via the server.

[0405] Prompt Sentence Examples

[0406] Type: "I saw a beautiful castle today. I'll send you some photos."

[0407] Prompt: "Generate a great response based on this photo."

[0408] As described above, this system uses a generative AI model and an emotion engine to enable solo travelers to freely share their travel experiences and receive emotionally sensitive responses, thereby reducing loneliness without compromising the benefits of solo travel and providing an emotionally sensitive travel experience.

[0409] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0410] Step 1: User installs and launches the application

[0411] The user downloads the dedicated application onto their mobile device, installs it, and then launches it. After installation, the first time they launch it, an account creation screen appears.

[0412] Input: None

[0413] Output: Account creation screen displayed

[0414] How it works: A user downloads an app from the App Store or Google Play Store and taps the install icon to launch it.

[0415] Step 2: User enters basic information to create an account

[0416] The user enters basic information such as name, email address, and password and presses the "Register" button.

[0417] The terminal sends this information to the server.

[0418] Input: Name, Email Address, Password

[0419] Output: Sending registration information to the server

[0420] How it works: The user enters information into the registration form and presses the "Register" button. The device encrypts the information and sends it to the server.

[0421] Step 3: The server generates an authentication token and returns it to the device.

[0422] The server stores the received information in a database, generates an authentication token, and returns it to the terminal.

[0423] Input: User basic information

[0424] Output: Authentication token

[0425] How it works: The server generates an authentication token in JWT format and sends it to the device.

[0426] Step 4: User selects a virtual travel companion character

[0427] After logging in, the user moves to a screen for selecting a virtual travel companion character and selects the character of their choice.

[0428] The terminal sends this information to the server.

[0429] Input: Character selection information

[0430] Output: Character information sent to the server

[0431] Action: The user taps a character to select it and presses the "Confirm" button. The device sends the selection information to the server.

[0432] Step 5: The server confirms the character settings and has the generated AI load the response template.

[0433] The server saves the selected character information in a database and has the generation AI load a response template.

[0434] Input: Character selection information

[0435] Output: Loading response template

[0436] How it works: The server saves character information to a database and sends a request to the generative AI engine to load a response template.

[0437] Step 6: User enters travel story and sends it to virtual travel friends

[0438] The user enters the events and experiences that occurred during the trip in text or image format and presses the "Send" button.

[0439] The terminal forwards this information to the server.

[0440] Input: Travel story (text, images)

[0441] Output: Sending information to the server

[0442] Operation: The user inputs an episode and presses the "Send" button. The device transfers the data to the server.

[0443] Step 7: The server asks the generation AI to generate a response

[0444] The server requests the received episode information from the generation AI and has it generate a response.

[0445] Input: Travel episode information

[0446] Output: The generated response

[0447] How it works: The server passes episode information to the generation AI and asks for an appropriate response.

[0448] Step 8: Send the generated response to the user

[0449] Generative AI analyzes user input and generates a response.

[0450] The server sends this response to the terminal, where it is received by the user.

[0451] Input: Request to generate a response

[0452] Output: The response sent to the user

[0453] How it works: The generation AI generates a response and sends it to the device via the server. The user then checks the response on the screen.

[0454] Step 9: The user enters a question that determines the next action.

[0455] The user enters a question to determine the next action and presses the submit button.

[0456] The terminal sends this question to the server.

[0457] Input: Next Action Question

[0458] Output: Send a query to the server

[0459] How it works: The user enters a question into the text input field and presses the "Submit" button. The device sends the question to the server.

[0460] Step 10: The server sends the question to the AI ​​generator and receives the answer.

[0461] The server passes the received question information to the generation AI and requests an appropriate answer.

[0462] Input: Question information

[0463] Output: The generated answer

[0464] How it works: The server sends the question information to the generation AI and requests an appropriate answer.

[0465] Step 11: Send the generated answer to the user

[0466] The generation AI generates answers to questions, and the server sends them to the device.

[0467] The user receives the answer.

[0468] Input: Request to generate a response

[0469] Output: The answer sent to the user

[0470] How it works: The generation AI generates an answer and sends it to the device via the server. The user then checks the answer on the screen.

[0471] Step 12: User requests trip summary

[0472] The user requests a "trip summary."

[0473] The terminal sends this request to the server.

[0474] Input: Travel summary request

[0475] Output: Send request to server

[0476] Operation: The user presses the "Travel Summary" button, and the device sends the request information to the server.

[0477] Step 13: The server collects chat history and images and asks the AI ​​to generate a summary and album.

[0478] The server collects chat history and images and asks the generation AI to create a summary and create an album.

[0479] Input: Travel summary request

[0480] Output: Generate summary and album

[0481] How it works: The server collects information from the database and asks the generation AI to generate a summary and album.

[0482] Step 14: The server generates a download link to provide the generated album to the user.

[0483] The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user.

[0484] Input: Request for summary and album generation

[0485] Output: Download link

[0486] How it works: The generation AI creates an album, and the server generates a download link to provide to the user.

[0487] Step 15: Recognize user emotions and tailor your response

[0488] The emotion engine recognizes emotions from the text information entered by the user, and the server sends that emotion information to the generation AI, which then generates a response based on the emotion.

[0489] Input: Text information including sentiment

[0490] Output: Emotion-based response

[0491] How it works: The emotion engine extracts emotions, the server sends the emotion information to the generation AI, which generates a response, which is returned to the user via the server.

[0492] (Application example 2)

[0493] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0494] Current travel experience sharing systems often leave users feeling isolated when they input and share their trip details. Furthermore, these systems lack emotional responses and real-time advice, making it difficult to provide personalized experiences tailored to individual needs. Furthermore, even when users enjoy shopping in virtual stores, the experience can feel lonely and lack emotional support.

[0495] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for inputting information about experiences a user has had during a trip; means for transmitting the input information to the server; means for the server to collect the information and request a generated response from a generation AI; means for the generation AI to generate the response and return the response to the user via the server; means for generating a summary and album of the trip based on the user's input information and response content; means for providing the album to the user; and emotion recognition means for recognizing the user's emotions and generating a response according to the emotions. This allows users to enjoy a personalized experience tailored to their individual emotions and needs when traveling alone or shopping in a virtual store, thereby reducing their sense of loneliness.

[0496] "User" refers to an individual who uses the system to input their experience and receive responses and services from the system.

[0497] "Information experienced during travel" refers to events experienced, things seen and heard by the user during travel, input in the form of text or images.

[0498] "Server" refers to a computer system that receives and processes information sent by users and requests it to the generating AI.

[0499] "Generative AI" refers to an artificial intelligence system that generates appropriate responses based on input information from the user.

[0500] "User input information" refers to information such as text and images that a user inputs into the system.

[0501] "Response content" refers to the response text and recommendations generated by the generation AI based on the user's input information.

[0502] The "trip summary" refers to text information that is a compilation of the user's input information and their responses.

[0503] "Album" refers to a digital photo book or slide show that compiles and visually presents a user's travel experience.

[0504] "Emotion recognition means" refers to technology for identifying emotions from user input information and adjusting the generative AI's response based on that.

[0505] The term "virtual travel buddy" refers to a virtual character that is set based on the user's selection and that interacts with the user.

[0506] "Response template" refers to a response pattern prepared in advance based on the character settings of the virtual travel companion.

[0507] "Virtual store" refers to a virtual shopping space where users can browse products and consider purchasing within a digital environment.

[0508] "Product information" refers to the features and detailed information of a product that a user inputs or obtains in a virtual store.

[0509] This invention is a system for sharing the travel experiences of solo travelers and reducing feelings of loneliness. It also aims to make shopping in a virtual store a more personal experience. This system is realized using a server, a generation AI, an emotion recognition means, and other components. Specific embodiments are described below.

[0510] Hardware and software used

[0511] Hardware: Smart glasses, head-mounted displays

[0512] Software: Generative AI model (OpenAI GPT-4), emotion recognition engine, database (PostgreSQL), cloud server (AWS or Google Cloud)

[0513] System configuration

[0514] User Registration and Login

[0515] Users create an account by entering basic information through an application installed on their smart glasses or head-mounted display. The server receives this information, stores it in a database, and generates an authentication token, which it returns to the user.

[0516] Setting up virtual friends

[0517] After the user logs in, a screen appears where they can select a virtual friend character. For example, the user can choose a friend who is knowledgeable about fashion or interior design. The server saves the selected information in a database and loads a response template into the generation AI.

[0518] Sharing your shopping experience

[0519] Users enter information about products they see in a virtual store using text and images and send it to their virtual friends. The server receives this information and passes it on to the generation AI, which analyzes the user's input and generates an appropriate response. For example, in response to a user's question, "What do you think of this dress?", the AI ​​responds, "It looks great on you! What do you particularly like about it?"

[0520] Real-time conversation and question answering

[0521] When a user asks a question about where to go next or what to buy in the virtual store, the server passes the question to the generation AI, which then generates an appropriate answer and sends it back to the user. For example, in response to the question, "What product should I look at next?", the AI ​​might respond, "There's a section for the latest gadgets nearby, so be sure to check it out."

[0522] Shopping summary and album generation

[0523] After shopping, if the user requests it, the server will collect the chat history and images and ask the AI ​​to create a summary and album. The generated album will be provided to the user as a download link.

[0524] Response adjustment using emotion engine

[0525] It uses an emotion engine that recognizes emotions from user input. For example, in response to a message such as "I'm a little tired today, but it was fun," the emotion engine extracts "tiredness" and "fun," and the generating AI responds with, "Today was tough, wasn't it? But I'm glad you had fun. In the next section, find an item that will refresh you."

[0526] Specific examples

[0527] If a user sends a message saying "What do you think of this dress?" along with a picture of the dress, the AI ​​will respond with "It looks great on you! What do you like about it?" The AI ​​will be prompted with the following prompt:

[0528] User message: "What do you think of this dress?"

[0529] Emotion Engine result: "Positive emotion"

[0530] Prompt for generative AI: "A user submits a picture of a new dress and asks for their opinion. It shows positive emotion. Your response should be something like, 'It looks great on you! What do you like about it?'"

[0531] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0532] Processing Steps

[0533] Step 1: User Registration and Login

[0534] Input: User information (name, email address, password)

[0535] How it works: A user enters basic information through an application installed on a smart pair of glasses or a head-mounted display.

[0536] Data processing: The terminal sends the entered information to the server, which then stores the data in a database.

[0537] Output: The server returns the generated authentication token to the user, logging them in.

[0538] Step 2: Setting up virtual friends

[0539] Input: Character selection information (e.g., a friend who is knowledgeable about fashion, a friend who is knowledgeable about interior design)

[0540] How it works: After a user logs in, they select a character for their virtual friend.

[0541] Data processing: The device sends the character selection information to the server, which stores it in a database.

[0542] Output: The server loads a response template into the generated AI based on the selected character settings.

[0543] Step 3: Share your shopping experience

[0544] Input: Product information (text, image)

[0545] How it works: A user enters and submits information about a product they saw in a virtual store.

[0546] Data processing: The terminal sends product information to the server, which then passes the information to the generation AI.

[0547] Output: The generation AI generates an appropriate response and sends it to the user via the server.

[0548] Step 4: Real-time conversation and question answering

[0549] Input: User question (e.g., "What product should I look at next?")

[0550] How it works: The user asks questions about where to go next and what to buy in the virtual store.

[0551] Data processing: The device sends the question to the server, which then passes the question to the generation AI.

[0552] Output: The generation AI generates an appropriate answer and sends it back to the user via the server.

[0553] Step 5: Shopping summary and album creation

[0554] Input: Shopping completion notification

[0555] How it works: A user requests a summary after completing their shopping.

[0556] Data processing: The server collects chat history and images and asks the generation AI to summarize and create an album.

[0557] Output: The generated album is provided to the user as a download link.

[0558] Step 6: Adjusting responses using the emotion engine

[0559] Input: User message (e.g. "Today was a little tiring, but fun.")

[0560] How it works: The emotion recognition engine identifies emotions from the user's messages.

[0561] Data processing: Emotional information is passed to a generative AI, which generates a response based on the emotion.

[0562] Output: A response according to the generated emotion is sent back to the user via the server.

[0563] Specific examples

[0564] When a user submits a product request such as "What do you think of this dress?":

[0565] Input: Message from user: "What do you think of this dress?"

[0566] Action: The device sends a message to the server.

[0567] Data processing: The server passes the message to the generation AI, which analyzes the data to generate a response.

[0568] Output: The generated AI responds, "It looks great! What do you like about it?" and sends it back to the user via the server.

[0569] Examples of prompts:

[0570] User message: "What do you think of this dress?"

[0571] Emotion Engine result: "Positive emotion"

[0572] Prompt for generative AI: "A user submits a picture of a new dress and asks for their opinion. It shows positive emotion. Your response should be something like, 'It looks great on you! What do you like about it?'"

[0573] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0574] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0575] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0576] [Second embodiment]

[0577] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0578] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0579] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0580] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0581] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0582] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0583] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0584] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0585] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0586] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0587] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0588] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0589] The present invention is a system called "virtual travel buddies" that can reduce the sense of loneliness felt by users traveling alone and allow them to freely share travel experiences. A specific embodiment of this system is described below.

[0590] Program processing and specific examples

[0591] 1. User Registration and Login

[0592] A user installs and launches an application. When using it for the first time, the user enters basic information such as name, email address, and password to create an account. The device sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[0593] 2. Selecting virtual travel companions

[0594] After logging in, the user opens a screen to select the character of their virtual travel buddy. For example, they can choose between an adventurous friend or a culturally knowledgeable friend. After selection, the device sends the character information to the server. The server stores this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the character settings.

[0595] 3. Sharing travel stories

[0596] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[0597] As a specific example, when a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[0598] 4. Real-time conversation and question answering

[0599] When deciding on their next move during their journey, the user inputs a question, and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. For example, in response to the question, "Where should we go next?", the generation AI generates the answer, "There's a beautiful garden nearby, so be sure to visit it," and sends it to the user via the server. The user then plans their next move based on this information.

[0600] 5. Travel summary and album creation

[0601] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[0602] Specifically, the system sends a response saying, "You had a great trip today. I'll make an album for you," and generates a digital album that compiles the chat history and images. This album is provided to the user as part of a memorable trip.

[0603] ---

[0604] In this way, the present invention utilizes generative AI to provide a system that allows solo travelers to freely share their memories and receive responses in real time, thereby reducing loneliness and allowing them to enjoy their trip with peace of mind without losing the benefits of solo travel.

[0605] The processing flow will be explained below.

[0606] User Registration and Login

[0607] Step 1:

[0608] The user installs and launches the application and selects the "New Registration" button from the home screen.

[0609] Step 2:

[0610] The user enters basic information such as name, email address, and password, which is then stored on the device.

[0611] Step 3:

[0612] The device sends the entered information to the server using the HTTPS protocol.

[0613] Step 4:

[0614] The server saves the received information in the database using SQL commands.

[0615] Step 5:

[0616] The server generates an authentication token and returns it to the device. The token is generated using JWT (Json Web Token).

[0617] Step 6:

[0618] The terminal stores the authentication token and keeps the user logged in.

[0619] Selecting virtual travel companions

[0620] Step 1:

[0621] After the user logs in, the virtual travel buddy character selection screen opens, and a list of characters is displayed.

[0622] Step 2:

[0623] The user selects a character and presses the "OK" button. The selected character information is saved on the device.

[0624] Step 3:

[0625] The device sends the selected character information to the server using an HTTP POST request.

[0626] Step 4:

[0627] The server saves the character selection information to the database using the INSERT SQL command.

[0628] Step 5:

[0629] The server determines the user's character settings and loads a response template based on those settings into the generation AI.

[0630] Sharing travel stories

[0631] Step 1:

[0632] Users can enter text or images of their travel experiences and send them to their virtual travel buddies using the app's chat interface.

[0633] Step 2:

[0634] The device transfers the input message and image data to the server using an HTTP POST request.

[0635] Step 3:

[0636] The server passes the received data to the generation AI and requests it to generate a response. Data transfer uses an API.

[0637] Step 4:

[0638] Generative AI analyzes the user's message and generates an appropriate response, using natural language processing technology.

[0639] Step 5:

[0640] The server sends the generated response to the terminal using an HTTP response.

[0641] Step 6:

[0642] Users receive responses and continue the conversation, enabling real-time shared experiences.

[0643] Real-time conversation and question answering

[0644] Step 1:

[0645] The user enters a question to determine the next action, using the in-app chat interface.

[0646] Step 2:

[0647] The device sends the user's question to the server using an HTTP POST request.

[0648] Step 3:

[0649] The server passes the question to the AI ​​generator and requests it to generate a response. Data is transferred using an API.

[0650] Step 4:

[0651] Generative AI analyzes questions and generates appropriate answers, using knowledge databases and search engines for analysis and generation.

[0652] Step 5:

[0653] The server sends the generated answer to the terminal using an HTTP response.

[0654] Step 6:

[0655] The user receives the answer and uses that information to plan their next steps, ensuring smooth travel.

[0656] Travel summary and album creation

[0657] Step 1:

[0658] The user sends a message to the chatbot requesting a "trip summary," using the in-app chat interface.

[0659] Step 2:

[0660] The device sends a request message to the server using an HTTP POST request.

[0661] Step 3:

[0662] The server collects the chat history and images sent using a database query.

[0663] Step 4:

[0664] The server passes the collected data to the AI ​​generator and requests it to summarize and generate an album. Data transfer is performed using an API.

[0665] Step 5:

[0666] Generative AI analyzes chat history and images to create text summaries and album pages, using machine learning algorithms for analysis and generation.

[0667] Step 6:

[0668] The server generates a download link for the created album to provide it to the user. The link generation is performed using a web service.

[0669] Step 7:

[0670] The server sends the download link to the device using an HTTP response.

[0671] Step 8:

[0672] The user receives a download link and downloads the generated album, which contains a summary of the trip and images.

[0673] Example 1

[0674] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0675] Traditionally, solo travelers have often felt lonely and had no one to share their travel experiences with, which often prevented them from fully enjoying their trip. They also had difficulty gathering information and making decisions during their trip. There is a need for a system that can solve these problems and help travelers enjoy their trips more while reducing feelings of loneliness.

[0676] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0677] In this invention, the server includes a means for inputting information about experiences during a trip, a means for transmitting the input information to the server, and a means for collecting the information and requesting a response from the generation AI. This allows the user to reduce feelings of loneliness and share their travel experiences. Furthermore, by sending questions to the generation AI and receiving appropriate responses in real time, the server facilitates decision-making during the trip. Furthermore, the server also includes a means for generating a summary and album of the trip based on the user's input information and responses, and providing them to the user, allowing the user to reminisce about their solo travel memories.

[0678] "User" refers to an individual who uses the system, primarily a traveler traveling alone.

[0679] "Terminal" refers to a computing device used by a user, such as a smartphone or tablet.

[0680] "Server" refers to a central processing unit that receives, processes, stores, and generates necessary responses from data sent by terminals.

[0681] "Generative AI" refers to an artificial intelligence model that analyzes information input by a user and generates an appropriate response based on that information.

[0682] An "authentication token" refers to secure authentication information that is returned from a server to a terminal to keep the user logged in.

[0683] "Database" refers to a system installed on a server for storing user information, character setting information, etc.

[0684] "Character" refers to a virtual person with various personalities and characteristics that a user selects as a virtual travel companion.

[0685] "Response template" refers to the basic pattern of the response that the generation AI generates based on the character of the virtual travel companion.

[0686] "Trip summary" refers to a summary of the trip that is generated based on the information entered by the user during the trip and the response from the server.

[0687] An "album" refers to a digital booklet that compiles images taken by the user during their trip and information entered by the user, and includes a summary of the trip generated by the generative AI.

[0688] "Question" refers to a textual inquiry that a user enters to determine their next action during their journey.

[0689] "Download link" refers to the web link provided by the server for the user to obtain the generated album.

[0690] "Application" refers to software that users install on their devices and use.

[0691] The present invention is a system called "virtual travel buddies" that can reduce the sense of loneliness felt by users traveling alone and allow users to freely share their travel experiences. A specific embodiment of this system is described below.

[0692] User Registration and Login

[0693] A user installs and launches an application on their smartphone or tablet. When using the application for the first time, the user creates an account by entering basic information such as their name, email address, and password. The device then sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[0694] Hardware and Software Used

[0695] Hardware: Smartphone or tablet

[0696] Software: iOS / Android applications, HTTP protocol, database systems (e.g., MySQL)

[0697] Specific examples

[0698] When a user creates an account under the name "John Smith" and signs in, the server stores John Smith's information in a database and sends an authentication token back to the terminal.

[0699] Selecting virtual travel companions

[0700] After logging in, the user opens a screen to select the character of their virtual travel buddy. For example, they can choose between an adventurous friend or a culturally knowledgeable friend. After selection, the device sends the character information to the server. The server saves this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the character settings.

[0701] Hardware and Software Used

[0702] Hardware: Smartphone or tablet

[0703] Software: Database management systems, generative AI (e.g., GPT-3)

[0704] Specific examples

[0705] When the user selects "adventurous friend," the server sets the friend as adventurous and has the generation AI load a response template appropriate for that character.

[0706] Sharing travel stories

[0707] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[0708] Hardware and Software Used

[0709] Hardware: Smartphone or tablet, cloud server

[0710] Software: Image analysis tools, generative AI (e.g., GPT-3)

[0711] Specific examples

[0712] When a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[0713] Real-time conversation and question answering

[0714] When a user decides on their next move during their journey, they input a question and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. The generated answer is sent to the user via the server, and the user uses this information to plan their next move.

[0715] Hardware and Software Used

[0716] Hardware: Smartphone or tablet, cloud server

[0717] Software: Generative AI (e.g., GPT-3)

[0718] Specific examples

[0719] When a user types, "Where should we go next?", the generating AI responds, "There's a beautiful garden nearby, so be sure to visit it," and sends this to the user via the server.

[0720] Travel summary and album creation

[0721] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests a generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[0722] Hardware and Software Used

[0723] Hardware: Smartphone or tablet, cloud server

[0724] Software: Generative AI (e.g., GPT-3)

[0725] Specific examples

[0726] The response is, "You had a great trip today. I'll make an album for you," and a digital album is generated that includes the chat history and photos. This album is then made available to the user as part of a memorable trip.

[0727] ---

[0728] In this way, the present invention utilizes generative AI to provide a system that allows solo travelers to freely share their memories and receive responses in real time, thereby reducing loneliness and allowing them to enjoy their trip with peace of mind without losing the benefits of solo travel.

[0729] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0730] Step 1: User Registration and Login

[0731] explanation

[0732] A user installs and launches an application on their smartphone or tablet. They create an account by entering basic information such as their name, email address, and password. The device sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[0733] Input and Output

[0734] Input: Name, Email Address, Password

[0735] Data processing: validation and storage of entered information

[0736] Output: Authentication token

[0737] Specific actions

[0738] A user creates an account under the name "John Smith," the server stores John Smith's information in a database, generates an authentication token, and sends it back to the terminal, which automatically logs the user in.

[0739] Step 2: Selecting virtual travel companions

[0740] explanation

[0741] After logging in, the user opens a screen to select a virtual travel buddy character. The user selects their preferred character from the provided options. The device sends the selected character information to the server. The server saves this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the set character.

[0742] Input and Output

[0743] Input: Character selection information

[0744] Data processing: Saving character information and loading templates

[0745] Output: Character settings confirmed

[0746] Specific actions

[0747] When the user selects "adventurous friend," the server stores this in a database and loads a response template based on the generated AI.

[0748] Step 3: Share your travel stories

[0749] explanation

[0750] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[0751] Input and Output

[0752] Input: Text and image information

[0753] Data processing: Analysis of input information and response generation

[0754] Output: The generated response

[0755] Specific actions

[0756] When a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the generation AI, which then generates a response saying, "That's a beautiful photo! What impressed you about the castle?" and returns it to the user via the server.

[0757] Step 4: Real-time conversation and question answering

[0758] explanation

[0759] When a user decides on their next move during their journey, they input a question and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. The generated answer is sent to the user via the server, and the user uses this information to plan their next move.

[0760] Input and Output

[0761] Input: Question text

[0762] Data processing: Question analysis and answer generation

[0763] Output: The generated answer

[0764] Specific actions

[0765] When a user types, "Where should we go next?", the generating AI responds, "There's a beautiful garden nearby, so be sure to visit it," and sends this to the user via the server.

[0766] Step 5: Summarize your trip and create an album

[0767] explanation

[0768] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[0769] Input and Output

[0770] Input: Bulk request

[0771] Data processing: Chat history and image collection, summarization, and album creation

[0772] Output: Download link

[0773] Specific actions

[0774] When a user types "Please summarize my trip," the server collects chat history and images and passes them to the AI ​​generator, which then generates a digital album with the response "Today was a great trip. I'll create an album for you," and the server provides the user with a download link.

[0775] (Application example 1)

[0776] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0777] In modern society, many people feel lonely when eating alone. In particular, when using food delivery services, there is a lack of experience enjoying a meal alone, making it difficult to obtain psychological satisfaction. Another problem is that when dining out, there are limited ways to obtain food reviews or advice on what dishes to try next.

[0778] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0779] In this invention, the server includes means for inputting information about the user's experience, means for transmitting the input information to the server, means for the server to collect the information and request a generated response from a generation AI, means for the generation AI to generate the response and return the response to the user via the server, means for generating a summary and an album based on the user's input information and response content, means for providing the album to the user, and means for sharing food delivery experiences as virtual gourmet friends and generating responses. This makes it possible to reduce loneliness even when dining alone through interactive interaction, thereby enriching the dining experience.

[0780] "User" means an individual who uses the system to input experience information and share their food delivery experience.

[0781] "Experience information" is data such as text and images related to travel and meals entered by the user.

[0782] A "server" is a centralized computer system that receives information sent by a user, requests a generation AI to generate a response, and sends it back to the user.

[0783] "Generative AI" is an artificial intelligence technology that generates appropriate responses based on information sent by the user.

[0784] A "response template" is a set of predetermined response patterns that the generation AI uses based on the character settings.

[0785] A "summary" is a document that compactly summarizes the information entered by the user and the contents of the conversation.

[0786] An "album" is a digital record of travel and dining experiences.

[0787] A "virtual gourmet friend" is a virtual character that shares the food delivery experience and responds to the user.

[0788] A "question" is a question that a user inputs into the system to determine the next action or recommendation.

[0789] An "answer" is the answer that the generation AI generates to a question.

[0790] This invention is a system called "Virtual Gourmet Friends" that enriches the food delivery experience and reduces loneliness. The system aims to provide a more enjoyable dining experience by allowing users to interact with virtual gourmet friends while enjoying food delivery and share their experiences.

[0791] System configuration

[0792] The system consists of the following main components:

[0793] User device: A device that is directly used by a user, such as a smartphone or tablet.

[0794] Server: A centralized computer system that works in conjunction with user devices to process data, request generation AI, and store and transmit data.

[0795] Generative AI model: An artificial intelligence technique that generates appropriate responses based on input from users.

[0796] Database: A system that stores data such as user information, experience information, and response templates.

[0797] System Operation

[0798] 1. User registration and login: When a user uses the system for the first time, they register by entering their name, email address, and password via their smartphone. The registration information is sent to the server and stored in the database. The user then enters their login information and obtains an authentication token to complete the login process.

[0799] 2. Selecting a virtual gourmet friend: After logging in, the user selects a character for their virtual gourmet friend on the system screen. For example, they can choose a friend who loves cooking or a friend who loves adventure. The selected character information is sent to the server and stored in the database. A response template is also loaded based on this information.

[0800] 3. Sharing food stories: Users can input their experiences using food delivery services as text and photos and send them to the system. For example, they can send a message like, "I had some amazing sushi delivered to me. I'll send you a photo too." This is sent to the server, and the AI ​​generates an appropriate response (e.g., "That sushi looks delicious! Where did you order it from?") and sends it back to the user.

[0801] 4. Question Answering: When a user inputs a question about their next meal or recommended dishes, the question is sent to the generation AI via the server. The generation AI generates an appropriate answer and sends it back to the user. For example, the response to the question "What's your recommended next dish?" may be "I recommend the pizza at a nearby restaurant."

[0802] 5. Meal summary and album generation: After a user has finished a meal experience, they can request an album to be generated that summarises the experience. Based on the chat history and images, the AI ​​generates a summary and album and provides it to the user. The user can then download the album using the download link.

[0803] This process allows users to interact with virtual gourmet friends while enjoying food delivery, reducing feelings of loneliness and allowing them to have a good time.

[0804] Specific examples

[0805] User: "I had some amazing sushi delivered. I'll send you a photo."

[0806] Generative AI: "That sushi looks delicious! Where did you order it from?"

[0807] In this way, the generating AI responds to the experience information entered by the user, making it possible to interact with virtual gourmet friends.

[0808] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0809] Step 1:

[0810] A user uses a smartphone to register by entering their name, email address, and password. The entered information is sent from the device to the server and stored in a database. When registration is successful, the server generates an authentication token and returns it to the device. Upon receiving this authentication token, the user can log in.

[0811] Step 2:

[0812] Once logged in, the user selects a character for their virtual gourmet friend. For example, options such as "friend who loves to cook" are displayed. Once the user selects a character, the device sends this information to the server. The server stores this character setting information in a database and asks the generative AI model to load a response template. The generative AI model loads the appropriate response template based on the selected character and makes it available for use.

[0813] Step 3:

[0814] A user orders food delivery and enters their dining experience using text and photos. For example, they might enter, "I had some great sushi delivered. I'll send you some photos." The device then sends this information to a server. The server then passes the received text and photos to a generative AI model, asking it to generate an appropriate response. The generative AI model analyzes the input and generates a response such as, "That sushi looks delicious! Where did you order it from?" This response is then returned to the user via the server.

[0815] Step 4:

[0816] The user inputs a question about the next dish or restaurant they should try. For example, "What's your next recommended dish?" The device sends the question to the server, which passes it on to the generative AI model. The generative AI model analyzes the question and generates an appropriate answer, such as "I recommend the pizza at a nearby restaurant." This answer is then sent back to the user via the server.

[0817] Step 5:

[0818] After the user finishes their dining experience, they request the creation of a summary and album. This request is sent from the user's device to the server. The server collects the chat history and images and asks the generative AI model to create a summary and album. The generative AI model analyzes the data and creates a summary and a digital album. This album is made available to the user via a download link provided via the server.

[0819] Step 6:

[0820] The user uses the download link to retrieve a digital album containing summaries and photos of their dining experiences, allowing them to reminisce about fond memories.

[0821] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0822] The present invention is a system called "Virtual Travel Buddy" that reduces the sense of loneliness felt by users traveling alone, allows users to freely share their travel experiences, recognizes the user's emotions, and adjusts responses accordingly. A specific embodiment of this system is described below.

[0823] Program processing and specific examples

[0824] 1. User Registration and Login

[0825] A user installs and launches an application. When using it for the first time, the user enters basic information such as name, email address, and password to create an account. The device sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[0826] 2. Selecting virtual travel companions

[0827] After logging in, the user opens a screen to select the character of their virtual travel buddy. For example, they can choose between an adventurous friend or a culturally knowledgeable friend. After selection, the device sends the character information to the server. The server stores this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the character settings.

[0828] 3. Sharing travel stories

[0829] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[0830] As a specific example, when a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[0831] 4. Real-time conversation and question answering

[0832] When deciding on their next move during their journey, the user inputs a question, and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. For example, in response to the question, "Where should we go next?", the generation AI generates the answer, "There's a beautiful garden nearby, so be sure to visit it," and sends it to the user via the server. The user then plans their next move based on this information.

[0833] 5. Travel summary and album creation

[0834] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[0835] Specifically, the system sends a response saying, "You had a great trip today. I'll make an album for you," and generates a digital album that compiles the chat history and images. This album is provided to the user as part of a memorable trip.

[0836] 6. Response adjustment using emotion engine

[0837] To further reflect the user's emotions during the journey, an emotion engine is built in. It recognizes emotions from the text information entered by the user. For example, if the message "Today was tiring but fun" is received, the emotion engine will extract the emotions of "tiredness" and "fun."

[0838] The server sends this emotional information to the AI ​​generator, which then generates a response based on the emotion. The AI ​​generator generates a response such as, "It seems like you had a hard day today. But I'm glad you had fun. Shall we find a place to refresh yourself?" The server then sends this response to the device, where the user receives it.

[0839] This enables interactions that are emotionally fulfilling for the user. For example, if a user inputs, "I felt a little lonely today," the server passes this information to the emotion engine and the generation AI, which then generates an encouraging response such as, "That was tough. But I'm sure you'll have a wonderful experience at your next location." This response is then returned to the user via the server.

[0840] In this way, the present invention utilizes generative AI and an emotion engine to provide a system that allows solo travelers to freely share their memories and receive reliable responses, thereby reducing loneliness without compromising the benefits of solo travel and providing an emotionally sensitive travel experience.

[0841] The processing flow will be explained below.

[0842] User Registration and Login

[0843] Step 1:

[0844] The user installs and launches the application and selects the "New Registration" button from the home screen.

[0845] Step 2:

[0846] The user enters basic information such as name, email address, and password, which is then stored on the device.

[0847] Step 3:

[0848] The device sends the entered information to the server using the HTTPS protocol.

[0849] Step 4:

[0850] The server saves the received information in the database using SQL commands.

[0851] Step 5:

[0852] The server generates an authentication token and returns it to the device. The token is generated using JWT (Json Web Token).

[0853] Step 6:

[0854] The terminal stores the authentication token and keeps the user logged in.

[0855] Selecting virtual travel companions

[0856] Step 1:

[0857] After the user logs in, the virtual travel buddy character selection screen opens, and a list of characters is displayed.

[0858] Step 2:

[0859] The user selects a character and presses the "OK" button. The selected character information is saved on the device.

[0860] Step 3:

[0861] The device sends the selected character information to the server using an HTTP POST request.

[0862] Step 4:

[0863] The server saves the character selection information to the database using the INSERT SQL command.

[0864] Step 5:

[0865] The server determines the user's character settings and loads a response template based on those settings into the generation AI.

[0866] Sharing travel stories

[0867] Step 1:

[0868] Users can enter text or images of their travel experiences and send them to their virtual travel buddies using the app's chat interface.

[0869] Step 2:

[0870] The device transfers the input message and image data to the server using an HTTP POST request.

[0871] Step 3:

[0872] The server passes the received data to the generation AI and requests it to generate a response. Data transfer uses an API.

[0873] Step 4:

[0874] Generative AI analyzes the user's message and generates an appropriate response, using natural language processing technology.

[0875] Step 5:

[0876] The server sends the generated response to the terminal using an HTTP response.

[0877] Step 6:

[0878] Users receive responses and continue the conversation, enabling real-time shared experiences.

[0879] Real-time conversation and question answering

[0880] Step 1:

[0881] The user enters a question to determine the next action, using the in-app chat interface.

[0882] Step 2:

[0883] The device sends the user's question to the server using an HTTP POST request.

[0884] Step 3:

[0885] The server passes the question to the AI ​​generator and requests it to generate a response. Data is transferred using an API.

[0886] Step 4:

[0887] Generative AI analyzes questions and generates appropriate answers, using knowledge databases and search engines for analysis and generation.

[0888] Step 5:

[0889] The server sends the generated answer to the terminal using an HTTP response.

[0890] Step 6:

[0891] The user receives the answer and uses that information to plan their next steps, ensuring smooth travel.

[0892] Travel summary and album creation

[0893] Step 1:

[0894] The user sends a message to the chatbot requesting a "trip summary," using the in-app chat interface.

[0895] Step 2:

[0896] The device sends a request message to the server using an HTTP POST request.

[0897] Step 3:

[0898] The server collects the chat history and images sent using a database query.

[0899] Step 4:

[0900] The server passes the collected data to the AI ​​generator and requests it to summarize and generate an album. Data transfer is performed using an API.

[0901] Step 5:

[0902] Generative AI analyzes chat history and images to create text summaries and album pages, using machine learning algorithms for analysis and generation.

[0903] Step 6:

[0904] The server generates a download link for the created album to provide it to the user. The link generation is performed using a web service.

[0905] Step 7:

[0906] The server sends the download link to the device using an HTTP response.

[0907] Step 8:

[0908] The user receives a download link and downloads the generated album, which contains a summary of the trip and images.

[0909] Response adjustment using emotion engine

[0910] Step 1:

[0911] When a user enters a text description of an experience they had during their trip, the emotion engine analyzes the text. For example, "Today was tiring, but it was a lot of fun."

[0912] Step 2:

[0913] The device sends the entered text to the server using an HTTP POST request.

[0914] Step 3:

[0915] The server passes the received text data to the emotion engine, which analyzes the emotions using natural language processing technology.

[0916] Step 4:

[0917] The emotion engine extracts the emotions of "fatigue" and "enjoyment" and passes that emotional data to the generation AI.

[0918] Step 5:

[0919] Based on the emotional data, the generative AI generates a response such as, "It seems like today was tough. But I'm glad you had fun. Shall we find a place to refresh again?"

[0920] Step 6:

[0921] The server sends the generated response to the terminal using an HTTP response.

[0922] Step 7:

[0923] The user receives the response and plans their next course of action. An emotionally sensitive response leaves the user feeling fulfilled.

[0924] Example 2

[0925] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0926] Solo travelers often feel lonely. It is difficult for them to freely share their travel experiences and emotions in real time and receive reliable responses based on their experiences. Furthermore, there is a lack of suitable tools for easily creating comprehensive summaries and albums at the end of a trip.

[0927] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for inputting information about the user's experiences during the trip; means for transmitting the input information to the server; means for the server to collect the information and request a generated response from a generation AI; means for the generation AI to generate the response and return the response to the user via the server; means for generating a travel summary and album based on the user's input information and response content; means for providing the album to the user; and means including an emotion engine for recognizing the user's emotions and adjusting the response. This allows solo travelers to reduce their sense of loneliness and receive reliable responses based on their emotions in real time. Furthermore, a comprehensive summary and album can be easily created and provided at the end of the trip.

[0928] A "user" is an individual who has registered to use the system and is actively traveling.

[0929] A "server" is a computer system that receives and processes information sent by users and requests the generation AI to generate a response.

[0930] "Terminal" means a device operated by a user, and is a device for inputting, sending, and receiving information.

[0931] "Generative AI" is an artificial intelligence technology that generates appropriate responses based on information entered by the user.

[0932] An "emotion engine" is a technology that recognizes emotions from the user's input text and allows the generative AI to generate a response that corresponds to the emotion.

[0933] A "virtual travel buddy" is a character selected by the user, who is a virtual friend who interacts with the user.

[0934] A "response template" is a dialogue template that is generated based on the character settings of the virtual travel companion.

[0935] An "album" is a digital record of a user's travel experiences and chat history, and is used to preserve travel memories.

[0936] The "trip summary" is information that the user puts together at the end of the trip, and provides a concise overview of the trip.

[0937] An "authentication token" is identification data generated by a server to allow a user to maintain a logged-in state.

[0938] The present invention is a "virtual travel buddy" system that reduces the sense of loneliness felt by users traveling alone, and recognizes the user's emotions and adjusts responses while freely sharing travel experiences. Specific embodiments for implementing this system are described below.

[0939] User Registration and Login

[0940] A user installs and launches a dedicated application on their mobile device. They create an account by entering basic information such as their name, email address, and password. The device sends this information to a server, which stores it in a database. An authentication token is generated and returned to the device, allowing the user to remain logged in.

[0941] Selecting virtual travel companions

[0942] After logging in, the user is presented with a screen to select a character for their virtual travel buddy. They can choose from multiple characters, such as an adventurous friend or a culturally knowledgeable friend. The selected character information is sent from the device to the server, which stores this information in a database. The server then loads a response template based on the selected character into the generated AI.

[0943] Sharing travel stories

[0944] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[0945] As a specific example, when a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[0946] Real-time conversation and question answering

[0947] When a user decides on their next move during their journey, they input a question. The device sends this question to the server, which passes it on to the generation AI. The generation AI generates an appropriate answer and sends it to the user via the server. For example, in response to the question, "Where should we go next?", the generation AI generates the answer, "There's a beautiful garden nearby, so be sure to visit it."

[0948] Travel summary and album creation

[0949] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[0950] Specifically, the system sends a response saying, "You had a great trip today. I'll make an album for you," and generates a digital album that compiles the chat history and images. This album is provided to the user as part of a memorable trip.

[0951] Response adjustment using emotion engine

[0952] An emotion engine is built in to reflect the user's emotions during the journey. Emotions are recognized from the text information entered by the user. For example, if the message "Today was tiring, but fun" is received, the emotion engine will extract the emotions of "tiredness" and "fun."

[0953] The server sends this emotional information to the AI, which then generates a response based on the emotion. The AI ​​generates a response such as, "It seems like you had a hard day today. But I'm glad you had fun. Shall we find a place to refresh yourself?" The server then sends this response to the device, where the user receives it.

[0954] As a specific example, if a user inputs "I felt a little lonely today," the server passes this information to the emotion engine and the generation AI, which then generates an encouraging response such as "That was tough, but I'm sure you'll have a wonderful experience at your next location." This response is then returned to the user via the server.

[0955] Prompt Sentence Examples

[0956] Type: "I saw a beautiful castle today. I'll send you some photos."

[0957] Prompt: "Generate a great response based on this photo."

[0958] As described above, this system uses a generative AI model and an emotion engine to enable solo travelers to freely share their travel experiences and receive emotionally sensitive responses, thereby reducing loneliness without compromising the benefits of solo travel and providing an emotionally sensitive travel experience.

[0959] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0960] Step 1: User installs and launches the application

[0961] The user downloads the dedicated application onto their mobile device, installs it, and then launches it. After installation, the first time they launch it, an account creation screen appears.

[0962] Input: None

[0963] Output: Account creation screen displayed

[0964] How it works: A user downloads an app from the App Store or Google Play Store and taps the install icon to launch it.

[0965] Step 2: User enters basic information to create an account

[0966] The user enters basic information such as name, email address, and password and presses the "Register" button.

[0967] The terminal sends this information to the server.

[0968] Input: Name, Email Address, Password

[0969] Output: Sending registration information to the server

[0970] How it works: The user enters information into the registration form and presses the "Register" button. The device encrypts the information and sends it to the server.

[0971] Step 3: The server generates an authentication token and returns it to the device.

[0972] The server stores the received information in a database, generates an authentication token, and returns it to the terminal.

[0973] Input: User basic information

[0974] Output: Authentication token

[0975] How it works: The server generates an authentication token in JWT format and sends it to the device.

[0976] Step 4: User selects a virtual travel companion character

[0977] After logging in, the user moves to a screen for selecting a virtual travel companion character and selects the character of their choice.

[0978] The terminal sends this information to the server.

[0979] Input: Character selection information

[0980] Output: Character information sent to the server

[0981] Action: The user taps a character to select it and presses the "Confirm" button. The device sends the selection information to the server.

[0982] Step 5: The server confirms the character settings and has the generated AI load the response template.

[0983] The server saves the selected character information in a database and has the generation AI load a response template.

[0984] Input: Character selection information

[0985] Output: Loading response template

[0986] How it works: The server saves character information to a database and sends a request to the generative AI engine to load a response template.

[0987] Step 6: User enters travel story and sends it to virtual travel friends

[0988] The user enters the events and experiences that occurred during the trip in text or image format and presses the "Send" button.

[0989] The terminal forwards this information to the server.

[0990] Input: Travel story (text, images)

[0991] Output: Sending information to the server

[0992] Operation: The user inputs an episode and presses the "Send" button. The device transfers the data to the server.

[0993] Step 7: The server asks the generation AI to generate a response

[0994] The server requests the received episode information from the generation AI and has it generate a response.

[0995] Input: Travel episode information

[0996] Output: The generated response

[0997] How it works: The server passes episode information to the generation AI and asks for an appropriate response.

[0998] Step 8: Send the generated response to the user

[0999] Generative AI analyzes user input and generates a response.

[1000] The server sends this response to the terminal, where it is received by the user.

[1001] Input: Request to generate a response

[1002] Output: The response sent to the user

[1003] How it works: The generation AI generates a response and sends it to the device via the server. The user then checks the response on the screen.

[1004] Step 9: The user enters a question that determines the next action.

[1005] The user enters a question to determine the next action and presses the submit button.

[1006] The terminal sends this question to the server.

[1007] Input: Next Action Question

[1008] Output: Send a query to the server

[1009] How it works: The user enters a question into the text input field and presses the "Submit" button. The device sends the question to the server.

[1010] Step 10: The server sends the question to the AI ​​generator and receives the answer.

[1011] The server passes the received question information to the generation AI and requests an appropriate answer.

[1012] Input: Question information

[1013] Output: The generated answer

[1014] How it works: The server sends the question information to the generation AI and requests an appropriate answer.

[1015] Step 11: Send the generated answer to the user

[1016] The generation AI generates answers to questions, and the server sends them to the device.

[1017] The user receives the answer.

[1018] Input: Request to generate a response

[1019] Output: The answer sent to the user

[1020] How it works: The generation AI generates an answer and sends it to the device via the server. The user then checks the answer on the screen.

[1021] Step 12: User requests trip summary

[1022] The user requests a "trip summary."

[1023] The terminal sends this request to the server.

[1024] Input: Travel summary request

[1025] Output: Send request to server

[1026] Operation: The user presses the "Travel Summary" button, and the device sends the request information to the server.

[1027] Step 13: The server collects chat history and images and asks the AI ​​to generate a summary and album.

[1028] The server collects chat history and images and asks the generation AI to create a summary and create an album.

[1029] Input: Travel summary request

[1030] Output: Generate summary and album

[1031] How it works: The server collects information from the database and asks the generation AI to generate a summary and album.

[1032] Step 14: The server generates a download link to provide the generated album to the user.

[1033] The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user.

[1034] Input: Request for summary and album generation

[1035] Output: Download link

[1036] How it works: The generation AI creates an album, and the server generates a download link to provide to the user.

[1037] Step 15: Recognize user emotions and tailor your response

[1038] The emotion engine recognizes emotions from the text information entered by the user, and the server sends that emotion information to the generation AI, which then generates a response based on the emotion.

[1039] Input: Text information including sentiment

[1040] Output: Emotion-based response

[1041] How it works: The emotion engine extracts emotions, the server sends the emotion information to the generation AI, which generates a response, which is returned to the user via the server.

[1042] (Application example 2)

[1043] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1044] Current travel experience sharing systems often leave users feeling isolated when they input and share their trip details. Furthermore, these systems lack emotional responses and real-time advice, making it difficult to provide personalized experiences tailored to individual needs. Furthermore, even when users enjoy shopping in virtual stores, the experience can feel lonely and lack emotional support.

[1045] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for inputting information about experiences a user has had during a trip; means for transmitting the input information to the server; means for the server to collect the information and request a generated response from a generation AI; means for the generation AI to generate the response and return the response to the user via the server; means for generating a summary and album of the trip based on the user's input information and response content; means for providing the album to the user; and emotion recognition means for recognizing the user's emotions and generating a response according to the emotions. This allows users to enjoy a personalized experience tailored to their individual emotions and needs when traveling alone or shopping in a virtual store, thereby reducing their sense of loneliness.

[1046] "User" refers to an individual who uses the system to input their experience and receive responses and services from the system.

[1047] "Information experienced during travel" refers to events experienced, things seen and heard by the user during travel, input in the form of text or images.

[1048] "Server" refers to a computer system that receives and processes information sent by users and requests it to the generating AI.

[1049] "Generative AI" refers to an artificial intelligence system that generates appropriate responses based on input information from the user.

[1050] "User input information" refers to information such as text and images that a user inputs into the system.

[1051] "Response content" refers to the response text and recommendations generated by the generation AI based on the user's input information.

[1052] The "trip summary" refers to text information that is a compilation of the user's input information and their responses.

[1053] "Album" refers to a digital photo book or slide show that compiles and visually presents a user's travel experience.

[1054] "Emotion recognition means" refers to technology for identifying emotions from user input information and adjusting the generative AI's response based on that.

[1055] The term "virtual travel buddy" refers to a virtual character that is set based on the user's selection and that interacts with the user.

[1056] "Response template" refers to a response pattern prepared in advance based on the character settings of the virtual travel companion.

[1057] "Virtual store" refers to a virtual shopping space where users can browse products and consider purchasing within a digital environment.

[1058] "Product information" refers to the features and detailed information of a product that a user inputs or obtains in a virtual store.

[1059] This invention is a system for sharing the travel experiences of solo travelers and reducing feelings of loneliness. It also aims to make shopping in a virtual store a more personal experience. This system is realized using a server, a generation AI, an emotion recognition means, and other components. Specific embodiments are described below.

[1060] Hardware and software used

[1061] Hardware: Smart glasses, head-mounted displays

[1062] Software: Generative AI model (OpenAI GPT-4), emotion recognition engine, database (PostgreSQL), cloud server (AWS or Google Cloud)

[1063] System configuration

[1064] User Registration and Login

[1065] Users create an account by entering basic information through an application installed on their smart glasses or head-mounted display. The server receives this information, stores it in a database, and generates an authentication token, which it returns to the user.

[1066] Setting up virtual friends

[1067] After the user logs in, a screen appears where they can select a virtual friend character. For example, the user can choose a friend who is knowledgeable about fashion or interior design. The server saves the selected information in a database and loads a response template into the generation AI.

[1068] Sharing your shopping experience

[1069] Users enter information about products they see in a virtual store using text and images and send it to their virtual friends. The server receives this information and passes it on to the generation AI, which analyzes the user's input and generates an appropriate response. For example, in response to a user's question, "What do you think of this dress?", the AI ​​responds, "It looks great on you! What do you particularly like about it?"

[1070] Real-time conversation and question answering

[1071] When a user asks a question about where to go next or what to buy in the virtual store, the server passes the question to the generation AI, which then generates an appropriate answer and sends it back to the user. For example, in response to the question, "What product should I look at next?", the AI ​​might respond, "There's a section for the latest gadgets nearby, so be sure to check it out."

[1072] Shopping summary and album generation

[1073] After shopping, if the user requests it, the server will collect the chat history and images and ask the AI ​​to create a summary and album. The generated album will be provided to the user as a download link.

[1074] Response adjustment using emotion engine

[1075] It uses an emotion engine that recognizes emotions from user input. For example, in response to a message such as "I'm a little tired today, but it was fun," the emotion engine extracts "tiredness" and "fun," and the generating AI responds with, "Today was tough, wasn't it? But I'm glad you had fun. In the next section, find an item that will refresh you."

[1076] Specific examples

[1077] If a user sends a message saying "What do you think of this dress?" along with a picture of the dress, the AI ​​will respond with "It looks great on you! What do you like about it?" The AI ​​will be prompted with the following prompt:

[1078] User message: "What do you think of this dress?"

[1079] Emotion Engine result: "Positive emotion"

[1080] Prompt for generative AI: "A user submits a picture of a new dress and asks for their opinion. It shows positive emotion. Your response should be something like, 'It looks great on you! What do you like about it?'"

[1081] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1082] Processing Steps

[1083] Step 1: User Registration and Login

[1084] Input: User information (name, email address, password)

[1085] How it works: A user enters basic information through an application installed on a smart pair of glasses or a head-mounted display.

[1086] Data processing: The terminal sends the entered information to the server, which then stores the data in a database.

[1087] Output: The server returns the generated authentication token to the user, logging them in.

[1088] Step 2: Setting up virtual friends

[1089] Input: Character selection information (e.g., a friend who is knowledgeable about fashion, a friend who is knowledgeable about interior design)

[1090] How it works: After a user logs in, they select a character for their virtual friend.

[1091] Data processing: The device sends the character selection information to the server, which stores it in a database.

[1092] Output: The server loads a response template into the generated AI based on the selected character settings.

[1093] Step 3: Share your shopping experience

[1094] Input: Product information (text, image)

[1095] How it works: A user enters and submits information about a product they saw in a virtual store.

[1096] Data processing: The terminal sends product information to the server, which then passes the information to the generation AI.

[1097] Output: The generation AI generates an appropriate response and sends it to the user via the server.

[1098] Step 4: Real-time conversation and question answering

[1099] Input: User question (e.g., "What product should I look at next?")

[1100] How it works: The user asks questions about where to go next and what to buy in the virtual store.

[1101] Data processing: The device sends the question to the server, which then passes the question to the generation AI.

[1102] Output: The generation AI generates an appropriate answer and sends it back to the user via the server.

[1103] Step 5: Shopping summary and album creation

[1104] Input: Shopping completion notification

[1105] How it works: A user requests a summary after completing their shopping.

[1106] Data processing: The server collects chat history and images and asks the generation AI to summarize and create an album.

[1107] Output: The generated album is provided to the user as a download link.

[1108] Step 6: Adjusting responses using the emotion engine

[1109] Input: User message (e.g. "Today was a little tiring, but fun.")

[1110] How it works: The emotion recognition engine identifies emotions from the user's messages.

[1111] Data processing: Emotional information is passed to a generative AI, which generates a response based on the emotion.

[1112] Output: A response according to the generated emotion is sent back to the user via the server.

[1113] Specific examples

[1114] When a user submits a product request such as "What do you think of this dress?":

[1115] Input: Message from user: "What do you think of this dress?"

[1116] Action: The device sends a message to the server.

[1117] Data processing: The server passes the message to the generation AI, which analyzes the data to generate a response.

[1118] Output: The generated AI responds, "It looks great! What do you like about it?" and sends it back to the user via the server.

[1119] Examples of prompts:

[1120] User message: "What do you think of this dress?"

[1121] Emotion Engine result: "Positive emotion"

[1122] Prompt for generative AI: "A user submits a picture of a new dress and asks for their opinion. It shows positive emotion. Your response should be something like, 'It looks great on you! What do you like about it?'"

[1123] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1124] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1125] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1126] [Third embodiment]

[1127] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1128] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1129] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1130] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1131] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1132] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1133] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1134] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1135] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1136] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1137] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1138] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1139] The present invention is a system called "virtual travel buddies" that can reduce the sense of loneliness felt by users traveling alone and allow them to freely share travel experiences. A specific embodiment of this system is described below.

[1140] Program processing and specific examples

[1141] 1. User Registration and Login

[1142] A user installs and launches an application. When using it for the first time, the user enters basic information such as name, email address, and password to create an account. The device sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[1143] 2. Selecting virtual travel companions

[1144] After logging in, the user opens a screen to select the character of their virtual travel buddy. For example, they can choose between an adventurous friend or a culturally knowledgeable friend. After selection, the device sends the character information to the server. The server stores this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the character settings.

[1145] 3. Sharing travel stories

[1146] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[1147] As a specific example, when a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[1148] 4. Real-time conversation and question answering

[1149] When deciding on their next move during their journey, the user inputs a question, and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. For example, in response to the question, "Where should we go next?", the generation AI generates the answer, "There's a beautiful garden nearby, so be sure to visit it," and sends it to the user via the server. The user then plans their next move based on this information.

[1150] 5. Travel summary and album creation

[1151] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[1152] Specifically, the system sends a response saying, "You had a great trip today. I'll make an album for you," and generates a digital album that compiles the chat history and images. This album is provided to the user as part of a memorable trip.

[1153] ---

[1154] In this way, the present invention utilizes generative AI to provide a system that allows solo travelers to freely share their memories and receive responses in real time, thereby reducing loneliness and allowing them to enjoy their trip with peace of mind without losing the benefits of solo travel.

[1155] The processing flow will be explained below.

[1156] User Registration and Login

[1157] Step 1:

[1158] The user installs and launches the application and selects the "New Registration" button from the home screen.

[1159] Step 2:

[1160] The user enters basic information such as name, email address, and password, which is then stored on the device.

[1161] Step 3:

[1162] The device sends the entered information to the server using the HTTPS protocol.

[1163] Step 4:

[1164] The server saves the received information in the database using SQL commands.

[1165] Step 5:

[1166] The server generates an authentication token and returns it to the device. The token is generated using JWT (Json Web Token).

[1167] Step 6:

[1168] The terminal stores the authentication token and keeps the user logged in.

[1169] Selecting virtual travel companions

[1170] Step 1:

[1171] After the user logs in, the virtual travel buddy character selection screen opens, and a list of characters is displayed.

[1172] Step 2:

[1173] The user selects a character and presses the "OK" button. The selected character information is saved on the device.

[1174] Step 3:

[1175] The device sends the selected character information to the server using an HTTP POST request.

[1176] Step 4:

[1177] The server saves the character selection information to the database using the INSERT SQL command.

[1178] Step 5:

[1179] The server determines the user's character settings and loads a response template based on those settings into the generation AI.

[1180] Sharing travel stories

[1181] Step 1:

[1182] Users can enter text or images of their travel experiences and send them to their virtual travel buddies using the app's chat interface.

[1183] Step 2:

[1184] The device transfers the input message and image data to the server using an HTTP POST request.

[1185] Step 3:

[1186] The server passes the received data to the generation AI and requests it to generate a response. Data transfer uses an API.

[1187] Step 4:

[1188] Generative AI analyzes the user's message and generates an appropriate response, using natural language processing technology.

[1189] Step 5:

[1190] The server sends the generated response to the terminal using an HTTP response.

[1191] Step 6:

[1192] Users receive responses and continue the conversation, enabling real-time shared experiences.

[1193] Real-time conversation and question answering

[1194] Step 1:

[1195] The user enters a question to determine the next action, using the in-app chat interface.

[1196] Step 2:

[1197] The device sends the user's question to the server using an HTTP POST request.

[1198] Step 3:

[1199] The server passes the question to the AI ​​generator and requests it to generate a response. Data is transferred using an API.

[1200] Step 4:

[1201] Generative AI analyzes questions and generates appropriate answers, using knowledge databases and search engines for analysis and generation.

[1202] Step 5:

[1203] The server sends the generated answer to the terminal using an HTTP response.

[1204] Step 6:

[1205] The user receives the answer and uses that information to plan their next steps, ensuring smooth travel.

[1206] Travel summary and album creation

[1207] Step 1:

[1208] The user sends a message to the chatbot requesting a "trip summary," using the in-app chat interface.

[1209] Step 2:

[1210] The device sends a request message to the server using an HTTP POST request.

[1211] Step 3:

[1212] The server collects the chat history and images sent using a database query.

[1213] Step 4:

[1214] The server passes the collected data to the AI ​​generator and requests it to summarize and generate an album. Data transfer is performed using an API.

[1215] Step 5:

[1216] Generative AI analyzes chat history and images to create text summaries and album pages, using machine learning algorithms for analysis and generation.

[1217] Step 6:

[1218] The server generates a download link for the created album to provide it to the user. The link generation is performed using a web service.

[1219] Step 7:

[1220] The server sends the download link to the device using an HTTP response.

[1221] Step 8:

[1222] The user receives a download link and downloads the generated album, which contains a summary of the trip and images.

[1223] Example 1

[1224] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1225] Traditionally, solo travelers have often felt lonely and had no one to share their travel experiences with, which often prevented them from fully enjoying their trip. They also had difficulty gathering information and making decisions during their trip. There is a need for a system that can solve these problems and help travelers enjoy their trips more while reducing feelings of loneliness.

[1226] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1227] In this invention, the server includes a means for inputting information about experiences during a trip, a means for transmitting the input information to the server, and a means for collecting the information and requesting a response from the generation AI. This allows the user to reduce feelings of loneliness and share their travel experiences. Furthermore, by sending questions to the generation AI and receiving appropriate responses in real time, the server facilitates decision-making during the trip. Furthermore, the server also includes a means for generating a summary and album of the trip based on the user's input information and responses, and providing them to the user, allowing the user to reminisce about their solo travel memories.

[1228] "User" refers to an individual who uses the system, primarily a traveler traveling alone.

[1229] "Terminal" refers to a computing device used by a user, such as a smartphone or tablet.

[1230] "Server" refers to a central processing unit that receives, processes, stores, and generates necessary responses from data sent by terminals.

[1231] "Generative AI" refers to an artificial intelligence model that analyzes information input by a user and generates an appropriate response based on that information.

[1232] An "authentication token" refers to secure authentication information that is returned from a server to a terminal to keep the user logged in.

[1233] "Database" refers to a system installed on a server for storing user information, character setting information, etc.

[1234] "Character" refers to a virtual person with various personalities and characteristics that a user selects as a virtual travel companion.

[1235] "Response template" refers to the basic pattern of the response that the generation AI generates based on the character of the virtual travel companion.

[1236] "Trip summary" refers to a summary of the trip that is generated based on the information entered by the user during the trip and the response from the server.

[1237] An "album" refers to a digital booklet that compiles images taken by the user during their trip and information entered by the user, and includes a summary of the trip generated by the generative AI.

[1238] "Question" refers to a textual inquiry that a user enters to determine their next action during their journey.

[1239] "Download link" refers to the web link provided by the server for the user to obtain the generated album.

[1240] "Application" refers to software that users install on their devices and use.

[1241] The present invention is a system called "virtual travel buddies" that can reduce the sense of loneliness felt by users traveling alone and allow users to freely share their travel experiences. A specific embodiment of this system is described below.

[1242] User Registration and Login

[1243] A user installs and launches an application on their smartphone or tablet. When using the application for the first time, the user creates an account by entering basic information such as their name, email address, and password. The device then sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[1244] Hardware and Software Used

[1245] Hardware: Smartphone or tablet

[1246] Software: iOS / Android applications, HTTP protocol, database systems (e.g., MySQL)

[1247] Specific examples

[1248] When a user creates an account under the name "John Smith" and signs in, the server stores John Smith's information in a database and sends an authentication token back to the terminal.

[1249] Selecting virtual travel companions

[1250] After logging in, the user opens a screen to select the character of their virtual travel buddy. For example, they can choose between an adventurous friend or a culturally knowledgeable friend. After selection, the device sends the character information to the server. The server saves this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the character settings.

[1251] Hardware and Software Used

[1252] Hardware: Smartphone or tablet

[1253] Software: Database management systems, generative AI (e.g., GPT-3)

[1254] Specific examples

[1255] When the user selects "adventurous friend," the server sets the friend as adventurous and has the generation AI load a response template appropriate for that character.

[1256] Sharing travel stories

[1257] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[1258] Hardware and Software Used

[1259] Hardware: Smartphone or tablet, cloud server

[1260] Software: Image analysis tools, generative AI (e.g., GPT-3)

[1261] Specific examples

[1262] When a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[1263] Real-time conversation and question answering

[1264] When a user decides on their next move during their journey, they input a question and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. The generated answer is sent to the user via the server, and the user uses this information to plan their next move.

[1265] Hardware and Software Used

[1266] Hardware: Smartphone or tablet, cloud server

[1267] Software: Generative AI (e.g., GPT-3)

[1268] Specific examples

[1269] When a user types, "Where should we go next?", the generating AI responds, "There's a beautiful garden nearby, so be sure to visit it," and sends this to the user via the server.

[1270] Travel summary and album creation

[1271] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests a generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[1272] Hardware and Software Used

[1273] Hardware: Smartphone or tablet, cloud server

[1274] Software: Generative AI (e.g., GPT-3)

[1275] Specific examples

[1276] The response is, "You had a great trip today. I'll make an album for you," and a digital album is generated that includes the chat history and photos. This album is then made available to the user as part of a memorable trip.

[1277] ---

[1278] In this way, the present invention utilizes generative AI to provide a system that allows solo travelers to freely share their memories and receive responses in real time, thereby reducing loneliness and allowing them to enjoy their trip with peace of mind without losing the benefits of solo travel.

[1279] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1280] Step 1: User Registration and Login

[1281] explanation

[1282] A user installs and launches an application on their smartphone or tablet. They create an account by entering basic information such as their name, email address, and password. The device sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[1283] Input and Output

[1284] Input: Name, Email Address, Password

[1285] Data processing: validation and storage of entered information

[1286] Output: Authentication token

[1287] Specific actions

[1288] A user creates an account under the name "John Smith," the server stores John Smith's information in a database, generates an authentication token, and sends it back to the terminal, which automatically logs the user in.

[1289] Step 2: Selecting virtual travel companions

[1290] explanation

[1291] After logging in, the user opens a screen to select a virtual travel buddy character. The user selects their preferred character from the provided options. The device sends the selected character information to the server. The server saves this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the set character.

[1292] Input and Output

[1293] Input: Character selection information

[1294] Data processing: Saving character information and loading templates

[1295] Output: Character settings confirmed

[1296] Specific actions

[1297] When the user selects "adventurous friend," the server stores this in a database and loads a response template based on the generated AI.

[1298] Step 3: Share your travel stories

[1299] explanation

[1300] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[1301] Input and Output

[1302] Input: Text and image information

[1303] Data processing: Analysis of input information and response generation

[1304] Output: The generated response

[1305] Specific actions

[1306] When a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the generation AI, which then generates a response saying, "That's a beautiful photo! What impressed you about the castle?" and returns it to the user via the server.

[1307] Step 4: Real-time conversation and question answering

[1308] explanation

[1309] When a user decides on their next move during their journey, they input a question and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. The generated answer is sent to the user via the server, and the user uses this information to plan their next move.

[1310] Input and Output

[1311] Input: Question text

[1312] Data processing: Question analysis and answer generation

[1313] Output: The generated answer

[1314] Specific actions

[1315] When a user types, "Where should we go next?", the generating AI responds, "There's a beautiful garden nearby, so be sure to visit it," and sends this to the user via the server.

[1316] Step 5: Summarize your trip and create an album

[1317] explanation

[1318] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[1319] Input and Output

[1320] Input: Bulk request

[1321] Data processing: Chat history and image collection, summarization, and album creation

[1322] Output: Download link

[1323] Specific actions

[1324] When a user types "Please summarize my trip," the server collects chat history and images and passes them to the AI ​​generator, which then generates a digital album with the response "Today was a great trip. I'll create an album for you," and the server provides the user with a download link.

[1325] (Application example 1)

[1326] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1327] In modern society, many people feel lonely when eating alone. In particular, when using food delivery services, there is a lack of experience enjoying a meal alone, making it difficult to obtain psychological satisfaction. Another problem is that when dining out, there are limited ways to obtain food reviews or advice on what dishes to try next.

[1328] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1329] In this invention, the server includes means for inputting information about the user's experience, means for transmitting the input information to the server, means for the server to collect the information and request a generated response from a generation AI, means for the generation AI to generate the response and return the response to the user via the server, means for generating a summary and an album based on the user's input information and response content, means for providing the album to the user, and means for sharing food delivery experiences as virtual gourmet friends and generating responses. This makes it possible to reduce loneliness even when dining alone through interactive interaction, thereby enriching the dining experience.

[1330] "User" means an individual who uses the system to input experience information and share their food delivery experience.

[1331] "Experience information" is data such as text and images related to travel and meals entered by the user.

[1332] A "server" is a centralized computer system that receives information sent by a user, requests a generation AI to generate a response, and sends it back to the user.

[1333] "Generative AI" is an artificial intelligence technology that generates appropriate responses based on information sent by the user.

[1334] A "response template" is a set of predetermined response patterns that the generation AI uses based on the character settings.

[1335] A "summary" is a document that compactly summarizes the information entered by the user and the contents of the conversation.

[1336] An "album" is a digital record of travel and dining experiences.

[1337] A "virtual gourmet friend" is a virtual character that shares the food delivery experience and responds to the user.

[1338] A "question" is a question that a user inputs into the system to determine the next action or recommendation.

[1339] An "answer" is the answer that the generation AI generates to a question.

[1340] This invention is a system called "Virtual Gourmet Friends" that enriches the food delivery experience and reduces loneliness. The system aims to provide a more enjoyable dining experience by allowing users to interact with virtual gourmet friends while enjoying food delivery and share their experiences.

[1341] System configuration

[1342] The system consists of the following main components:

[1343] User device: A device that is directly used by a user, such as a smartphone or tablet.

[1344] Server: A centralized computer system that works in conjunction with user devices to process data, request generation AI, and store and transmit data.

[1345] Generative AI model: An artificial intelligence technique that generates appropriate responses based on input from users.

[1346] Database: A system that stores data such as user information, experience information, and response templates.

[1347] System Operation

[1348] 1. User registration and login: When a user uses the system for the first time, they register by entering their name, email address, and password via their smartphone. The registration information is sent to the server and stored in the database. The user then enters their login information and obtains an authentication token to complete the login process.

[1349] 2. Selecting a virtual gourmet friend: After logging in, the user selects a character for their virtual gourmet friend on the system screen. For example, they can choose a friend who loves cooking or a friend who loves adventure. The selected character information is sent to the server and stored in the database. A response template is also loaded based on this information.

[1350] 3. Sharing food stories: Users can input their experiences using food delivery services as text and photos and send them to the system. For example, they can send a message like, "I had some amazing sushi delivered to me. I'll send you a photo too." This is sent to the server, and the AI ​​generates an appropriate response (e.g., "That sushi looks delicious! Where did you order it from?") and sends it back to the user.

[1351] 4. Question Answering: When a user inputs a question about their next meal or recommended dishes, the question is sent to the generation AI via the server. The generation AI generates an appropriate answer and sends it back to the user. For example, the response to the question "What's your recommended next dish?" may be "I recommend the pizza at a nearby restaurant."

[1352] 5. Meal summary and album generation: After a user has finished a meal experience, they can request an album to be generated that summarises the experience. Based on the chat history and images, the AI ​​generates a summary and album and provides it to the user. The user can then download the album using the download link.

[1353] This process allows users to interact with virtual gourmet friends while enjoying food delivery, reducing feelings of loneliness and allowing them to have a good time.

[1354] Specific examples

[1355] User: "I had some amazing sushi delivered. I'll send you a photo."

[1356] Generative AI: "That sushi looks delicious! Where did you order it from?"

[1357] In this way, the generating AI responds to the experience information entered by the user, making it possible to interact with virtual gourmet friends.

[1358] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1359] Step 1:

[1360] A user uses a smartphone to register by entering their name, email address, and password. The entered information is sent from the device to the server and stored in a database. When registration is successful, the server generates an authentication token and returns it to the device. Upon receiving this authentication token, the user can log in.

[1361] Step 2:

[1362] Once logged in, the user selects a character for their virtual gourmet friend. For example, options such as "friend who loves to cook" are displayed. Once the user selects a character, the device sends this information to the server. The server stores this character setting information in a database and asks the generative AI model to load a response template. The generative AI model loads the appropriate response template based on the selected character and makes it available for use.

[1363] Step 3:

[1364] A user orders food delivery and enters their dining experience using text and photos. For example, they might enter, "I had some great sushi delivered. I'll send you some photos." The device then sends this information to a server. The server then passes the received text and photos to a generative AI model, asking it to generate an appropriate response. The generative AI model analyzes the input and generates a response such as, "That sushi looks delicious! Where did you order it from?" This response is then returned to the user via the server.

[1365] Step 4:

[1366] The user inputs a question about the next dish or restaurant they should try. For example, "What's your next recommended dish?" The device sends the question to the server, which passes it on to the generative AI model. The generative AI model analyzes the question and generates an appropriate answer, such as "I recommend the pizza at a nearby restaurant." This answer is then sent back to the user via the server.

[1367] Step 5:

[1368] After the user finishes their dining experience, they request the creation of a summary and album. This request is sent from the user's device to the server. The server collects the chat history and images and asks the generative AI model to create a summary and album. The generative AI model analyzes the data and creates a summary and a digital album. This album is made available to the user via a download link provided via the server.

[1369] Step 6:

[1370] The user uses the download link to retrieve a digital album containing summaries and photos of their dining experiences, allowing them to reminisce about fond memories.

[1371] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1372] The present invention is a system called "Virtual Travel Buddy" that reduces the sense of loneliness felt by users traveling alone, allows users to freely share their travel experiences, recognizes the user's emotions, and adjusts responses accordingly. A specific embodiment of this system is described below.

[1373] Program processing and specific examples

[1374] 1. User Registration and Login

[1375] A user installs and launches an application. When using it for the first time, the user enters basic information such as name, email address, and password to create an account. The device sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[1376] 2. Selecting virtual travel companions

[1377] After logging in, the user opens a screen to select the character of their virtual travel buddy. For example, they can choose between an adventurous friend or a culturally knowledgeable friend. After selection, the device sends the character information to the server. The server stores this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the character settings.

[1378] 3. Sharing travel stories

[1379] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[1380] As a specific example, when a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[1381] 4. Real-time conversation and question answering

[1382] When deciding on their next move during their journey, the user inputs a question, and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. For example, in response to the question, "Where should we go next?", the generation AI generates the answer, "There's a beautiful garden nearby, so be sure to visit it," and sends it to the user via the server. The user then plans their next move based on this information.

[1383] 5. Travel summary and album creation

[1384] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[1385] Specifically, the system sends a response saying, "You had a great trip today. I'll make an album for you," and generates a digital album that compiles the chat history and images. This album is provided to the user as part of a memorable trip.

[1386] 6. Response adjustment using emotion engine

[1387] To further reflect the user's emotions during the journey, an emotion engine is built in. It recognizes emotions from the text information entered by the user. For example, if the message "Today was tiring but fun" is received, the emotion engine will extract the emotions of "tiredness" and "fun."

[1388] The server sends this emotional information to the AI ​​generator, which then generates a response based on the emotion. The AI ​​generator generates a response such as, "It seems like you had a hard day today. But I'm glad you had fun. Shall we find a place to refresh yourself?" The server then sends this response to the device, where the user receives it.

[1389] This enables interactions that are emotionally fulfilling for the user. For example, if a user inputs, "I felt a little lonely today," the server passes this information to the emotion engine and the generation AI, which then generates an encouraging response such as, "That was tough. But I'm sure you'll have a wonderful experience at your next location." This response is then returned to the user via the server.

[1390] In this way, the present invention utilizes generative AI and an emotion engine to provide a system that allows solo travelers to freely share their memories and receive reliable responses, thereby reducing loneliness without compromising the benefits of solo travel and providing an emotionally sensitive travel experience.

[1391] The processing flow will be explained below.

[1392] User Registration and Login

[1393] Step 1:

[1394] The user installs and launches the application and selects the "New Registration" button from the home screen.

[1395] Step 2:

[1396] The user enters basic information such as name, email address, and password, which is then stored on the device.

[1397] Step 3:

[1398] The device sends the entered information to the server using the HTTPS protocol.

[1399] Step 4:

[1400] The server saves the received information in the database using SQL commands.

[1401] Step 5:

[1402] The server generates an authentication token and returns it to the device. The token is generated using JWT (Json Web Token).

[1403] Step 6:

[1404] The terminal stores the authentication token and keeps the user logged in.

[1405] Selecting virtual travel companions

[1406] Step 1:

[1407] After the user logs in, the virtual travel buddy character selection screen opens, and a list of characters is displayed.

[1408] Step 2:

[1409] The user selects a character and presses the "OK" button. The selected character information is saved on the device.

[1410] Step 3:

[1411] The device sends the selected character information to the server using an HTTP POST request.

[1412] Step 4:

[1413] The server saves the character selection information to the database using the INSERT SQL command.

[1414] Step 5:

[1415] The server determines the user's character settings and loads a response template based on those settings into the generation AI.

[1416] Sharing travel stories

[1417] Step 1:

[1418] Users can enter text or images of their travel experiences and send them to their virtual travel buddies using the app's chat interface.

[1419] Step 2:

[1420] The device transfers the input message and image data to the server using an HTTP POST request.

[1421] Step 3:

[1422] The server passes the received data to the generation AI and requests it to generate a response. Data transfer uses an API.

[1423] Step 4:

[1424] Generative AI analyzes the user's message and generates an appropriate response, using natural language processing technology.

[1425] Step 5:

[1426] The server sends the generated response to the terminal using an HTTP response.

[1427] Step 6:

[1428] Users receive responses and continue the conversation, enabling real-time shared experiences.

[1429] Real-time conversation and question answering

[1430] Step 1:

[1431] The user enters a question to determine the next action, using the in-app chat interface.

[1432] Step 2:

[1433] The device sends the user's question to the server using an HTTP POST request.

[1434] Step 3:

[1435] The server passes the question to the AI ​​generator and requests it to generate a response. Data is transferred using an API.

[1436] Step 4:

[1437] Generative AI analyzes questions and generates appropriate answers, using knowledge databases and search engines for analysis and generation.

[1438] Step 5:

[1439] The server sends the generated answer to the terminal using an HTTP response.

[1440] Step 6:

[1441] The user receives the answer and uses that information to plan their next steps, ensuring smooth travel.

[1442] Travel summary and album creation

[1443] Step 1:

[1444] The user sends a message to the chatbot requesting a "trip summary," using the in-app chat interface.

[1445] Step 2:

[1446] The device sends a request message to the server using an HTTP POST request.

[1447] Step 3:

[1448] The server collects the chat history and images sent using a database query.

[1449] Step 4:

[1450] The server passes the collected data to the AI ​​generator and requests it to summarize and generate an album. Data transfer is performed using an API.

[1451] Step 5:

[1452] Generative AI analyzes chat history and images to create text summaries and album pages, using machine learning algorithms for analysis and generation.

[1453] Step 6:

[1454] The server generates a download link for the created album to provide it to the user. The link generation is performed using a web service.

[1455] Step 7:

[1456] The server sends the download link to the device using an HTTP response.

[1457] Step 8:

[1458] The user receives a download link and downloads the generated album, which contains a summary of the trip and images.

[1459] Response adjustment using emotion engine

[1460] Step 1:

[1461] When a user enters a text description of an experience they had during their trip, the emotion engine analyzes the text. For example, "Today was tiring, but it was a lot of fun."

[1462] Step 2:

[1463] The device sends the entered text to the server using an HTTP POST request.

[1464] Step 3:

[1465] The server passes the received text data to the emotion engine, which analyzes the emotions using natural language processing technology.

[1466] Step 4:

[1467] The emotion engine extracts the emotions of "fatigue" and "enjoyment" and passes that emotional data to the generation AI.

[1468] Step 5:

[1469] Based on the emotional data, the generative AI generates a response such as, "It seems like today was tough. But I'm glad you had fun. Shall we find a place to refresh again?"

[1470] Step 6:

[1471] The server sends the generated response to the terminal using an HTTP response.

[1472] Step 7:

[1473] The user receives the response and plans their next course of action. An emotionally sensitive response leaves the user feeling fulfilled.

[1474] Example 2

[1475] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1476] Solo travelers often feel lonely. It is difficult for them to freely share their travel experiences and emotions in real time and receive reliable responses based on their experiences. Furthermore, there is a lack of suitable tools for easily creating comprehensive summaries and albums at the end of a trip.

[1477] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for inputting information about the user's experiences during the trip; means for transmitting the input information to the server; means for the server to collect the information and request a generated response from a generation AI; means for the generation AI to generate the response and return the response to the user via the server; means for generating a travel summary and album based on the user's input information and response content; means for providing the album to the user; and means including an emotion engine for recognizing the user's emotions and adjusting the response. This allows solo travelers to reduce their sense of loneliness and receive reliable responses based on their emotions in real time. Furthermore, a comprehensive summary and album can be easily created and provided at the end of the trip.

[1478] A "user" is an individual who has registered to use the system and is actively traveling.

[1479] A "server" is a computer system that receives and processes information sent by users and requests the generation AI to generate a response.

[1480] "Terminal" means a device operated by a user, and is a device for inputting, sending, and receiving information.

[1481] "Generative AI" is an artificial intelligence technology that generates appropriate responses based on information entered by the user.

[1482] An "emotion engine" is a technology that recognizes emotions from the user's input text and allows the generative AI to generate a response that corresponds to the emotion.

[1483] A "virtual travel buddy" is a character selected by the user, who is a virtual friend who interacts with the user.

[1484] A "response template" is a dialogue template that is generated based on the character settings of the virtual travel companion.

[1485] An "album" is a digital record of a user's travel experiences and chat history, and is used to preserve travel memories.

[1486] The "trip summary" is information that the user puts together at the end of the trip, and provides a concise overview of the trip.

[1487] An "authentication token" is identification data generated by a server to allow a user to maintain a logged-in state.

[1488] The present invention is a "virtual travel buddy" system that reduces the sense of loneliness felt by users traveling alone, and recognizes the user's emotions and adjusts responses while freely sharing travel experiences. Specific embodiments for implementing this system are described below.

[1489] User Registration and Login

[1490] A user installs and launches a dedicated application on their mobile device. They create an account by entering basic information such as their name, email address, and password. The device sends this information to a server, which stores it in a database. An authentication token is generated and returned to the device, allowing the user to remain logged in.

[1491] Selecting virtual travel companions

[1492] After logging in, the user is presented with a screen to select a character for their virtual travel buddy. They can choose from multiple characters, such as an adventurous friend or a culturally knowledgeable friend. The selected character information is sent from the device to the server, which stores this information in a database. The server then loads a response template based on the selected character into the generated AI.

[1493] Sharing travel stories

[1494] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[1495] As a specific example, when a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[1496] Real-time conversation and question answering

[1497] When a user decides on their next move during their journey, they input a question. The device sends this question to the server, which passes it on to the generation AI. The generation AI generates an appropriate answer and sends it to the user via the server. For example, in response to the question, "Where should we go next?", the generation AI generates the answer, "There's a beautiful garden nearby, so be sure to visit it."

[1498] Travel summary and album creation

[1499] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[1500] Specifically, the system sends a response saying, "You had a great trip today. I'll make an album for you," and generates a digital album that compiles the chat history and images. This album is provided to the user as part of a memorable trip.

[1501] Response adjustment using emotion engine

[1502] An emotion engine is built in to reflect the user's emotions during the journey. Emotions are recognized from the text information entered by the user. For example, if the message "Today was tiring, but fun" is received, the emotion engine will extract the emotions of "tiredness" and "fun."

[1503] The server sends this emotional information to the AI, which then generates a response based on the emotion. The AI ​​generates a response such as, "It seems like you had a hard day today. But I'm glad you had fun. Shall we find a place to refresh yourself?" The server then sends this response to the device, where the user receives it.

[1504] As a specific example, if a user inputs "I felt a little lonely today," the server passes this information to the emotion engine and the generation AI, which then generates an encouraging response such as "That was tough, but I'm sure you'll have a wonderful experience at your next location." This response is then returned to the user via the server.

[1505] Prompt Sentence Examples

[1506] Type: "I saw a beautiful castle today. I'll send you some photos."

[1507] Prompt: "Generate a great response based on this photo."

[1508] As described above, this system uses a generative AI model and an emotion engine to enable solo travelers to freely share their travel experiences and receive emotionally sensitive responses, thereby reducing loneliness without compromising the benefits of solo travel and providing an emotionally sensitive travel experience.

[1509] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1510] Step 1: User installs and launches the application

[1511] The user downloads the dedicated application onto their mobile device, installs it, and then launches it. After installation, the first time they launch it, an account creation screen appears.

[1512] Input: None

[1513] Output: Account creation screen displayed

[1514] How it works: A user downloads an app from the App Store or Google Play Store and taps the install icon to launch it.

[1515] Step 2: User enters basic information to create an account

[1516] The user enters basic information such as name, email address, and password and presses the "Register" button.

[1517] The terminal sends this information to the server.

[1518] Input: Name, Email Address, Password

[1519] Output: Sending registration information to the server

[1520] How it works: The user enters information into the registration form and presses the "Register" button. The device encrypts the information and sends it to the server.

[1521] Step 3: The server generates an authentication token and returns it to the device.

[1522] The server stores the received information in a database, generates an authentication token, and returns it to the terminal.

[1523] Input: User basic information

[1524] Output: Authentication token

[1525] How it works: The server generates an authentication token in JWT format and sends it to the device.

[1526] Step 4: User selects a virtual travel companion character

[1527] After logging in, the user moves to a screen for selecting a virtual travel companion character and selects the character of their choice.

[1528] The terminal sends this information to the server.

[1529] Input: Character selection information

[1530] Output: Character information sent to the server

[1531] Action: The user taps a character to select it and presses the "Confirm" button. The device sends the selection information to the server.

[1532] Step 5: The server confirms the character settings and has the generated AI load the response template.

[1533] The server saves the selected character information in a database and has the generation AI load a response template.

[1534] Input: Character selection information

[1535] Output: Loading response template

[1536] How it works: The server saves character information to a database and sends a request to the generative AI engine to load a response template.

[1537] Step 6: User enters travel story and sends it to virtual travel friends

[1538] The user enters the events and experiences that occurred during the trip in text or image format and presses the "Send" button.

[1539] The terminal forwards this information to the server.

[1540] Input: Travel story (text, images)

[1541] Output: Sending information to the server

[1542] Operation: The user inputs an episode and presses the "Send" button. The device transfers the data to the server.

[1543] Step 7: The server asks the generation AI to generate a response

[1544] The server requests the received episode information from the generation AI and has it generate a response.

[1545] Input: Travel episode information

[1546] Output: The generated response

[1547] How it works: The server passes episode information to the generation AI and asks for an appropriate response.

[1548] Step 8: Send the generated response to the user

[1549] Generative AI analyzes user input and generates a response.

[1550] The server sends this response to the terminal, where it is received by the user.

[1551] Input: Request to generate a response

[1552] Output: The response sent to the user

[1553] How it works: The generation AI generates a response and sends it to the device via the server. The user then checks the response on the screen.

[1554] Step 9: The user enters a question that determines the next action.

[1555] The user enters a question to determine the next action and presses the submit button.

[1556] The terminal sends this question to the server.

[1557] Input: Next Action Question

[1558] Output: Send a query to the server

[1559] How it works: The user enters a question into the text input field and presses the "Submit" button. The device sends the question to the server.

[1560] Step 10: The server sends the question to the AI ​​generator and receives the answer.

[1561] The server passes the received question information to the generation AI and requests an appropriate answer.

[1562] Input: Question information

[1563] Output: The generated answer

[1564] How it works: The server sends the question information to the generation AI and requests an appropriate answer.

[1565] Step 11: Send the generated answer to the user

[1566] The generation AI generates answers to questions, and the server sends them to the device.

[1567] The user receives the answer.

[1568] Input: Request to generate a response

[1569] Output: The answer sent to the user

[1570] How it works: The generation AI generates an answer and sends it to the device via the server. The user then checks the answer on the screen.

[1571] Step 12: User requests trip summary

[1572] The user requests a "trip summary."

[1573] The terminal sends this request to the server.

[1574] Input: Travel summary request

[1575] Output: Send request to server

[1576] Operation: The user presses the "Travel Summary" button, and the device sends the request information to the server.

[1577] Step 13: The server collects chat history and images and asks the AI ​​to generate a summary and album.

[1578] The server collects chat history and images and asks the generation AI to create a summary and create an album.

[1579] Input: Travel summary request

[1580] Output: Generate summary and album

[1581] How it works: The server collects information from the database and asks the generation AI to generate a summary and album.

[1582] Step 14: The server generates a download link to provide the generated album to the user.

[1583] The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user.

[1584] Input: Request for summary and album generation

[1585] Output: Download link

[1586] How it works: The generation AI creates an album, and the server generates a download link to provide to the user.

[1587] Step 15: Recognize user emotions and tailor your response

[1588] The emotion engine recognizes emotions from the text information entered by the user, and the server sends that emotion information to the generation AI, which then generates a response based on the emotion.

[1589] Input: Text information including sentiment

[1590] Output: Emotion-based response

[1591] How it works: The emotion engine extracts emotions, the server sends the emotion information to the generation AI, which generates a response, which is returned to the user via the server.

[1592] (Application example 2)

[1593] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1594] Current travel experience sharing systems often leave users feeling isolated when they input and share their trip details. Furthermore, these systems lack emotional responses and real-time advice, making it difficult to provide personalized experiences tailored to individual needs. Furthermore, even when users enjoy shopping in virtual stores, the experience can feel lonely and lack emotional support.

[1595] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for inputting information about experiences a user has had during a trip; means for transmitting the input information to the server; means for the server to collect the information and request a generated response from a generation AI; means for the generation AI to generate the response and return the response to the user via the server; means for generating a summary and album of the trip based on the user's input information and response content; means for providing the album to the user; and emotion recognition means for recognizing the user's emotions and generating a response according to the emotions. This allows users to enjoy a personalized experience tailored to their individual emotions and needs when traveling alone or shopping in a virtual store, thereby reducing their sense of loneliness.

[1596] "User" refers to an individual who uses the system to input their experience and receive responses and services from the system.

[1597] "Information experienced during travel" refers to events experienced, things seen and heard by the user during travel, input in the form of text or images.

[1598] "Server" refers to a computer system that receives and processes information sent by users and requests it to the generating AI.

[1599] "Generative AI" refers to an artificial intelligence system that generates appropriate responses based on input information from the user.

[1600] "User input information" refers to information such as text and images that a user inputs into the system.

[1601] "Response content" refers to the response text and recommendations generated by the generation AI based on the user's input information.

[1602] The "trip summary" refers to text information that is a compilation of the user's input information and their responses.

[1603] "Album" refers to a digital photo book or slide show that compiles and visually presents a user's travel experience.

[1604] "Emotion recognition means" refers to technology for identifying emotions from user input information and adjusting the generative AI's response based on that.

[1605] The term "virtual travel buddy" refers to a virtual character that is set based on the user's selection and that interacts with the user.

[1606] "Response template" refers to a response pattern prepared in advance based on the character settings of the virtual travel companion.

[1607] "Virtual store" refers to a virtual shopping space where users can browse products and consider purchasing within a digital environment.

[1608] "Product information" refers to the features and detailed information of a product that a user inputs or obtains in a virtual store.

[1609] This invention is a system for sharing the travel experiences of solo travelers and reducing feelings of loneliness. It also aims to make shopping in a virtual store a more personal experience. This system is realized using a server, a generation AI, an emotion recognition means, and other components. Specific embodiments are described below.

[1610] Hardware and software used

[1611] Hardware: Smart glasses, head-mounted displays

[1612] Software: Generative AI model (OpenAI GPT-4), emotion recognition engine, database (PostgreSQL), cloud server (AWS or Google Cloud)

[1613] System configuration

[1614] User Registration and Login

[1615] Users create an account by entering basic information through an application installed on their smart glasses or head-mounted display. The server receives this information, stores it in a database, and generates an authentication token, which it returns to the user.

[1616] Setting up virtual friends

[1617] After the user logs in, a screen appears where they can select a virtual friend character. For example, the user can choose a friend who is knowledgeable about fashion or interior design. The server saves the selected information in a database and loads a response template into the generation AI.

[1618] Sharing your shopping experience

[1619] Users enter information about products they see in a virtual store using text and images and send it to their virtual friends. The server receives this information and passes it on to the generation AI, which analyzes the user's input and generates an appropriate response. For example, in response to a user's question, "What do you think of this dress?", the AI ​​responds, "It looks great on you! What do you particularly like about it?"

[1620] Real-time conversation and question answering

[1621] When a user asks a question about where to go next or what to buy in the virtual store, the server passes the question to the generation AI, which then generates an appropriate answer and sends it back to the user. For example, in response to the question, "What product should I look at next?", the AI ​​might respond, "There's a section for the latest gadgets nearby, so be sure to check it out."

[1622] Shopping summary and album generation

[1623] After shopping, if the user requests it, the server will collect the chat history and images and ask the AI ​​to create a summary and album. The generated album will be provided to the user as a download link.

[1624] Response adjustment using emotion engine

[1625] It uses an emotion engine that recognizes emotions from user input. For example, in response to a message such as "I'm a little tired today, but it was fun," the emotion engine extracts "tiredness" and "fun," and the generating AI responds with, "Today was tough, wasn't it? But I'm glad you had fun. In the next section, find an item that will refresh you."

[1626] Specific examples

[1627] If a user sends a message saying "What do you think of this dress?" along with a picture of the dress, the AI ​​will respond with "It looks great on you! What do you like about it?" The AI ​​will be prompted with the following prompt:

[1628] User message: "What do you think of this dress?"

[1629] Emotion Engine result: "Positive emotion"

[1630] Prompt for generative AI: "A user submits a picture of a new dress and asks for their opinion. It shows positive emotion. Your response should be something like, 'It looks great on you! What do you like about it?'"

[1631] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1632] Processing Steps

[1633] Step 1: User Registration and Login

[1634] Input: User information (name, email address, password)

[1635] How it works: A user enters basic information through an application installed on a smart pair of glasses or a head-mounted display.

[1636] Data processing: The terminal sends the entered information to the server, which then stores the data in a database.

[1637] Output: The server returns the generated authentication token to the user, logging them in.

[1638] Step 2: Setting up virtual friends

[1639] Input: Character selection information (e.g., a friend who is knowledgeable about fashion, a friend who is knowledgeable about interior design)

[1640] How it works: After a user logs in, they select a character for their virtual friend.

[1641] Data processing: The device sends the character selection information to the server, which stores it in a database.

[1642] Output: The server loads a response template into the generated AI based on the selected character settings.

[1643] Step 3: Share your shopping experience

[1644] Input: Product information (text, image)

[1645] How it works: A user enters and submits information about a product they saw in a virtual store.

[1646] Data processing: The terminal sends product information to the server, which then passes the information to the generation AI.

[1647] Output: The generation AI generates an appropriate response and sends it to the user via the server.

[1648] Step 4: Real-time conversation and question answering

[1649] Input: User question (e.g., "What product should I look at next?")

[1650] How it works: The user asks questions about where to go next and what to buy in the virtual store.

[1651] Data processing: The device sends the question to the server, which then passes the question to the generation AI.

[1652] Output: The generation AI generates an appropriate answer and sends it back to the user via the server.

[1653] Step 5: Shopping summary and album creation

[1654] Input: Shopping completion notification

[1655] How it works: A user requests a summary after completing their shopping.

[1656] Data processing: The server collects chat history and images and asks the generation AI to summarize and create an album.

[1657] Output: The generated album is provided to the user as a download link.

[1658] Step 6: Adjusting responses using the emotion engine

[1659] Input: User message (e.g. "Today was a little tiring, but fun.")

[1660] How it works: The emotion recognition engine identifies emotions from the user's messages.

[1661] Data processing: Emotional information is passed to a generative AI, which generates a response based on the emotion.

[1662] Output: A response according to the generated emotion is sent back to the user via the server.

[1663] Specific examples

[1664] When a user submits a product request such as "What do you think of this dress?":

[1665] Input: Message from user: "What do you think of this dress?"

[1666] Action: The device sends a message to the server.

[1667] Data processing: The server passes the message to the generation AI, which analyzes the data to generate a response.

[1668] Output: The generated AI responds, "It looks great! What do you like about it?" and sends it back to the user via the server.

[1669] Examples of prompts:

[1670] User message: "What do you think of this dress?"

[1671] Emotion Engine result: "Positive emotion"

[1672] Prompt for generative AI: "A user submits a picture of a new dress and asks for their opinion. It shows positive emotion. Your response should be something like, 'It looks great on you! What do you like about it?'"

[1673] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1674] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1675] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1676] [Fourth embodiment]

[1677] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1678] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1679] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1680] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1681] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1682] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1683] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1684] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1685] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1686] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1687] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1688] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1689] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1690] The present invention is a system called "virtual travel buddies" that can reduce the sense of loneliness felt by users traveling alone and allow them to freely share travel experiences. A specific embodiment of this system is described below.

[1691] Program processing and specific examples

[1692] 1. User Registration and Login

[1693] A user installs and launches an application. When using it for the first time, the user enters basic information such as name, email address, and password to create an account. The device sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[1694] 2. Selecting virtual travel companions

[1695] After logging in, the user opens a screen to select the character of their virtual travel buddy. For example, they can choose between an adventurous friend or a culturally knowledgeable friend. After selection, the device sends the character information to the server. The server stores this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the character settings.

[1696] 3. Sharing travel stories

[1697] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[1698] As a specific example, when a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[1699] 4. Real-time conversation and question answering

[1700] When deciding on their next move during their journey, the user inputs a question, and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. For example, in response to the question, "Where should we go next?", the generation AI generates the answer, "There's a beautiful garden nearby, so be sure to visit it," and sends it to the user via the server. The user then plans their next move based on this information.

[1701] 5. Travel summary and album creation

[1702] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[1703] Specifically, the system sends a response saying, "You had a great trip today. I'll make an album for you," and generates a digital album that compiles the chat history and images. This album is provided to the user as part of a memorable trip.

[1704] ---

[1705] In this way, the present invention utilizes generative AI to provide a system that allows solo travelers to freely share their memories and receive responses in real time, thereby reducing loneliness and allowing them to enjoy their trip with peace of mind without losing the benefits of solo travel.

[1706] The processing flow will be explained below.

[1707] User Registration and Login

[1708] Step 1:

[1709] The user installs and launches the application and selects the "New Registration" button from the home screen.

[1710] Step 2:

[1711] The user enters basic information such as name, email address, and password, which is then stored on the device.

[1712] Step 3:

[1713] The device sends the entered information to the server using the HTTPS protocol.

[1714] Step 4:

[1715] The server saves the received information in the database using SQL commands.

[1716] Step 5:

[1717] The server generates an authentication token and returns it to the device. The token is generated using JWT (Json Web Token).

[1718] Step 6:

[1719] The terminal stores the authentication token and keeps the user logged in.

[1720] Selecting virtual travel companions

[1721] Step 1:

[1722] After the user logs in, the virtual travel buddy character selection screen opens, and a list of characters is displayed.

[1723] Step 2:

[1724] The user selects a character and presses the "OK" button. The selected character information is saved on the device.

[1725] Step 3:

[1726] The device sends the selected character information to the server using an HTTP POST request.

[1727] Step 4:

[1728] The server saves the character selection information to the database using the INSERT SQL command.

[1729] Step 5:

[1730] The server determines the user's character settings and loads a response template based on those settings into the generation AI.

[1731] Sharing travel stories

[1732] Step 1:

[1733] Users can enter text or images of their travel experiences and send them to their virtual travel buddies using the app's chat interface.

[1734] Step 2:

[1735] The device transfers the input message and image data to the server using an HTTP POST request.

[1736] Step 3:

[1737] The server passes the received data to the generation AI and requests it to generate a response. Data transfer uses an API.

[1738] Step 4:

[1739] Generative AI analyzes the user's message and generates an appropriate response, using natural language processing technology.

[1740] Step 5:

[1741] The server sends the generated response to the terminal using an HTTP response.

[1742] Step 6:

[1743] Users receive responses and continue the conversation, enabling real-time shared experiences.

[1744] Real-time conversation and question answering

[1745] Step 1:

[1746] The user enters a question to determine the next action, using the in-app chat interface.

[1747] Step 2:

[1748] The device sends the user's question to the server using an HTTP POST request.

[1749] Step 3:

[1750] The server passes the question to the AI ​​generator and requests it to generate a response. Data is transferred using an API.

[1751] Step 4:

[1752] Generative AI analyzes questions and generates appropriate answers, using knowledge databases and search engines for analysis and generation.

[1753] Step 5:

[1754] The server sends the generated answer to the terminal using an HTTP response.

[1755] Step 6:

[1756] The user receives the answer and uses that information to plan their next steps, ensuring smooth travel.

[1757] Travel summary and album creation

[1758] Step 1:

[1759] The user sends a message to the chatbot requesting a "trip summary," using the in-app chat interface.

[1760] Step 2:

[1761] The device sends a request message to the server using an HTTP POST request.

[1762] Step 3:

[1763] The server collects the chat history and images sent using a database query.

[1764] Step 4:

[1765] The server passes the collected data to the AI ​​generator and requests it to summarize and generate an album. Data transfer is performed using an API.

[1766] Step 5:

[1767] Generative AI analyzes chat history and images to create text summaries and album pages, using machine learning algorithms for analysis and generation.

[1768] Step 6:

[1769] The server generates a download link for the created album to provide it to the user. The link generation is performed using a web service.

[1770] Step 7:

[1771] The server sends the download link to the device using an HTTP response.

[1772] Step 8:

[1773] The user receives a download link and downloads the generated album, which contains a summary of the trip and images.

[1774] Example 1

[1775] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1776] Traditionally, solo travelers have often felt lonely and had no one to share their travel experiences with, which often prevented them from fully enjoying their trip. They also had difficulty gathering information and making decisions during their trip. There is a need for a system that can solve these problems and help travelers enjoy their trips more while reducing feelings of loneliness.

[1777] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1778] In this invention, the server includes a means for inputting information about experiences during a trip, a means for transmitting the input information to the server, and a means for collecting the information and requesting a response from the generation AI. This allows the user to reduce feelings of loneliness and share their travel experiences. Furthermore, by sending questions to the generation AI and receiving appropriate responses in real time, the server facilitates decision-making during the trip. Furthermore, the server also includes a means for generating a summary and album of the trip based on the user's input information and responses, and providing them to the user, allowing the user to reminisce about their solo travel memories.

[1779] "User" refers to an individual who uses the system, primarily a traveler traveling alone.

[1780] "Terminal" refers to a computing device used by a user, such as a smartphone or tablet.

[1781] "Server" refers to a central processing unit that receives, processes, stores, and generates necessary responses from data sent by terminals.

[1782] "Generative AI" refers to an artificial intelligence model that analyzes information input by a user and generates an appropriate response based on that information.

[1783] An "authentication token" refers to secure authentication information that is returned from a server to a terminal to keep a user logged in.

[1784] "Database" refers to a system installed on a server for storing user information, character setting information, etc.

[1785] "Character" refers to a virtual person with various personalities and characteristics that a user selects as a virtual travel companion.

[1786] "Response template" refers to the basic pattern of the response that the generation AI generates based on the character of the virtual travel companion.

[1787] "Trip summary" refers to a summary of the trip that is generated based on the information entered by the user during the trip and the response from the server.

[1788] An "album" refers to a digital booklet that compiles images taken by the user during their trip and information entered by the user, and includes a summary of the trip generated by the generative AI.

[1789] "Question" refers to a textual inquiry that a user enters to determine their next action during their journey.

[1790] "Download link" refers to the web link provided by the server for the user to obtain the generated album.

[1791] "Application" refers to software that users install on their devices and use.

[1792] The present invention is a system called "virtual travel buddies" that can reduce the sense of loneliness felt by users traveling alone and allow users to freely share their travel experiences. A specific embodiment of this system is described below.

[1793] User Registration and Login

[1794] A user installs and launches an application on their smartphone or tablet. When using the application for the first time, the user creates an account by entering basic information such as their name, email address, and password. The device then sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[1795] Hardware and Software Used

[1796] Hardware: Smartphone or tablet

[1797] Software: iOS / Android applications, HTTP protocol, database systems (e.g., MySQL)

[1798] Specific examples

[1799] When a user creates an account under the name "John Smith" and signs in, the server stores John Smith's information in a database and sends an authentication token back to the terminal.

[1800] Selecting virtual travel companions

[1801] After logging in, the user opens a screen to select the character of their virtual travel buddy. For example, they can choose between an adventurous friend or a culturally knowledgeable friend. After selection, the device sends the character information to the server. The server saves this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the character settings.

[1802] Hardware and Software Used

[1803] Hardware: Smartphone or tablet

[1804] Software: Database management systems, generative AI (e.g., GPT-3)

[1805] Specific examples

[1806] When the user selects "adventurous friend," the server sets the friend as adventurous and has the generation AI load a response template appropriate for that character.

[1807] Sharing travel stories

[1808] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[1809] Hardware and Software Used

[1810] Hardware: Smartphone or tablet, cloud server

[1811] Software: Image analysis tools, generative AI (e.g., GPT-3)

[1812] Specific examples

[1813] When a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[1814] Real-time conversation and question answering

[1815] When a user decides on their next move during their journey, they input a question and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. The generated answer is sent to the user via the server, and the user uses this information to plan their next move.

[1816] Hardware and Software Used

[1817] Hardware: Smartphone or tablet, cloud server

[1818] Software: Generative AI (e.g., GPT-3)

[1819] Specific examples

[1820] When a user types, "Where should we go next?", the generating AI responds, "There's a beautiful garden nearby, so be sure to visit it," and sends this to the user via the server.

[1821] Travel summary and album creation

[1822] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests a generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[1823] Hardware and Software Used

[1824] Hardware: Smartphone or tablet, cloud server

[1825] Software: Generative AI (e.g., GPT-3)

[1826] Specific examples

[1827] The response is, "You had a great trip today. I'll make an album for you," and a digital album is generated that includes the chat history and photos. This album is then made available to the user as part of a memorable trip.

[1828] ---

[1829] In this way, the present invention utilizes generative AI to provide a system that allows solo travelers to freely share their memories and receive responses in real time, thereby reducing loneliness and allowing them to enjoy their trip with peace of mind without losing the benefits of solo travel.

[1830] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1831] Step 1: User Registration and Login

[1832] explanation

[1833] A user installs and launches an application on their smartphone or tablet. They create an account by entering basic information such as their name, email address, and password. The device sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[1834] Input and Output

[1835] Input: Name, Email Address, Password

[1836] Data processing: validation and storage of entered information

[1837] Output: Authentication token

[1838] Specific actions

[1839] A user creates an account under the name "John Smith," the server stores John Smith's information in a database, generates an authentication token, and sends it back to the terminal, which automatically logs the user in.

[1840] Step 2: Selecting virtual travel companions

[1841] explanation

[1842] After logging in, the user opens a screen to select a virtual travel buddy character. The user selects their preferred character from the provided options. The device sends the selected character information to the server. The server saves this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the set character.

[1843] Input and Output

[1844] Input: Character selection information

[1845] Data processing: Saving character information and loading templates

[1846] Output: Character settings confirmed

[1847] Specific actions

[1848] When the user selects "adventurous friend," the server stores this in a database and loads a response template based on the generated AI.

[1849] Step 3: Share your travel stories

[1850] explanation

[1851] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[1852] Input and Output

[1853] Input: Text and image information

[1854] Data processing: Analysis of input information and response generation

[1855] Output: The generated response

[1856] Specific actions

[1857] When a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the generation AI, which then generates a response saying, "That's a beautiful photo! What impressed you about the castle?" and returns it to the user via the server.

[1858] Step 4: Real-time conversation and question answering

[1859] explanation

[1860] When a user decides on their next move during their journey, they input a question and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. The generated answer is sent to the user via the server, and the user uses this information to plan their next move.

[1861] Input and Output

[1862] Input: Question text

[1863] Data processing: Question analysis and answer generation

[1864] Output: The generated answer

[1865] Specific actions

[1866] When a user types, "Where should we go next?", the generating AI responds, "There's a beautiful garden nearby, so be sure to visit it," and sends this to the user via the server.

[1867] Step 5: Summarize your trip and create an album

[1868] explanation

[1869] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[1870] Input and Output

[1871] Input: Bulk request

[1872] Data processing: Chat history and image collection, summarization, and album creation

[1873] Output: Download link

[1874] Specific actions

[1875] When a user types "Please summarize my trip," the server collects chat history and images and passes them to the AI ​​generator, which then generates a digital album with the response "Today was a great trip. I'll create an album for you," and the server provides the user with a download link.

[1876] (Application example 1)

[1877] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1878] In modern society, many people feel lonely when eating alone. In particular, when using food delivery services, there is a lack of experience enjoying a meal alone, making it difficult to obtain psychological satisfaction. Another problem is that when dining out, there are limited ways to obtain food reviews or advice on what dishes to try next.

[1879] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1880] In this invention, the server includes means for inputting information about the user's experience, means for transmitting the input information to the server, means for the server to collect the information and request a generated response from a generation AI, means for the generation AI to generate the response and return the response to the user via the server, means for generating a summary and an album based on the user's input information and response content, means for providing the album to the user, and means for sharing food delivery experiences as virtual gourmet friends and generating responses. This makes it possible to reduce loneliness even when dining alone through interactive interaction, thereby enriching the dining experience.

[1881] "User" means an individual who uses the system to input experience information and share their food delivery experience.

[1882] "Experience information" is data such as text and images related to travel and meals entered by the user.

[1883] A "server" is a centralized computer system that receives information sent by a user, requests a generation AI to generate a response, and sends it back to the user.

[1884] "Generative AI" is an artificial intelligence technology that generates appropriate responses based on information sent by the user.

[1885] A "response template" is a set of predetermined response patterns that the generation AI uses based on the character settings.

[1886] A "summary" is a document that compactly summarizes the information entered by the user and the contents of the conversation.

[1887] An "album" is a digital record of travel and dining experiences.

[1888] A "virtual gourmet friend" is a virtual character that shares the food delivery experience and responds to the user.

[1889] A "question" is a question that a user inputs into the system to determine the next action or recommendation.

[1890] An "answer" is the answer that the generation AI generates to a question.

[1891] This invention is a system called "Virtual Gourmet Friends" that enriches the food delivery experience and reduces loneliness. The system aims to provide a more enjoyable dining experience by allowing users to interact with virtual gourmet friends while enjoying food delivery and share their experiences.

[1892] System configuration

[1893] The system consists of the following main components:

[1894] User device: A device that is directly used by a user, such as a smartphone or tablet.

[1895] Server: A centralized computer system that works in conjunction with user devices to process data, request generation AI, and store and transmit data.

[1896] Generative AI model: An artificial intelligence technique that generates appropriate responses based on input from users.

[1897] Database: A system that stores data such as user information, experience information, and response templates.

[1898] System Operation

[1899] 1. User registration and login: When a user uses the system for the first time, they register by entering their name, email address, and password via their smartphone. The registration information is sent to the server and stored in the database. The user then enters their login information and obtains an authentication token to complete the login process.

[1900] 2. Selecting a virtual gourmet friend: After logging in, the user selects a character for their virtual gourmet friend on the system screen. For example, they can choose a friend who loves cooking or a friend who loves adventure. The selected character information is sent to the server and stored in the database. A response template is also loaded based on this information.

[1901] 3. Sharing food stories: Users can input their experiences using food delivery services as text and photos and send them to the system. For example, they can send a message like, "I had some amazing sushi delivered to me. I'll send you a photo too." This is sent to the server, and the AI ​​generates an appropriate response (e.g., "That sushi looks delicious! Where did you order it from?") and sends it back to the user.

[1902] 4. Question Answering: When a user inputs a question about their next meal or recommended dishes, the question is sent to the generation AI via the server. The generation AI generates an appropriate answer and sends it back to the user. For example, the response to the question "What's your recommended next dish?" may be "I recommend the pizza at a nearby restaurant."

[1903] 5. Meal summary and album generation: After a user has finished a meal experience, they can request an album to be generated that summarises the experience. Based on the chat history and images, the AI ​​generates a summary and album and provides it to the user. The user can then download the album using the download link.

[1904] This process allows users to interact with virtual gourmet friends while enjoying food delivery, reducing feelings of loneliness and allowing them to have a good time.

[1905] Specific examples

[1906] User: "I had some amazing sushi delivered. I'll send you a photo."

[1907] Generative AI: "That sushi looks delicious! Where did you order it from?"

[1908] In this way, the generating AI responds to the experience information entered by the user, making it possible to interact with virtual gourmet friends.

[1909] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1910] Step 1:

[1911] A user uses a smartphone to register by entering their name, email address, and password. The entered information is sent from the device to the server and stored in a database. When registration is successful, the server generates an authentication token and returns it to the device. Upon receiving this authentication token, the user can log in.

[1912] Step 2:

[1913] Once logged in, the user selects a character for their virtual gourmet friend. For example, options such as "friend who loves to cook" are displayed. Once the user selects a character, the device sends this information to the server. The server stores this character setting information in a database and asks the generative AI model to load a response template. The generative AI model loads the appropriate response template based on the selected character and makes it available for use.

[1914] Step 3:

[1915] A user orders food delivery and enters their dining experience using text and photos. For example, they might enter, "I had some great sushi delivered. I'll send you some photos." The device then sends this information to a server. The server then passes the received text and photos to a generative AI model, asking it to generate an appropriate response. The generative AI model analyzes the input and generates a response such as, "That sushi looks delicious! Where did you order it from?" This response is then returned to the user via the server.

[1916] Step 4:

[1917] The user inputs a question about the next dish or restaurant they should try. For example, "What's your next recommended dish?" The device sends the question to the server, which passes it on to the generative AI model. The generative AI model analyzes the question and generates an appropriate answer, such as "I recommend the pizza at a nearby restaurant." This answer is then sent back to the user via the server.

[1918] Step 5:

[1919] After the user finishes their dining experience, they request the creation of a summary and album. This request is sent from the user's device to the server. The server collects the chat history and images and asks the generative AI model to create a summary and album. The generative AI model analyzes the data and creates a summary and a digital album. This album is made available to the user via a download link provided via the server.

[1920] Step 6:

[1921] The user uses the download link to retrieve a digital album containing summaries and photos of their dining experiences, allowing them to reminisce about fond memories.

[1922] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1923] The present invention is a system called "Virtual Travel Buddy" that reduces the sense of loneliness felt by users traveling alone, allows users to freely share their travel experiences, recognizes the user's emotions, and adjusts responses accordingly. A specific embodiment of this system is described below.

[1924] Program processing and specific examples

[1925] 1. User Registration and Login

[1926] A user installs and launches an application. When using it for the first time, the user enters basic information such as name, email address, and password to create an account. The device sends this information to the server. The server stores the received information in a database, generates an authentication token, and returns it to the device, allowing the user to remain logged in.

[1927] 2. Selecting virtual travel companions

[1928] After logging in, the user opens a screen to select the character of their virtual travel buddy. For example, they can choose between an adventurous friend or a culturally knowledgeable friend. After selection, the device sends the character information to the server. The server stores this information in a database and finalizes the character settings. The server also loads a response template into the generation AI based on the character settings.

[1929] 3. Sharing travel stories

[1930] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[1931] As a specific example, when a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[1932] 4. Real-time conversation and question answering

[1933] When deciding on their next move during their journey, the user inputs a question, and the device sends this question to the server. The server passes the question to the generation AI, which generates an appropriate answer. For example, in response to the question, "Where should we go next?", the generation AI generates the answer, "There's a beautiful garden nearby, so be sure to visit it," and sends it to the user via the server. The user then plans their next move based on this information.

[1934] 5. Travel summary and album creation

[1935] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[1936] Specifically, the system sends a response saying, "You had a great trip today. I'll make an album for you," and generates a digital album that compiles the chat history and images. This album is provided to the user as part of a memorable trip.

[1937] 6. Response adjustment using emotion engine

[1938] To further reflect the user's emotions during the journey, an emotion engine is built in. It recognizes emotions from the text information entered by the user. For example, if the message "Today was tiring but fun" is received, the emotion engine will extract the emotions of "tiredness" and "fun."

[1939] The server sends this emotional information to the AI ​​generator, which generates a response based on the emotion. The AI ​​generator generates a response such as, "It seems like you had a hard day today. But I'm glad you had fun. Shall we find a place to refresh yourself?" The server sends this response to the device, and the user receives it.

[1940] This enables interactions that are emotionally fulfilling for the user. For example, if a user inputs, "I felt a little lonely today," the server passes this information to the emotion engine and the generation AI, which then generates an encouraging response such as, "That was tough. But I'm sure you'll have a wonderful experience at your next location." This response is then returned to the user via the server.

[1941] In this way, the present invention utilizes generative AI and an emotion engine to provide a system that allows solo travelers to freely share their memories and receive reliable responses, thereby reducing loneliness without compromising the benefits of solo travel and providing an emotionally sensitive travel experience.

[1942] The processing flow will be explained below.

[1943] User Registration and Login

[1944] Step 1:

[1945] The user installs and launches the application and selects the "New Registration" button from the home screen.

[1946] Step 2:

[1947] The user enters basic information such as name, email address, and password, which is then stored on the device.

[1948] Step 3:

[1949] The device sends the entered information to the server using the HTTPS protocol.

[1950] Step 4:

[1951] The server saves the received information in the database using SQL commands.

[1952] Step 5:

[1953] The server generates an authentication token and returns it to the device. The token is generated using JWT (Json Web Token).

[1954] Step 6:

[1955] The terminal stores the authentication token and keeps the user logged in.

[1956] Selecting virtual travel companions

[1957] Step 1:

[1958] After the user logs in, the virtual travel buddy character selection screen opens, and a list of characters is displayed.

[1959] Step 2:

[1960] The user selects a character and presses the "OK" button. The selected character information is saved on the device.

[1961] Step 3:

[1962] The device sends the selected character information to the server using an HTTP POST request.

[1963] Step 4:

[1964] The server saves the character selection information to the database using the INSERT SQL command.

[1965] Step 5:

[1966] The server determines the user's character settings and loads a response template based on those settings into the generation AI.

[1967] Sharing travel stories

[1968] Step 1:

[1969] Users can enter text or images of their travel experiences and send them to their virtual travel buddies using the app's chat interface.

[1970] Step 2:

[1971] The device transfers the input message and image data to the server using an HTTP POST request.

[1972] Step 3:

[1973] The server passes the received data to the generation AI and requests it to generate a response. Data transfer uses an API.

[1974] Step 4:

[1975] Generative AI analyzes the user's message and generates an appropriate response, using natural language processing technology.

[1976] Step 5:

[1977] The server sends the generated response to the terminal using an HTTP response.

[1978] Step 6:

[1979] Users receive responses and continue the conversation, enabling real-time shared experiences.

[1980] Real-time conversation and question answering

[1981] Step 1:

[1982] The user enters a question to determine the next action, using the in-app chat interface.

[1983] Step 2:

[1984] The device sends the user's question to the server using an HTTP POST request.

[1985] Step 3:

[1986] The server passes the question to the AI ​​generator and requests it to generate a response. Data is transferred using an API.

[1987] Step 4:

[1988] Generative AI analyzes questions and generates appropriate answers, using knowledge databases and search engines for analysis and generation.

[1989] Step 5:

[1990] The server sends the generated answer to the terminal using an HTTP response.

[1991] Step 6:

[1992] The user receives the answer and uses that information to plan their next steps, ensuring smooth travel.

[1993] Travel summary and album creation

[1994] Step 1:

[1995] The user sends a message to the chatbot requesting a "trip summary," using the in-app chat interface.

[1996] Step 2:

[1997] The device sends a request message to the server using an HTTP POST request.

[1998] Step 3:

[1999] The server collects the chat history and images sent using a database query.

[2000] Step 4:

[2001] The server passes the collected data to the AI ​​generator and requests it to summarize and generate an album. Data transfer is performed using an API.

[2002] Step 5:

[2003] Generative AI analyzes chat history and images to create text summaries and album pages, using machine learning algorithms for analysis and generation.

[2004] Step 6:

[2005] The server generates a download link for the created album to provide it to the user. The link generation is performed using a web service.

[2006] Step 7:

[2007] The server sends the download link to the device using an HTTP response.

[2008] Step 8:

[2009] The user receives a download link and downloads the generated album, which contains a summary of the trip and images.

[2010] Response adjustment using emotion engine

[2011] Step 1:

[2012] When a user enters a text description of an experience they had during their trip, the emotion engine analyzes the text. For example, "Today was tiring, but it was a lot of fun."

[2013] Step 2:

[2014] The device sends the entered text to the server using an HTTP POST request.

[2015] Step 3:

[2016] The server passes the received text data to the emotion engine, which analyzes the emotions using natural language processing technology.

[2017] Step 4:

[2018] The emotion engine extracts the emotions of "fatigue" and "enjoyment" and passes that emotional data to the generation AI.

[2019] Step 5:

[2020] Based on the emotional data, the generative AI generates a response such as, "It seems like today was tough. But I'm glad you had fun. Shall we find a place to refresh again?"

[2021] Step 6:

[2022] The server sends the generated response to the terminal using an HTTP response.

[2023] Step 7:

[2024] The user receives the response and plans their next course of action. An emotionally sensitive response leaves the user feeling fulfilled.

[2025] Example 2

[2026] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2027] Solo travelers often feel lonely. It is difficult for them to freely share their travel experiences and emotions in real time and receive reliable responses based on their experiences. Furthermore, there is a lack of suitable tools for easily creating comprehensive summaries and albums at the end of a trip.

[2028] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for inputting information about the user's experiences during the trip; means for transmitting the input information to the server; means for the server to collect the information and request a generated response from a generation AI; means for the generation AI to generate the response and return the response to the user via the server; means for generating a travel summary and album based on the user's input information and response content; means for providing the album to the user; and means including an emotion engine for recognizing the user's emotions and adjusting the response. This allows solo travelers to reduce their sense of loneliness and receive reliable responses based on their emotions in real time. Furthermore, a comprehensive summary and album can be easily created and provided at the end of the trip.

[2029] A "user" is an individual who has registered to use the system and is actively traveling.

[2030] A "server" is a computer system that receives and processes information sent by users and requests the generation AI to generate a response.

[2031] "Terminal" means a device operated by a user, and is a device for inputting, sending, and receiving information.

[2032] "Generative AI" is an artificial intelligence technology that generates appropriate responses based on information entered by the user.

[2033] An "emotion engine" is a technology that recognizes emotions from the user's input text and allows the generative AI to generate a response that corresponds to the emotion.

[2034] A "virtual travel buddy" is a character selected by the user, who is a virtual friend who interacts with the user.

[2035] A "response template" is a dialogue template that is generated based on the character settings of the virtual travel companion.

[2036] An "album" is a digital record of a user's travel experiences and chat history, and is used to preserve travel memories.

[2037] The "trip summary" is information that the user puts together at the end of the trip, and provides a concise overview of the trip.

[2038] An "authentication token" is identification data generated by a server to allow a user to maintain a logged-in state.

[2039] The present invention is a "virtual travel buddy" system that reduces the sense of loneliness felt by users traveling alone, and recognizes the user's emotions and adjusts responses while freely sharing travel experiences. Specific embodiments for implementing this system are described below.

[2040] User Registration and Login

[2041] A user installs and launches a dedicated application on their mobile device. They create an account by entering basic information such as their name, email address, and password. The device sends this information to a server, which stores it in a database. An authentication token is generated and returned to the device, allowing the user to remain logged in.

[2042] Selecting virtual travel companions

[2043] After logging in, the user is presented with a screen to select a character for their virtual travel buddy. They can choose from multiple characters, such as an adventurous friend or a culturally knowledgeable friend. The selected character information is sent from the device to the server, which stores this information in a database. The server then loads a response template based on the selected character into the generated AI.

[2044] Sharing travel stories

[2045] The user inputs the events and experiences they had during their trip in text or image format and sends it to their virtual travel buddy. The device transfers this information to the server, which then asks the AI ​​to generate a response. The AI ​​analyzes the user's input and generates an appropriate response. The server sends this response to the device, where the user receives it and continues the conversation.

[2046] As a specific example, when a user sends a message saying, "I saw a beautiful castle today. I'll send you a photo," along with a photo, the server passes this information to the AI ​​generator, which then generates a response saying, "That's a beautiful photo! What was it about the castle that impressed you?" This response is then returned to the user via the server.

[2047] Real-time conversation and question answering

[2048] When a user decides on their next move during their journey, they input a question. The device sends this question to the server, which passes it on to the generation AI. The generation AI generates an appropriate answer and sends it to the user via the server. For example, in response to the question, "Where should we go next?", the generation AI generates the answer, "There's a beautiful garden nearby, so be sure to visit it."

[2049] Travel summary and album creation

[2050] After completing a trip, the user requests a "trip summary," and the device sends this request to the server. The server collects the chat history and images and requests the generation AI to create a summary and album. The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user. The user can download the album using this link.

[2051] Specifically, the system sends a response saying, "You had a great trip today. I'll make an album for you," and generates a digital album that compiles the chat history and images. This album is provided to the user as part of a memorable trip.

[2052] Response adjustment using emotion engine

[2053] An emotion engine is built in to reflect the user's emotions during the journey. Emotions are recognized from the text information entered by the user. For example, if the message "Today was tiring, but fun" is received, the emotion engine will extract the emotions of "tiredness" and "fun."

[2054] The server sends this emotional information to the AI, which then generates a response based on the emotion. The AI ​​generates a response such as, "It seems like you had a hard day today. But I'm glad you had fun. Shall we find a place to refresh yourself?" The server then sends this response to the device, where the user receives it.

[2055] As a specific example, if a user inputs "I felt a little lonely today," the server passes this information to the emotion engine and the generation AI, which then generates an encouraging response such as "That was tough, but I'm sure you'll have a wonderful experience at your next location." This response is then returned to the user via the server.

[2056] Prompt Sentence Examples

[2057] Type: "I saw a beautiful castle today. I'll send you some photos."

[2058] Prompt: "Generate a great response based on this photo."

[2059] As described above, this system uses a generative AI model and an emotion engine to enable solo travelers to freely share their travel experiences and receive emotionally sensitive responses, thereby reducing loneliness without compromising the benefits of solo travel and providing an emotionally sensitive travel experience.

[2060] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2061] Step 1: User installs and launches the application

[2062] The user downloads the dedicated application onto their mobile device, installs it, and then launches it. After installation, the first time they launch it, an account creation screen appears.

[2063] Input: None

[2064] Output: Account creation screen displayed

[2065] How it works: A user downloads an app from the App Store or Google Play Store and taps the install icon to launch it.

[2066] Step 2: User enters basic information to create an account

[2067] The user enters basic information such as name, email address, and password and presses the "Register" button.

[2068] The terminal sends this information to the server.

[2069] Input: Name, Email Address, Password

[2070] Output: Sending registration information to the server

[2071] How it works: The user enters information into the registration form and presses the "Register" button. The device encrypts the information and sends it to the server.

[2072] Step 3: The server generates an authentication token and returns it to the device.

[2073] The server stores the received information in a database, generates an authentication token, and returns it to the terminal.

[2074] Input: User basic information

[2075] Output: Authentication token

[2076] How it works: The server generates an authentication token in JWT format and sends it to the device.

[2077] Step 4: User selects a virtual travel companion character

[2078] After logging in, the user moves to a screen for selecting a virtual travel companion character and selects the character of their choice.

[2079] The terminal sends this information to the server.

[2080] Input: Character selection information

[2081] Output: Character information sent to the server

[2082] Action: The user taps a character to select it and presses the "Confirm" button. The device sends the selection information to the server.

[2083] Step 5: The server confirms the character settings and has the generated AI load the response template.

[2084] The server saves the selected character information in a database and has the generation AI load a response template.

[2085] Input: Character selection information

[2086] Output: Loading response template

[2087] How it works: The server saves character information to a database and sends a request to the generative AI engine to load a response template.

[2088] Step 6: User enters travel story and sends it to virtual travel friends

[2089] The user enters the events and experiences that occurred during the trip in text or image format and presses the "Send" button.

[2090] The terminal forwards this information to the server.

[2091] Input: Travel story (text, images)

[2092] Output: Sending information to the server

[2093] Operation: The user inputs an episode and presses the "Send" button. The device transfers the data to the server.

[2094] Step 7: The server asks the generation AI to generate a response

[2095] The server requests the received episode information from the generation AI and has it generate a response.

[2096] Input: Travel episode information

[2097] Output: The generated response

[2098] How it works: The server passes episode information to the generation AI and asks for an appropriate response.

[2099] Step 8: Send the generated response to the user

[2100] Generative AI analyzes user input and generates a response.

[2101] The server sends this response to the terminal, where it is received by the user.

[2102] Input: Request to generate a response

[2103] Output: The response sent to the user

[2104] How it works: The generation AI generates a response and sends it to the device via the server. The user then checks the response on the screen.

[2105] Step 9: The user enters a question that determines the next action.

[2106] The user enters a question to determine the next action and presses the submit button.

[2107] The terminal sends this question to the server.

[2108] Input: Next Action Question

[2109] Output: Send a query to the server

[2110] How it works: The user enters a question into the text input field and presses the "Submit" button. The device sends the question to the server.

[2111] Step 10: The server sends the question to the AI ​​generator and receives the answer.

[2112] The server passes the received question information to the generation AI and requests an appropriate answer.

[2113] Input: Question information

[2114] Output: The generated answer

[2115] How it works: The server sends the question information to the generation AI and requests an appropriate answer.

[2116] Step 11: Send the generated answer to the user

[2117] The generation AI generates answers to questions, and the server sends them to the device.

[2118] The user receives the answer.

[2119] Input: Request to generate a response

[2120] Output: The answer sent to the user

[2121] How it works: The generation AI generates an answer and sends it to the device via the server. The user then checks the answer on the screen.

[2122] Step 12: User requests trip summary

[2123] The user requests a "trip summary."

[2124] The terminal sends this request to the server.

[2125] Input: Travel summary request

[2126] Output: Send request to server

[2127] Operation: The user presses the "Travel Summary" button, and the device sends the request information to the server.

[2128] Step 13: The server collects chat history and images and asks the AI ​​to generate a summary and album.

[2129] The server collects chat history and images and asks the generation AI to create a summary and create an album.

[2130] Input: Travel summary request

[2131] Output: Generate summary and album

[2132] How it works: The server collects information from the database and asks the generation AI to generate a summary and album.

[2133] Step 14: The server generates a download link to provide the generated album to the user.

[2134] The generation AI creates a text summary and album page based on the data, and the server generates a download link to provide the generated album to the user.

[2135] Input: Request for summary and album generation

[2136] Output: Download link

[2137] How it works: The generation AI creates an album, and the server generates a download link to provide to the user.

[2138] Step 15: Recognize user emotions and tailor your response

[2139] The emotion engine recognizes emotions from the text information entered by the user, and the server sends that emotion information to the generation AI, which then generates a response based on the emotion.

[2140] Input: Text information including sentiment

[2141] Output: Emotion-based response

[2142] How it works: The emotion engine extracts emotions, the server sends the emotion information to the generation AI, which generates a response, which is returned to the user via the server.

[2143] (Application example 2)

[2144] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2145] Current travel experience sharing systems often leave users feeling isolated when they input and share their trip details. Furthermore, these systems lack emotional responses and real-time advice, making it difficult to provide personalized experiences tailored to individual needs. Furthermore, even when users enjoy shopping in virtual stores, the experience can feel lonely and lack emotional support.

[2146] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for inputting information about experiences a user has had during a trip; means for transmitting the input information to the server; means for the server to collect the information and request a generated response from a generation AI; means for the generation AI to generate the response and return the response to the user via the server; means for generating a summary and album of the trip based on the user's input information and response content; means for providing the album to the user; and emotion recognition means for recognizing the user's emotions and generating a response according to the emotions. This allows users to enjoy a personalized experience tailored to their individual emotions and needs when traveling alone or shopping in a virtual store, thereby reducing their sense of loneliness.

[2147] "User" refers to an individual who uses the system to input their experience and receive responses and services from the system.

[2148] "Information experienced during travel" refers to events experienced, things seen and heard by the user during travel, input in the form of text or images.

[2149] "Server" refers to a computer system that receives and processes information sent by users and requests it to the generating AI.

[2150] "Generative AI" refers to an artificial intelligence system that generates appropriate responses based on input information from the user.

[2151] "User input information" refers to information such as text and images that a user inputs into the system.

[2152] "Response content" refers to the response text and recommendations generated by the generation AI based on the user's input information.

[2153] The "trip summary" refers to text information that is a compilation of the user's input ...

Claims

1. A means for a user to input information about experiences during a trip; means for transmitting the input information to a server; A means for the server to collect the information and request a generated response from a generation AI; A means for generating the response by the generation AI and returning the response to the user through the server; A means for generating a summary and album of a trip based on the user's input information and responses; means for providing the album to a user; A system including:

2. A means for setting a character of a virtual travel companion according to a user's selection; means for reading a response template based on the character settings; The system of claim 1 , comprising:

3. means for the user to input a question to determine the next course of action during the journey; A means for passing the question to a generation AI to generate an appropriate answer; means for transmitting the generated answer to the user; The system of claim 1 , comprising:

Images