system

Abstract

We provide the system. [Solution] Means for collecting information about the preferences of individual users, Means for generating a travel plan based on the aforementioned preferences, A means by which a virtual guide provides information about tourist destinations to individuals according to a generated travel plan, A means for individuals to share information they obtain while traveling with other individuals, A means of conducting local sales activities through a virtual guide, A means of providing a visual guidance experience tailored to individual interests, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is a problem that it is difficult to plan a travel itinerary at a tourist destination and users cannot effectively determine where to visit. In addition, it is difficult to connect with other travelers who have the same interests and share information, so the travel experience tends to be limited. Furthermore, since there is a lack of means for effectively promoting local tourist destinations and stores, there are also problems in activating the local economy.

Means for Solving the Problems

[0005] This invention provides a means for collecting individual user preference information and generating travel plans based on it. Furthermore, it realizes a system that meets individual needs by having a virtual guide provide users with tourist destination information in real time according to the generated travel plan. This system includes a means for users to share information obtained during their travels and promotes community building by exchanging information among agents. In addition, it supports the revitalization of local economies by conducting regional promotion activities through virtual guides.

[0006] "Preference information" refers to data that indicates a user's preferences and interests, and is used to plan and suggest travel options.

[0007] A "travel plan" is a suggestion of itineraries and places to visit created based on the user's preferences, and serves as a guideline to maximize the tourist experience.

[0008] A "virtual guide" is an interactive agent that uses a computer program to provide tourist information and guidance.

[0009] "Information sharing" refers to the act of users exchanging data and experiences gained during their travels with others, thereby enriching their travel experiences.

[0010] "Promotional activities" refer to information dissemination activities aimed at spreading awareness of the appeal of local tourist destinations and shops, and increasing the number of visitors.

[0011] "Exchanging information between agents" refers to a system where different virtual guides exchange data with each other to provide users with new suggestions and information.

[0012] "Revitalizing the local economy" is the process of improving the economic benefits of a region by increasing the number of visitors to tourist destinations and local businesses. [Brief explanation of the drawing]

[0013] [Figure 1]This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0014] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0017] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0018] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0019] In the following embodiments, the numbered communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), and the like.

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0021] [First Embodiment]

[0022] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0023] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0026] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0034] This invention is a system in which a virtual guide provides tourist information by collecting user preference information and formulating individual travel plans based on that information. The implementation of this system involves a server and terminal working together to provide users with a personalized travel experience.

[0035] The server receives preference information entered by the user through their terminal and queries the database based on that information. This generates a travel plan tailored to the user's interests and preferences. This travel plan includes suggestions for tourist destinations, available activities, and accommodations.

[0036] The generated travel plan is sent to the terminal, which not only displays it to the user but also activates a virtual guide. The virtual guide provides detailed information about the destinations based on the travel plan and responds to the user's questions in real time. For example, if the user asks about the history or highlights of a particular tourist spot, the virtual guide will provide that information.

[0037] Users can share information and experiences gained during their travels with other users via their devices. In this process, the server facilitates information exchange among users and collects data to generate new suggestions. This fosters the formation of a community among users.

[0038] For example, if a user selects city A as their travel destination and indicates an interest in art, the server generates a travel plan that includes famous museums and art events in city A. Based on this travel plan, the terminal uses a virtual guide to provide real-time information about museums and events, enriching the user's experience.

[0039] Furthermore, the virtual guide provides users with promotional information on local shops and tourist attractions, encouraging them to participate in sales and events. This promotional activity is designed to revitalize the local economy.

[0040] In this way, this system, which integrates servers, terminals, and virtual guides, realizes a form that can meet individual needs while also contributing to regional revitalization.

[0041] The following describes the processing flow.

[0042] Step 1:

[0043] The user accesses the system using a device and logs in. The device displays a screen for the user to enter their favorite characters, themes of interest, and places they would like to visit. The user enters this preference information and presses the submit button.

[0044] Step 2:

[0045] The device sends collected preference information to the server. Based on the received information, the server searches relevant tourism databases and generates a travel plan tailored to the user. The travel plan includes potential destinations, accommodations, and recommended activities.

[0046] Step 3:

[0047] The server sends the generated travel plan to the terminal. The terminal presents this plan to the user for review. Once the user approves the plan, the terminal prepares to activate the virtual guide.

[0048] Step 4:

[0049] Once the user begins their trip, the device activates a virtual guide that leads them based on their travel plan. The virtual guide combines the user's current location with their schedule to provide real-time information about tourist attractions and answer questions.

[0050] Step 5:

[0051] During their travels, users can share their experiences and interesting information with other users through their devices. The devices send this information to a server, where it is stored in a database. The server uses the collected data to analyze new information with AI models and provide useful suggestions to other users.

[0052] Step 6:

[0053] The server sends promotional information about tourist destinations and shops to a virtual guide, providing users with events and coupons. The terminal displays notifications to users encouraging participation in local benefits and events, and interested users can obtain more detailed information.

[0054] (Example 1)

[0055] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0056] In recent years, there has been a growing demand for more fulfilling travel experiences that cater to individual travel needs. However, conventional travel planning systems can only provide uniform information, making it difficult to propose itineraries optimized for individual user preferences. Furthermore, the lack of efficient means for regional promotion activities meant that these systems were not adequately contributing to the revitalization of local economies.

[0057] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0058] In this invention, the server includes means for collecting individual user preference information, means for generating a travel plan using a generative model based on the preference information, and means for a guide to provide destination information to the user according to the generated travel plan. This enables the provision of travel plans optimized for the user and real-time information responses. Furthermore, by efficiently conducting local promotional activities, it becomes possible to contribute to the revitalization of the local economy.

[0059] "Preference information" refers to information about each user's individual interests and preferences, and serves as basic data for individually optimizing travel plans.

[0060] A "generative model" is a data processing technique used to automatically generate appropriate travel plans based on user preference information.

[0061] A "travel plan" is an itinerary that compiles information on tourist destinations to visit, activities to participate in, and accommodations, tailored to the user's preferences.

[0062] A "guide" is an interface or virtual agent that provides users with detailed travel information based on their travel plan and answers their questions.

[0063] "Information exchange" is a communication process in which users share information and experiences gained during their travels to use as a reference for new travel plans.

[0064] "Promotional activities" refer to activities aimed at revitalizing the local economy by providing users with specific promotional information to encourage the purchase of products or participation in events.

[0065] This invention is a system that provides travel plans based on user preference information, and mainly consists of a server, terminals, and a virtual guide. The role and specific operation of each component are described below.

[0066] The server receives preference information entered by the user from their device and generates an appropriate travel plan based on that information. In doing so, the server accesses a database to indirectly obtain information related to the user. The generated travel plan is created by an AI model (e.g., a generative AI model), evolving from traditional fixed planning to a more flexible and personalized approach. In particular, it includes suggestions for tourist destinations, available activities, and accommodations.

[0067] The terminal receives travel plans sent from the server and displays them to the user. It also activates a virtual guide to provide detailed information about tourist destinations and events of interest to the user. The virtual guide uses natural language processing technology to respond to user questions in real time. For example, if the user asks, "I want to know more about the exhibits currently on display at the XX Museum in City A," the virtual guide will provide a detailed answer.

[0068] Users can share information and experiences gained during their travels with other users via their devices. This sharing function promotes community building and can generate potential travel ideas. By exchanging their experiences with others and gaining new information, users can enjoy a richer travel experience.

[0069] Furthermore, virtual guides can effectively provide users with local promotional information. This includes information on local sales and events, which users can use to consider participating in or making purchases.

[0070] For example, a possible prompt message could be, "The user wants to plan an art-related sightseeing trip in city A. Please list information on the art history, attractions, and related events." This would allow for the provision of information that meets diverse tourism needs while also considering the revitalization of the local economy.

[0071] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0072] Step 1:

[0073] Users use their devices to input their travel destination preferences and areas of interest. This input includes specific requests for tourist spots and categories of interest (e.g., art, culture, food). This information is processed and sent as data to the server.

[0074] Step 2:

[0075] The server analyzes preference information received from the terminal. Based on the received data, it refers to a database and generates queries to retrieve relevant tourist information. Text analysis and machine learning algorithms are used here to understand the user's preferences. The acquired data is used as material for generating travel plans.

[0076] Step 3:

[0077] The server uses a generative AI model based on the analysis results and acquired tourist information to generate individual travel plans. During this process, prompt statements are input to the AI ​​model, and a travel itinerary tailored to the user's preferences is output. For example, a prompt statement such as "Focus on art-related facilities in city A" might be used.

[0078] Step 4:

[0079] The server sends the generated travel plan to the terminal. This output information includes selections of tourist attractions, activities, and accommodations at the travel destination. The terminal then prepares to immediately display the received information to the user.

[0080] Step 5:

[0081] The terminal displays the received travel plan to the user. Furthermore, the terminal activates a virtual guide, ready to provide the user with detailed information about the planned tourist destinations and activities as needed. The guide internally maintains data to respond immediately to user inquiries.

[0082] Step 6:

[0083] Users can share information and experiences gained during their travels with others through their devices. This input information is sent to the server as shared data for other users and exchanged within the community. The shared data is then compiled into a database to help with future travel suggestions.

[0084] Step 7:

[0085] The virtual guide provides users with local promotional information. This includes specific store sale information and details of events taking place in tourist areas. The outputted information is used to encourage user participation and consumption.

[0086] (Application Example 1)

[0087] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0088] Traditional travel planning systems lacked the ability to provide travel experiences tailored to individual user preferences, and also had limited efficiency in real-time information provision and information sharing among users. Therefore, there is a need to respond to the diverse needs of users and effectively provide regional promotion and visual guidance experiences.

[0089] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0090] In this invention, the server includes means for collecting information on the preferences of individual users, means for generating travel plans based on said preferences, and means for a virtual guide to provide information on tourist destinations to the individual according to the generated travel plan. This enables a personalized travel experience based on the user's preferences, as well as immediate information provision and effective local promotion by a virtual guide.

[0091] "Preferences" refer to the specific interests and concerns that an individual has.

[0092] A "travel plan" is a schedule or itinerary for a trip or visit created based on an individual's preferences.

[0093] A "virtual guide" is a digital agent that provides travel information to individuals.

[0094] A "tourist destination" is an interesting region or landmark intended for individual visitors.

[0095] "Means of collecting information" refers to methods and techniques for obtaining information about an individual's preferences.

[0096] "Sales activities" refer to promotional and marketing methods aimed at stimulating the commercial aspects of a region.

[0097] A "visual guided experience" is a virtual travel or visiting experience conducted through visual means.

[0098] In this invention, the system mainly consists of a server, a terminal, and a virtual guide. The server collects individual user preference information and generates individual travel plans based on that data. This involves querying and analyzing data in a database, and is achieved by utilizing software technologies such as Python and SQL. The travel plan generated by the server is sent to the terminal, where it is displayed in a format that is easy for the user to view.

[0099] The terminal is typically a smartphone, tablet, or head-mounted display, and is a device used by the user while traveling. A virtual guide is activated on the terminal and provides information in real time. The virtual guide uses machine learning technology to perform natural language processing and respond to the user's questions. This utilizes generative AI models and performs data processing on a cloud server.

[0100] For example, if a user types, "I'm interested in art, where should I visit?", the virtual guide sends a prompt to the server, retrieves relevant tourist information and event information, and presents it to the user. Also, when a user shares their experiences at a tourist destination with other users, the information is uploaded to the server via the device, making it accessible to other users.

[0101] For example, a prompt such as, "Please provide detailed information about tourist destinations you are interested in. My interests are art events and museums," is sent to the AI ​​model, which then presents tourist spots and event information tailored to the user. This entire process provides users with a personalized travel experience and also contributes to supporting local business activities.

[0102] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0103] Step 1:

[0104] The server collects user preference information. The input is data about the user's interests and preferences entered through their terminal. The server receives this information and stores it in a database. The output here is the preference information stored in the database.

[0105] Step 2:

[0106] The server generates a travel plan based on the preference information it collects. The input is the preference information collected in step 1. The server uses this information to query the database for appropriate tourist destinations and activities and formulates the optimal travel plan. The output is a travel plan tailored to the user's preferences.

[0107] Step 3:

[0108] The server generates a travel plan and sends it to the terminal. The input is the travel plan created in step 2. The server sends this plan data to the terminal in real time and converts the format so that it can be displayed on the terminal. The output is a visually formatted travel plan on the terminal.

[0109] Step 4:

[0110] A virtual guide is activated on the terminal and provides information to the user. The input is the travel plan sent to the terminal in step 3. The virtual guide utilizes a generative AI model to provide information in natural language in response to the user's questions. The output is detailed information about tourist destinations and events presented to the user.

[0111] Step 5:

[0112] This system allows users to share their travel experiences and information with other users. Input is experience information reported by the user on their device. The device uploads this information to a server and processes it for sharing among users. Output is experience information accessible on the sharing platform.

[0113] Step 6:

[0114] Local business activity information is delivered to users via a virtual guide. The input is promotional data for each region. The virtual guide receives this data and provides promotional information relevant to the user's travel plans. The output is information about local business activities displayed to the user.

[0115] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0116] This invention is a system that generates travel plans based on user preference information, has a virtual guide provide sightseeing information, and uses an emotion engine to recognize the user's emotions and provide information and suggestions accordingly.

[0117] The emotion engine analyzes the user's facial expressions, speech, and actions, and sends the results to the server. The server then adjusts the virtual guide's responses in real time based on the acquired emotion data. This adjustment makes the travel experience more personalized and satisfying.

[0118] The server queries relevant tourism databases based on preference information entered by the user through their device and generates an initial travel plan. The emotion engine continuously detects the user's emotions during the trip, and the server dynamically adjusts the travel plan based on this data. For example, if the emotion engine determines that the user is tired, the server can add relaxing activities or destinations.

[0119] The device provides this information to the user, and a virtual guide provides directions to the tourist destination accordingly. The virtual guide customizes the content and tone of the information according to the user's current emotional state. This dynamic, emotion-based adjustment can enhance the user's satisfaction during their trip.

[0120] For example, if a user inputs an interest in history and begins planning a trip, but the emotion engine detects discomfort or fatigue along the way, the virtual guide can suggest nearby cafes or parks where the user can refresh themselves. This allows the user to continue their trip comfortably.

[0121] Furthermore, information sharing among users is also promoted. When users share their experiences and feelings, the emotional data analyzed by the emotion engine is used as reference, and the information is aggregated on the server as useful information for other users. This information is also used to generate new travel suggestions.

[0122] This system will allow for more personalized promotional activities for tourist destinations and shops, enabling approaches tailored to the emotions of users. In this way, the present invention provides travel support technology that takes user emotions into consideration, meeting individual needs while also contributing to regional revitalization.

[0123] The following describes the processing flow.

[0124] Step 1:

[0125] The user logs in using their device and accesses the system. The device displays a screen where the user can enter their preferences, such as favorite themes, categories of interest, and places they plan to visit. The user enters the information and presses the submit button.

[0126] Step 2:

[0127] The terminal sends the collected preference information to the server. Based on the received preference information, the server searches relevant tourism databases and generates a personalized travel plan for the user. This plan includes information such as tourist destinations to visit, available activities, and transportation options.

[0128] Step 3:

[0129] The server sends the generated travel plan to the terminal. The terminal displays the plan to the user and activates a virtual guide. The virtual guide begins providing tourist information based on the user's interests.

[0130] Step 4:

[0131] The emotion engine activates and analyzes the user's emotions in real time based on their facial expressions and speech. The device periodically sends the user's emotion data to the server via the emotion engine.

[0132] Step 5:

[0133] The server dynamically adjusts the travel plan based on the emotional data it collects. For example, if the server determines that the user is feeling tired, it will add relaxing spots and activities to the plan.

[0134] Step 6:

[0135] Users can share information and new emotions they experience during their travels with other users through their devices. The device sends the user experience, along with emotional data, to a server. The server stores this data in a database and provides it to other users as valuable information.

[0136] Step 7:

[0137] The virtual guide adjusts the tone and content of information provided based on acquired emotional data, offering optimal tourism support tailored to the user's state. It also provides promotional information for local businesses, matching the user's emotions to encourage participation. By participating in promotions that interest the user, it contributes to the revitalization of the local economy.

[0138] (Example 2)

[0139] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0140] In recent years, providing travel plans tailored to the individual preferences of users has become increasingly important. However, current systems fail to adequately consider users' instantaneous emotions and lack the flexibility to respond to unexpected situations. As a result, satisfaction during travel is not fully achieved. In particular, there are problems with the flexibility of dynamic plan adjustments and information provision in response to changes in users' emotions.

[0141] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0142] In this invention, the server includes means for collecting individual user preference information, means for evaluating emotions using an emotion analysis engine that analyzes the user's facial expressions and speech, and means for dynamically adjusting the travel plan based on the emotional state. This enables personalized information provision and plan adjustment in response to the user's preferences and instantaneous emotional changes.

[0143] "Preference information" refers to data about users' interests and preferences, and is fundamental information in generating travel plans.

[0144] A "travel plan" refers to a plan that includes an itinerary, the order in which to visit tourist spots, and activities, all suggested based on the user's preferences.

[0145] An "emotion analysis engine" refers to software or a system that analyzes a user's facial expressions and speech to evaluate their emotional state.

[0146] A "virtual guide" refers to a program or agent that provides users with tourist information and advice via audio or text during their travels.

[0147] "Dynamic adjustment" refers to the process of modifying or changing travel plans in real time based on the user's emotional state and other conditions.

[0148] "Promotional activities" refer to marketing and advertising activities aimed at enhancing the appeal of a region or tourist destination and increasing the number of visitors.

[0149] "Information sharing" refers to the process of users exchanging experiences and knowledge gained during their travels with other users, thereby promoting communication and engagement.

[0150] This system provides personalized travel plans using user preference information and emotional data. Specifically, it consists of three components: a server, a terminal, and the user. The server collects preference information from user input and generates an initial travel plan based on it. Generating the travel plan involves querying a travel database and related information bases. The terminal is equipped with an emotional analysis engine that analyzes the user's facial expressions and speech. This allows the user's emotional state to be evaluated in real time. The evaluated emotional data is sent to the server, which dynamically adjusts the travel plan.

[0151] The virtual guide provides information about tourist destinations via voice or text, based on a pre-arranged plan. The information provided varies depending on the user's emotions, and a conversational algorithm is used to enable flexible communication. The user's impressions and feedback during the trip are shared with other users and stored on the server as sentiment-analyzed data. This data is used to generate new travel plans, enabling more personalized suggestions.

[0152] For example, if a user uses the system with the prompt, "I'd like you to introduce me to historical tourist attractions, but I'm also tired, so please suggest some relaxing spots," the sentiment analysis engine will detect the user's fatigue level during their trip. The server can then add activities and locations that provide comfort to the travel plan, and the virtual guide can provide this information to the user. This makes the user's travel experience more satisfying.

[0153] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0154] Step 1:

[0155] Users input preference information via their devices. This input includes genres of tourist destinations they are interested in and activities they enjoy. This input data is temporarily stored on the device and then transferred to the server. The device confirms the input data and prepares it for transmission to the server.

[0156] Step 2:

[0157] The server queries the tourism database based on the received preference information. Specifically, it executes a database query to retrieve a list of relevant tourist attractions and activities. As a result of this database query, it generates an initial travel plan. The server temporarily stores the generated plan along with the user's identification information.

[0158] Step 3:

[0159] The emotion analysis engine built into the device collects the user's facial expressions and speech in real time and analyzes the emotional data. Specifically, it acquires data using the camera and microphone, and infers the emotional state through image processing and voice analysis. The analysis results are quantified as an emotional state and sent to the server.

[0160] Step 4:

[0161] The server dynamically adjusts the travel plan in real time based on emotional data received from the emotion analysis engine. For example, if the user's emotional state indicates "fatigue," the server searches for and adds locations that offer a relaxing environment. This updates the travel plan, making it flexibly customized.

[0162] Step 5:

[0163] The device provides users with tourist information through a virtual guide based on a pre-arranged travel plan. The virtual guide presents the information in a tone and content that reflects sentiment analysis data. The device also functions as an interface for receiving further feedback from the user.

[0164] Step 6:

[0165] Users share their travel experiences and feedback with other users via their devices. This shared information is aggregated on a server and used as data to help generate future travel plans. This data is also used to improve the accuracy of travel suggestions and recommend new tourist destinations.

[0166] (Application Example 2)

[0167] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0168] Traditional travel itineraries offered to tourists often fail to take into account the emotional state and real-time reactions of individual travelers, making it difficult to provide them with the best possible experience. Furthermore, the lack of individualized information sharing among travelers and the absence of personalized local promotional activities make efficient marketing challenging.

[0169] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0170] In this invention, the server includes emotion recognition means for determining the emotional state of a user, means for dynamically adjusting the travel plan based on the emotional state, and means for providing tourist information appropriate to the emotional state based on the adjusted travel plan. This makes it possible to provide travel plans that respond to the user's emotions in real time, improving the quality of the tourist experience, and enabling the personalization of information sharing among users and local promotional activities.

[0171] "User preference information" refers to data that indicates the interests and preferences of individual users, and is information that allows for the provision of customized services based on this information.

[0172] A "travel plan" is a detailed plan outlining the destinations and activities a user will engage in during their trip.

[0173] A "virtual guide" is a digitized guide character that provides users with travel-related information.

[0174] "Emotion recognition means" refers to a technology or device that analyzes a user's facial expressions, voice, and actions to determine their emotional state in real time.

[0175] "Means of dynamic adjustment" refers to methods or devices for modifying plans or proposals in real time based on acquired data and circumstances.

[0176] This system combines multiple technologies to provide an optimal travel plan based on the user's preferences and emotional state. The server first stores the user's preferences in a database, and then uses this data to query tourist destination information and generate an initial travel plan. This plan is dynamically adjusted by the emotion recognition mechanism described later.

[0177] Users receive information from a virtual guide during their trip using devices such as smartphones or smart glasses. The emotion engine utilizes emotion recognition software, such as Google® Cloud Vision API, to determine the user's current emotional state in real time by analyzing facial expressions and voice input. The determined emotion data is sent to a server and used to adjust the travel plan. The server is built using programming languages ​​such as Python, and the backend is implemented using Flask or Django. A relational database management system such as PostgreSQL is used for organizing the tourist information.

[0178] During the trip, the virtual guide adjusts the content and presentation of information according to the user's emotional state. For example, if the user is feeling tired, it can suggest places to refresh themselves, such as a nearby cafe or park. This dynamic adjustment improves the quality of the sightseeing experience and optimizes information sharing among users and local promotional activities.

[0179] For example, suppose a user visits a city over the weekend. This user is wearing smart glasses while sightseeing. Based on the information sensed by the smart glasses during sightseeing, the server refers to the user's preference information and emotional data, and adjusts the travel plan to a route that allows the user to relax. In this way, a personalized experience can be provided.

[0180] An example of a prompt message to input into the generating AI model might be, "Create a program that suggests nearby refresh spots when it detects stress from the user's facial expression."

[0181] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0182] Step 1:

[0183] Users input their preferences using their smartphones or smart glasses. This information is temporarily stored on the device before being sent to a server. The server stores this preference information in a database and queries tourist destination information to generate an initial travel plan. The output is personalized initial travel plan data.

[0184] Step 2:

[0185] Users receive information from a virtual guide via their smartphone or smart glasses while sightseeing. The device uses its camera and microphone to collect emotional data from the user's facial expressions and voice. This data is processed by the Google Cloud Vision API through an emotion engine to determine the user's emotional state. The output is real-time updated emotional state data.

[0186] Step 3:

[0187] When the server receives emotional state data, it adjusts the travel plan stored in the database. Specifically, it optimizes sightseeing routes and destinations based on the user's current emotional state. This process involves selecting appropriate tourist spots and simplifying routes. The output is the adjusted travel plan data.

[0188] Step 4:

[0189] Based on a customized travel plan, a virtual guide provides information to the user through a terminal. The terminal modifies the content and presentation method of the guidance according to the customized travel plan data. The virtual guide provides guidance to the user using voice and images. This allows the user to obtain a real-time, optimized sightseeing experience. As output, it provides the user with customized sightseeing information.

[0190] Step 5:

[0191] Users can share information they gain while sightseeing with other users. The device sends experiential information, along with emotional data, to a server, which is then stored in a database as information that may be used to inform other users' travel plans. The output is experiential information data that facilitates sharing among users.

[0192] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0193] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0194] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0195] [Second Embodiment]

[0196] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0197] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0198] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0199] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0200] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0201] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0202] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0203] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0204] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0205] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0206] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0207] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0208] This invention is a system in which a virtual guide provides tourist information by collecting user preference information and formulating individual travel plans based on that information. The implementation of this system involves a server and terminal working together to provide users with a personalized travel experience.

[0209] The server receives preference information entered by the user through their terminal and queries the database based on that information. This generates a travel plan tailored to the user's interests and preferences. This travel plan includes suggestions for tourist destinations, available activities, and accommodations.

[0210] The generated travel plan is sent to the terminal, which not only displays it to the user but also activates a virtual guide. The virtual guide provides detailed information about the destinations based on the travel plan and responds to the user's questions in real time. For example, if the user asks about the history or highlights of a particular tourist spot, the virtual guide will provide that information.

[0211] Users can share information and experiences gained during their travels with other users via their devices. In this process, the server facilitates information exchange among users and collects data to generate new suggestions. This fosters the formation of a community among users.

[0212] For example, if a user selects city A as their travel destination and indicates an interest in art, the server generates a travel plan that includes famous museums and art events in city A. Based on this travel plan, the terminal uses a virtual guide to provide real-time information about museums and events, enriching the user's experience.

[0213] Furthermore, the virtual guide provides users with promotional information on local shops and tourist attractions, encouraging them to participate in sales and events. This promotional activity is designed to revitalize the local economy.

[0214] In this way, this system, which integrates servers, terminals, and virtual guides, realizes a form that can meet individual needs while also contributing to regional revitalization.

[0215] The following describes the processing flow.

[0216] Step 1:

[0217] The user accesses the system using a device and logs in. The device displays a screen for the user to enter their favorite characters, themes of interest, and places they would like to visit. The user enters this preference information and presses the submit button.

[0218] Step 2:

[0219] The device sends collected preference information to the server. Based on the received information, the server searches relevant tourism databases and generates a travel plan tailored to the user. The travel plan includes potential destinations, accommodations, and recommended activities.

[0220] Step 3:

[0221] The server sends the generated travel plan to the terminal. The terminal presents this plan to the user for review. Once the user approves the plan, the terminal prepares to activate the virtual guide.

[0222] Step 4:

[0223] Once the user begins their trip, the device activates a virtual guide that leads them based on their travel plan. The virtual guide combines the user's current location with their schedule to provide real-time information about tourist attractions and answer questions.

[0224] Step 5:

[0225] During their travels, users can share their experiences and interesting information with other users through their devices. The devices send this information to a server, where it is stored in a database. The server uses the collected data to analyze new information with AI models and provide useful suggestions to other users.

[0226] Step 6:

[0227] The server sends promotional information about tourist destinations and shops to a virtual guide, providing users with events and coupons. The terminal displays notifications to users encouraging participation in local benefits and events, and interested users can obtain more detailed information.

[0228] (Example 1)

[0229] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0230] In recent years, there has been a growing demand for more fulfilling travel experiences that cater to individual travel needs. However, conventional travel planning systems can only provide uniform information, making it difficult to propose itineraries optimized for individual user preferences. Furthermore, the lack of efficient means for regional promotion activities meant that these systems were not adequately contributing to the revitalization of local economies.

[0231] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0232] In this invention, the server includes means for collecting individual user preference information, means for generating a travel plan using a generative model based on the preference information, and means for a guide to provide destination information to the user according to the generated travel plan. This enables the provision of travel plans optimized for the user and real-time information responses. Furthermore, by efficiently conducting local promotional activities, it becomes possible to contribute to the revitalization of the local economy.

[0233] "Preference information" refers to information about each user's individual interests and preferences, and serves as basic data for individually optimizing travel plans.

[0234] A "generative model" is a data processing technique used to automatically generate appropriate travel plans based on user preference information.

[0235] A "travel plan" is an itinerary that compiles information on tourist destinations to visit, activities to participate in, and accommodations, tailored to the user's preferences.

[0236] A "guide" is an interface or virtual agent that provides users with detailed travel information based on their travel plan and answers their questions.

[0237] "Information exchange" is a communication process in which users share information and experiences gained during their travels to use as a reference for new travel plans.

[0238] "Promotional activities" refer to activities aimed at revitalizing the local economy by providing users with specific promotional information to encourage the purchase of products or participation in events.

[0239] This invention is a system that provides travel plans based on user preference information, and mainly consists of a server, terminals, and a virtual guide. The role and specific operation of each component are described below.

[0240] The server receives preference information entered by the user from their device and generates an appropriate travel plan based on that information. In doing so, the server accesses a database to indirectly obtain information related to the user. The generated travel plan is created by an AI model (e.g., a generative AI model), evolving from traditional fixed planning to a more flexible and personalized approach. In particular, it includes suggestions for tourist destinations, available activities, and accommodations.

[0241] The terminal receives travel plans sent from the server and displays them to the user. It also activates a virtual guide to provide detailed information about tourist destinations and events of interest to the user. The virtual guide uses natural language processing technology to respond to user questions in real time. For example, if the user asks, "I want to know more about the exhibits currently on display at the XX Museum in City A," the virtual guide will provide a detailed answer.

[0242] Users can share information and experiences gained during their travels with other users via their devices. This sharing function promotes community building and can generate potential travel ideas. By exchanging their experiences with others and gaining new information, users can enjoy a richer travel experience.

[0243] Furthermore, virtual guides can effectively provide users with local promotional information. This includes information on local sales and events, which users can use to consider participating in or making purchases.

[0244] For example, a possible prompt message could be, "The user wants to plan an art-related sightseeing trip in city A. Please list information on the art history, attractions, and related events." This would allow for the provision of information that meets diverse tourism needs while also considering the revitalization of the local economy.

[0245] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0246] Step 1:

[0247] Users use their devices to input their travel destination preferences and areas of interest. This input includes specific requests for tourist spots and categories of interest (e.g., art, culture, food). This information is processed and sent as data to the server.

[0248] Step 2:

[0249] The server analyzes preference information received from the terminal. Based on the received data, it refers to a database and generates queries to retrieve relevant tourist information. Text analysis and machine learning algorithms are used here to understand the user's preferences. The acquired data is used as material for generating travel plans.

[0250] Step 3:

[0251] The server uses a generative AI model based on the analysis results and acquired tourist information to generate individual travel plans. During this process, prompt statements are input to the AI ​​model, and a travel itinerary tailored to the user's preferences is output. For example, a prompt statement such as "Focus on art-related facilities in city A" might be used.

[0252] Step 4:

[0253] The server sends the generated travel plan to the terminal. This output information includes selections of tourist attractions, activities, and accommodations at the travel destination. The terminal then prepares to immediately display the received information to the user.

[0254] Step 5:

[0255] The terminal displays the received travel plan to the user. Furthermore, the terminal activates a virtual guide, ready to provide the user with detailed information about the planned tourist destinations and activities as needed. The guide internally maintains data to respond immediately to user inquiries.

[0256] Step 6:

[0257] Users can share information and experiences gained during their travels with others through their devices. This input information is sent to the server as shared data for other users and exchanged within the community. The shared data is then compiled into a database to help with future travel suggestions.

[0258] Step 7:

[0259] The virtual guide provides users with local promotional information. This includes specific store sale information and details of events taking place in tourist areas. The outputted information is used to encourage user participation and consumption.

[0260] (Application Example 1)

[0261] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0262] Traditional travel planning systems lacked the ability to provide travel experiences tailored to individual user preferences, and also had limited efficiency in real-time information provision and information sharing among users. Therefore, there is a need to respond to the diverse needs of users and effectively provide regional promotion and visual guidance experiences.

[0263] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0264] In this invention, the server includes means for collecting information on the preferences of individual users, means for generating travel plans based on said preferences, and means for a virtual guide to provide information on tourist destinations to the individual according to the generated travel plan. This enables a personalized travel experience based on the user's preferences, as well as immediate information provision and effective local promotion by a virtual guide.

[0265] "Preferences" refer to the specific interests and concerns that an individual has.

[0266] A "travel plan" is a schedule or itinerary for a trip or visit created based on an individual's preferences.

[0267] A "virtual guide" is a digital agent that provides travel information to individuals.

[0268] A "tourist destination" is an interesting region or landmark intended for individual visitors.

[0269] "Means of collecting information" refers to methods and techniques for obtaining information about an individual's preferences.

[0270] "Sales activities" refer to promotional and marketing methods aimed at stimulating the commercial aspects of a region.

[0271] A "visual guided experience" is a virtual travel or visiting experience conducted through visual means.

[0272] In this invention, the system mainly consists of a server, a terminal, and a virtual guide. The server collects individual user preference information and generates individual travel plans based on that data. This involves querying and analyzing data in a database, and is achieved by utilizing software technologies such as Python and SQL. The travel plan generated by the server is sent to the terminal, where it is displayed in a format that is easy for the user to view.

[0273] The terminal is typically a smartphone, tablet, or head-mounted display, and is a device used by the user while traveling. A virtual guide is activated on the terminal and provides information in real time. The virtual guide uses machine learning technology to perform natural language processing and respond to the user's questions. This utilizes generative AI models and performs data processing on a cloud server.

[0274] For example, if a user types, "I'm interested in art, where should I visit?", the virtual guide sends a prompt to the server, retrieves relevant tourist information and event information, and presents it to the user. Also, when a user shares their experiences at a tourist destination with other users, the information is uploaded to the server via the device, making it accessible to other users.

[0275] For example, a prompt such as, "Please provide detailed information about tourist destinations you are interested in. My interests are art events and museums," is sent to the AI ​​model, which then presents tourist spots and event information tailored to the user. This entire process provides users with a personalized travel experience and also contributes to supporting local business activities.

[0276] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0277] Step 1:

[0278] The server collects the user's preference information. The input is data related to the user's interests and concerns entered through the terminal. The server receives this information and stores it in the database. The output here is the preference information stored in the database.

[0279] Step 2:

[0280] Based on the preference information collected by the server, a travel plan is generated. The input is the preference information collected in Step 1. The server uses this information to query the appropriate tourist destinations and activities from the database and formulates an optimal travel plan. The output is a travel plan tailored to the user's preferences.

[0281] Step 3:

[0282] The server sends the generated travel plan to the terminal. The input is the travel plan created in Step 2. The server transmits this plan data to the terminal in real time and performs format conversion so that it can be displayed on the terminal. The output is a visually formatted travel plan on the terminal.

[0283] Step 4:

[0284] A virtual guide is activated on the terminal to provide information to the user. The input is the travel plan sent to the terminal in Step 3. The virtual guide utilizes a generated AI model to provide information in natural language in response to the user's questions. The output is the detailed information of tourist destinations and events presented to the user.

[0285] Step 5:

[0286] The user shares the experiences and information obtained during the trip with other users. The input is the experience information reported by the user on the terminal. The terminal uploads this information to the server and processes it for sharing among users. The output is the experience information accessible on the sharing platform.

[0287] Step 6:

[0288] Local business activity information is delivered to users via a virtual guide. The input is promotional data for each region. The virtual guide receives this data and provides promotional information relevant to the user's travel plans. The output is information about local business activities displayed to the user.

[0289] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0290] This invention is a system that generates travel plans based on user preference information, has a virtual guide provide sightseeing information, and uses an emotion engine to recognize the user's emotions and provide information and suggestions accordingly.

[0291] The emotion engine analyzes the user's facial expressions, speech, and actions, and sends the results to the server. The server then adjusts the virtual guide's responses in real time based on the acquired emotion data. This adjustment makes the travel experience more personalized and satisfying.

[0292] The server queries relevant tourism databases based on preference information entered by the user through their device and generates an initial travel plan. The emotion engine continuously detects the user's emotions during the trip, and the server dynamically adjusts the travel plan based on this data. For example, if the emotion engine determines that the user is tired, the server can add relaxing activities or destinations.

[0293] The device provides this information to the user, and a virtual guide provides directions to the tourist destination accordingly. The virtual guide customizes the content and tone of the information according to the user's current emotional state. This dynamic, emotion-based adjustment can enhance the user's satisfaction during their trip.

[0294] For example, if a user inputs an interest in history and begins planning a trip, but the emotion engine detects discomfort or fatigue along the way, the virtual guide can suggest nearby cafes or parks where the user can refresh themselves. This allows the user to continue their trip comfortably.

[0295] Furthermore, information sharing among users is also promoted. When users share their experiences and feelings, the emotional data analyzed by the emotion engine is used as reference, and the information is aggregated on the server as useful information for other users. This information is also used to generate new travel suggestions.

[0296] This system will allow for more personalized promotional activities for tourist destinations and shops, enabling approaches tailored to the emotions of users. In this way, the present invention provides travel support technology that takes user emotions into consideration, meeting individual needs while also contributing to regional revitalization.

[0297] The following describes the processing flow.

[0298] Step 1:

[0299] The user logs in using their device and accesses the system. The device displays a screen where the user can enter their preferences, such as favorite themes, categories of interest, and places they plan to visit. The user enters the information and presses the submit button.

[0300] Step 2:

[0301] The terminal sends the collected preference information to the server. Based on the received preference information, the server searches relevant tourism databases and generates a personalized travel plan for the user. This plan includes information such as tourist destinations to visit, available activities, and transportation options.

[0302] Step 3:

[0303] The server sends the generated travel plan to the terminal. The terminal displays the plan to the user and activates the virtual guide. The virtual guide starts providing tourist information based on the user's interests.

[0304] Step 4:

[0305] The emotion engine activates and analyzes the user's emotions in real time from the user's expressions, speech, etc. The terminal periodically sends the user's emotion data to the server via the emotion engine.

[0306] Step 5:

[0307] Based on the acquired emotion data, the server dynamically adjusts the travel plan. For example, if it is determined that the user is feeling tired, the server adds relaxation spots and activities to the plan.

[0308] Step 6:

[0309] The user can share the information and new emotions obtained during the trip with other users through the terminal. The terminal sends the user experience with emotion data to the server. The server accumulates this in the database and provides it as valuable information to other users.

[0310] Step 7:

[0311] The virtual guide adjusts the tone and content of information provision according to the acquired emotion data, and provides optimal tourism support for the user's state. Also, it provides promotion information of local stores according to the emotion to encourage participation. By participating in the promotion that the user is interested in, it contributes to the activation of the local economy.

[0312] (Example 2)

[0313] Next, Example 2 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal".

[0314] In recent years, providing travel plans tailored to the individual preferences of users has become increasingly important. However, current systems fail to adequately consider users' instantaneous emotions and lack the flexibility to respond to unexpected situations. As a result, satisfaction during travel is not fully achieved. In particular, there are problems with the flexibility of dynamic plan adjustments and information provision in response to changes in users' emotions.

[0315] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0316] In this invention, the server includes means for collecting individual user preference information, means for evaluating emotions using an emotion analysis engine that analyzes the user's facial expressions and speech, and means for dynamically adjusting the travel plan based on the emotional state. This enables personalized information provision and plan adjustment in response to the user's preferences and instantaneous emotional changes.

[0317] "Preference information" refers to data about users' interests and preferences, and is fundamental information in generating travel plans.

[0318] A "travel plan" refers to a plan that includes an itinerary, the order in which to visit tourist spots, and activities, all suggested based on the user's preferences.

[0319] An "emotion analysis engine" refers to software or a system that analyzes a user's facial expressions and speech to evaluate their emotional state.

[0320] A "virtual guide" refers to a program or agent that provides users with tourist information and advice via audio or text during their travels.

[0321] "Dynamic adjustment" refers to the process of modifying or changing travel plans in real time based on the user's emotional state and other conditions.

[0322] "Promotional activities" refer to marketing and advertising activities aimed at enhancing the appeal of a region or tourist destination and increasing the number of visitors.

[0323] "Information sharing" refers to the process of users exchanging experiences and knowledge gained during their travels with other users, thereby promoting communication and engagement.

[0324] This system provides personalized travel plans using user preference information and emotional data. Specifically, it consists of three components: a server, a terminal, and the user. The server collects preference information from user input and generates an initial travel plan based on it. Generating the travel plan involves querying a travel database and related information bases. The terminal is equipped with an emotional analysis engine that analyzes the user's facial expressions and speech. This allows the user's emotional state to be evaluated in real time. The evaluated emotional data is sent to the server, which dynamically adjusts the travel plan.

[0325] The virtual guide provides information about tourist destinations via voice or text, based on a pre-arranged plan. The information provided varies depending on the user's emotions, and a conversational algorithm is used to enable flexible communication. The user's impressions and feedback during the trip are shared with other users and stored on the server as sentiment-analyzed data. This data is used to generate new travel plans, enabling more personalized suggestions.

[0326] For example, if a user uses the system with the prompt, "I'd like you to introduce me to historical tourist attractions, but I'm also tired, so please suggest some relaxing spots," the sentiment analysis engine will detect the user's fatigue level during their trip. The server can then add activities and locations that provide comfort to the travel plan, and the virtual guide can provide this information to the user. This makes the user's travel experience more satisfying.

[0327] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0328] Step 1:

[0329] Users input preference information via their devices. This input includes genres of tourist destinations they are interested in and activities they enjoy. This input data is temporarily stored on the device and then transferred to the server. The device confirms the input data and prepares it for transmission to the server.

[0330] Step 2:

[0331] The server queries the tourism database based on the received preference information. Specifically, it executes a database query to retrieve a list of relevant tourist attractions and activities. As a result of this database query, it generates an initial travel plan. The server temporarily stores the generated plan along with the user's identification information.

[0332] Step 3:

[0333] The emotion analysis engine built into the device collects the user's facial expressions and speech in real time and analyzes the emotional data. Specifically, it acquires data using the camera and microphone, and infers the emotional state through image processing and voice analysis. The analysis results are quantified as an emotional state and sent to the server.

[0334] Step 4:

[0335] The server dynamically adjusts the travel plan in real time based on emotional data received from the emotion analysis engine. For example, if the user's emotional state indicates "fatigue," the server searches for and adds locations that offer a relaxing environment. This updates the travel plan, making it flexibly customized.

[0336] Step 5:

[0337] The device provides users with tourist information through a virtual guide based on a pre-arranged travel plan. The virtual guide presents the information in a tone and content that reflects sentiment analysis data. The device also functions as an interface for receiving further feedback from the user.

[0338] Step 6:

[0339] Users share their travel experiences and feedback with other users via their devices. This shared information is aggregated on a server and used as data to help generate future travel plans. This data is also used to improve the accuracy of travel suggestions and recommend new tourist destinations.

[0340] (Application Example 2)

[0341] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0342] Traditional travel itineraries offered to tourists often fail to take into account the emotional state and real-time reactions of individual travelers, making it difficult to provide them with the best possible experience. Furthermore, the lack of individualized information sharing among travelers and the absence of personalized local promotional activities make efficient marketing challenging.

[0343] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0344] In this invention, the server includes emotion recognition means for determining the emotional state of a user, means for dynamically adjusting the travel plan based on the emotional state, and means for providing tourist information appropriate to the emotional state based on the adjusted travel plan. This makes it possible to provide travel plans that respond to the user's emotions in real time, improving the quality of the tourist experience, and enabling the personalization of information sharing among users and local promotional activities.

[0345] "User preference information" refers to data that indicates the interests and preferences of individual users, and is information that allows for the provision of customized services based on this information.

[0346] A "travel plan" is a detailed plan outlining the destinations and activities a user will engage in during their trip.

[0347] A "virtual guide" is a digitized guide character that provides users with travel-related information.

[0348] "Emotion recognition means" refers to a technology or device that analyzes a user's facial expressions, voice, and actions to determine their emotional state in real time.

[0349] "Means of dynamic adjustment" refers to methods or devices for modifying plans or proposals in real time based on acquired data and circumstances.

[0350] This system combines multiple technologies to provide an optimal travel plan based on the user's preferences and emotional state. The server first stores the user's preferences in a database, and then uses this data to query tourist destination information and generate an initial travel plan. This plan is dynamically adjusted by the emotion recognition mechanism described later.

[0351] Users receive information from a virtual guide during their trip using devices such as smartphones or smart glasses. The emotion engine utilizes emotion recognition software, such as the Google Cloud Vision API, to determine the user's current emotional state in real time by analyzing facial expressions and voice input. The determined emotion data is sent to a server and used to adjust the travel plan. The server is built using programming languages ​​such as Python, and the backend is implemented using Flask or Django. A relational database management system such as PostgreSQL is used for organizing the tourist information.

[0352] During the trip, the virtual guide adjusts the content and presentation of information according to the user's emotional state. For example, if the user is feeling tired, it can suggest places to refresh themselves, such as a nearby cafe or park. This dynamic adjustment improves the quality of the sightseeing experience and optimizes information sharing among users and local promotional activities.

[0353] For example, suppose a user visits a city over the weekend. This user is wearing smart glasses while sightseeing. Based on the information sensed by the smart glasses during sightseeing, the server refers to the user's preference information and emotional data, and adjusts the travel plan to a route that allows the user to relax. In this way, a personalized experience can be provided.

[0354] An example of a prompt message to input into the generating AI model might be, "Create a program that suggests nearby refresh spots when it detects stress from the user's facial expression."

[0355] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0356] Step 1:

[0357] Users input their preferences using their smartphones or smart glasses. This information is temporarily stored on the device before being sent to a server. The server stores this preference information in a database and queries tourist destination information to generate an initial travel plan. The output is personalized initial travel plan data.

[0358] Step 2:

[0359] Users receive information from a virtual guide via their smartphone or smart glasses while sightseeing. The device uses its camera and microphone to collect emotional data from the user's facial expressions and voice. This data is processed by the Google Cloud Vision API through an emotion engine to determine the user's emotional state. The output is real-time updated emotional state data.

[0360] Step 3:

[0361] When the server receives emotional state data, it adjusts the travel plan stored in the database. Specifically, it optimizes sightseeing routes and destinations based on the user's current emotional state. This process involves selecting appropriate tourist spots and simplifying routes. The output is the adjusted travel plan data.

[0362] Step 4:

[0363] Based on a customized travel plan, a virtual guide provides information to the user through a terminal. The terminal modifies the content and presentation method of the guidance according to the customized travel plan data. The virtual guide provides guidance to the user using voice and images. This allows the user to obtain a real-time, optimized sightseeing experience. As output, it provides the user with customized sightseeing information.

[0364] Step 5:

[0365] Users can share information they gain while sightseeing with other users. The device sends experiential information, along with emotional data, to a server, which is then stored in a database as information that may be used to inform other users' travel plans. The output is experiential information data that facilitates sharing among users.

[0366] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0367] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0368] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0369] [Third Embodiment]

[0370] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0371] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0372] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0373] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0374] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0375] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0376] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0377] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0378] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0379] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0380] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0381] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0382] This invention is a system in which a virtual guide provides tourist information by collecting user preference information and formulating individual travel plans based on that information. The implementation of this system involves a server and terminal working together to provide users with a personalized travel experience.

[0383] The server receives preference information entered by the user through their terminal and queries the database based on that information. This generates a travel plan tailored to the user's interests and preferences. This travel plan includes suggestions for tourist destinations, available activities, and accommodations.

[0384] The generated travel plan is sent to the terminal, which not only displays it to the user but also activates a virtual guide. The virtual guide provides detailed information about the destinations based on the travel plan and responds to the user's questions in real time. For example, if the user asks about the history or highlights of a particular tourist spot, the virtual guide will provide that information.

[0385] Users can share information and experiences gained during their travels with other users via their devices. In this process, the server facilitates information exchange among users and collects data to generate new suggestions. This fosters the formation of a community among users.

[0386] For example, if a user selects city A as their travel destination and indicates an interest in art, the server generates a travel plan that includes famous museums and art events in city A. Based on this travel plan, the terminal uses a virtual guide to provide real-time information about museums and events, enriching the user's experience.

[0387] Furthermore, the virtual guide provides users with promotional information on local shops and tourist attractions, encouraging them to participate in sales and events. This promotional activity is designed to revitalize the local economy.

[0388] In this way, this system, which integrates servers, terminals, and virtual guides, realizes a form that can meet individual needs while also contributing to regional revitalization.

[0389] The following describes the processing flow.

[0390] Step 1:

[0391] The user accesses the system using a device and logs in. The device displays a screen for the user to enter their favorite characters, themes of interest, and places they would like to visit. The user enters this preference information and presses the submit button.

[0392] Step 2:

[0393] The device sends collected preference information to the server. Based on the received information, the server searches relevant tourism databases and generates a travel plan tailored to the user. The travel plan includes potential destinations, accommodations, and recommended activities.

[0394] Step 3:

[0395] The server sends the generated travel plan to the terminal. The terminal presents this plan to the user for review. Once the user approves the plan, the terminal prepares to activate the virtual guide.

[0396] Step 4:

[0397] Once the user begins their trip, the device activates a virtual guide that leads them based on their travel plan. The virtual guide combines the user's current location with their schedule to provide real-time information about tourist attractions and answer questions.

[0398] Step 5:

[0399] During their travels, users can share their experiences and interesting information with other users through their devices. The devices send this information to a server, where it is stored in a database. The server uses the collected data to analyze new information with AI models and provide useful suggestions to other users.

[0400] Step 6:

[0401] The server sends promotional information about tourist destinations and shops to a virtual guide, providing users with events and coupons. The terminal displays notifications to users encouraging participation in local benefits and events, and interested users can obtain more detailed information.

[0402] (Example 1)

[0403] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0404] In recent years, there has been a growing demand for more fulfilling travel experiences that cater to individual travel needs. However, conventional travel planning systems can only provide uniform information, making it difficult to propose itineraries optimized for individual user preferences. Furthermore, the lack of efficient means for regional promotion activities meant that these systems were not adequately contributing to the revitalization of local economies.

[0405] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0406] In this invention, the server includes means for collecting individual user preference information, means for generating a travel plan using a generative model based on the preference information, and means for a guide to provide destination information to the user according to the generated travel plan. This enables the provision of travel plans optimized for the user and real-time information responses. Furthermore, by efficiently conducting local promotional activities, it becomes possible to contribute to the revitalization of the local economy.

[0407] "Preference information" refers to information about each user's individual interests and preferences, and serves as basic data for individually optimizing travel plans.

[0408] A "generative model" is a data processing technique used to automatically generate appropriate travel plans based on user preference information.

[0409] A "travel plan" is an itinerary that compiles information on tourist destinations to visit, activities to participate in, and accommodations, tailored to the user's preferences.

[0410] A "guide" is an interface or virtual agent that provides users with detailed travel information based on their travel plan and answers their questions.

[0411] "Information exchange" is a communication process in which users share information and experiences gained during their travels to use as a reference for new travel plans.

[0412] "Promotional activities" refer to activities aimed at revitalizing the local economy by providing users with specific promotional information to encourage the purchase of products or participation in events.

[0413] This invention is a system that provides travel plans based on user preference information, and mainly consists of a server, terminals, and a virtual guide. The role and specific operation of each component are described below.

[0414] The server receives preference information entered by the user from their device and generates an appropriate travel plan based on that information. In doing so, the server accesses a database to indirectly obtain information related to the user. The generated travel plan is created by an AI model (e.g., a generative AI model), evolving from traditional fixed planning to a more flexible and personalized approach. In particular, it includes suggestions for tourist destinations, available activities, and accommodations.

[0415] The terminal receives travel plans sent from the server and displays them to the user. It also activates a virtual guide to provide detailed information about tourist destinations and events of interest to the user. The virtual guide uses natural language processing technology to respond to user questions in real time. For example, if the user asks, "I want to know more about the exhibits currently on display at the XX Museum in City A," the virtual guide will provide a detailed answer.

[0416] Users can share information and experiences gained during their travels with other users via their devices. This sharing function promotes community building and can generate potential travel ideas. By exchanging their experiences with others and gaining new information, users can enjoy a richer travel experience.

[0417] Furthermore, virtual guides can effectively provide users with local promotional information. This includes information on local sales and events, which users can use to consider participating in or making purchases.

[0418] For example, a possible prompt message could be, "The user wants to plan an art-related sightseeing trip in city A. Please list information on the art history, attractions, and related events." This would allow for the provision of information that meets diverse tourism needs while also considering the revitalization of the local economy.

[0419] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0420] Step 1:

[0421] Users use their devices to input their travel destination preferences and areas of interest. This input includes specific requests for tourist spots and categories of interest (e.g., art, culture, food). This information is processed and sent as data to the server.

[0422] Step 2:

[0423] The server analyzes preference information received from the terminal. Based on the received data, it refers to a database and generates queries to retrieve relevant tourist information. Text analysis and machine learning algorithms are used here to understand the user's preferences. The acquired data is used as material for generating travel plans.

[0424] Step 3:

[0425] The server uses a generative AI model based on the analysis results and acquired tourist information to generate individual travel plans. During this process, prompt statements are input to the AI ​​model, and a travel itinerary tailored to the user's preferences is output. For example, a prompt statement such as "Focus on art-related facilities in city A" might be used.

[0426] Step 4:

[0427] The server sends the generated travel plan to the terminal. This output information includes selections of tourist attractions, activities, and accommodations at the travel destination. The terminal then prepares to immediately display the received information to the user.

[0428] Step 5:

[0429] The terminal displays the received travel plan to the user. Furthermore, the terminal activates a virtual guide, ready to provide the user with detailed information about the planned tourist destinations and activities as needed. The guide internally maintains data to respond immediately to user inquiries.

[0430] Step 6:

[0431] Users can share information and experiences gained during their travels with others through their devices. This input information is sent to the server as shared data for other users and exchanged within the community. The shared data is then compiled into a database to help with future travel suggestions.

[0432] Step 7:

[0433] The virtual guide provides users with local promotional information. This includes specific store sale information and details of events taking place in tourist areas. The outputted information is used to encourage user participation and consumption.

[0434] (Application Example 1)

[0435] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0436] Traditional travel planning systems lacked the ability to provide travel experiences tailored to individual user preferences, and also had limited efficiency in real-time information provision and information sharing among users. Therefore, there is a need to respond to the diverse needs of users and effectively provide regional promotion and visual guidance experiences.

[0437] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0438] In this invention, the server includes means for collecting information on the preferences of individual users, means for generating travel plans based on said preferences, and means for a virtual guide to provide information on tourist destinations to the individual according to the generated travel plan. This enables a personalized travel experience based on the user's preferences, as well as immediate information provision and effective local promotion by a virtual guide.

[0439] "Preferences" refer to the specific interests and concerns that an individual has.

[0440] A "travel plan" is a schedule or itinerary for a trip or visit created based on an individual's preferences.

[0441] A "virtual guide" is a digital agent that provides travel information to individuals.

[0442] A "tourist destination" is an interesting region or landmark intended for individual visitors.

[0443] "Means of collecting information" refers to methods and techniques for obtaining information about an individual's preferences.

[0444] "Sales activities" refer to promotional and marketing methods aimed at stimulating the commercial aspects of a region.

[0445] A "visual guided experience" is a virtual travel or visiting experience conducted through visual means.

[0446] In this invention, the system mainly consists of a server, a terminal, and a virtual guide. The server collects individual user preference information and generates individual travel plans based on that data. This involves querying and analyzing data in a database, and is achieved by utilizing software technologies such as Python and SQL. The travel plan generated by the server is sent to the terminal, where it is displayed in a format that is easy for the user to view.

[0447] The terminal is typically a smartphone, tablet, or head-mounted display, and is a device used by the user while traveling. A virtual guide is activated on the terminal and provides information in real time. The virtual guide uses machine learning technology to perform natural language processing and respond to the user's questions. This utilizes generative AI models and performs data processing on a cloud server.

[0448] For example, if a user types, "I'm interested in art, where should I visit?", the virtual guide sends a prompt to the server, retrieves relevant tourist information and event information, and presents it to the user. Also, when a user shares their experiences at a tourist destination with other users, the information is uploaded to the server via the device, making it accessible to other users.

[0449] For example, a prompt such as, "Please provide detailed information about tourist destinations you are interested in. My interests are art events and museums," is sent to the AI ​​model, which then presents tourist spots and event information tailored to the user. This entire process provides users with a personalized travel experience and also contributes to supporting local business activities.

[0450] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0451] Step 1:

[0452] The server collects user preference information. The input is data about the user's interests and preferences entered through their terminal. The server receives this information and stores it in a database. The output here is the preference information stored in the database.

[0453] Step 2:

[0454] The server generates a travel plan based on the preference information it collects. The input is the preference information collected in step 1. The server uses this information to query the database for appropriate tourist destinations and activities and formulates the optimal travel plan. The output is a travel plan tailored to the user's preferences.

[0455] Step 3:

[0456] The server generates a travel plan and sends it to the terminal. The input is the travel plan created in step 2. The server sends this plan data to the terminal in real time and converts the format so that it can be displayed on the terminal. The output is a visually formatted travel plan on the terminal.

[0457] Step 4:

[0458] A virtual guide is activated on the terminal and provides information to the user. The input is the travel plan sent to the terminal in step 3. The virtual guide utilizes a generative AI model to provide information in natural language in response to the user's questions. The output is detailed information about tourist destinations and events presented to the user.

[0459] Step 5:

[0460] This system allows users to share their travel experiences and information with other users. Input is experience information reported by the user on their device. The device uploads this information to a server and processes it for sharing among users. Output is experience information accessible on the sharing platform.

[0461] Step 6:

[0462] Local business activity information is delivered to users via a virtual guide. The input is promotional data for each region. The virtual guide receives this data and provides promotional information relevant to the user's travel plans. The output is information about local business activities displayed to the user.

[0463] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0464] This invention is a system that generates travel plans based on user preference information, has a virtual guide provide sightseeing information, and uses an emotion engine to recognize the user's emotions and provide information and suggestions accordingly.

[0465] The emotion engine analyzes the user's facial expressions, speech, and actions, and sends the results to the server. The server then adjusts the virtual guide's responses in real time based on the acquired emotion data. This adjustment makes the travel experience more personalized and satisfying.

[0466] The server queries relevant tourism databases based on preference information entered by the user through their device and generates an initial travel plan. The emotion engine continuously detects the user's emotions during the trip, and the server dynamically adjusts the travel plan based on this data. For example, if the emotion engine determines that the user is tired, the server can add relaxing activities or destinations.

[0467] The device provides this information to the user, and a virtual guide provides directions to the tourist destination accordingly. The virtual guide customizes the content and tone of the information according to the user's current emotional state. This dynamic, emotion-based adjustment can enhance the user's satisfaction during their trip.

[0468] For example, if a user inputs an interest in history and begins planning a trip, but the emotion engine detects discomfort or fatigue along the way, the virtual guide can suggest nearby cafes or parks where the user can refresh themselves. This allows the user to continue their trip comfortably.

[0469] Furthermore, information sharing among users is also promoted. When users share their experiences and feelings, the emotional data analyzed by the emotion engine is used as reference, and the information is aggregated on the server as useful information for other users. This information is also used to generate new travel suggestions.

[0470] This system will allow for more personalized promotional activities for tourist destinations and shops, enabling approaches tailored to the emotions of users. In this way, the present invention provides travel support technology that takes user emotions into consideration, meeting individual needs while also contributing to regional revitalization.

[0471] The following describes the processing flow.

[0472] Step 1:

[0473] The user logs in using their device and accesses the system. The device displays a screen where the user can enter their preferences, such as favorite themes, categories of interest, and places they plan to visit. The user enters the information and presses the submit button.

[0474] Step 2:

[0475] The terminal sends the collected preference information to the server. Based on the received preference information, the server searches relevant tourism databases and generates a personalized travel plan for the user. This plan includes information such as tourist destinations to visit, available activities, and transportation options.

[0476] Step 3:

[0477] The server sends the generated travel plan to the terminal. The terminal displays the plan to the user and activates a virtual guide. The virtual guide begins providing tourist information based on the user's interests.

[0478] Step 4:

[0479] The emotion engine activates and analyzes the user's emotions in real time based on their facial expressions and speech. The device periodically sends the user's emotion data to the server via the emotion engine.

[0480] Step 5:

[0481] The server dynamically adjusts the travel plan based on the emotional data it collects. For example, if the server determines that the user is feeling tired, it will add relaxing spots and activities to the plan.

[0482] Step 6:

[0483] Users can share information and new emotions they experience during their travels with other users through their devices. The device sends the user experience, along with emotional data, to a server. The server stores this data in a database and provides it to other users as valuable information.

[0484] Step 7:

[0485] The virtual guide adjusts the tone and content of information provided based on acquired emotional data, offering optimal tourism support tailored to the user's state. It also provides promotional information for local businesses, matching the user's emotions to encourage participation. By participating in promotions that interest the user, it contributes to the revitalization of the local economy.

[0486] (Example 2)

[0487] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0488] In recent years, providing travel plans tailored to the individual preferences of users has become increasingly important. However, current systems fail to adequately consider users' instantaneous emotions and lack the flexibility to respond to unexpected situations. As a result, satisfaction during travel is not fully achieved. In particular, there are problems with the flexibility of dynamic plan adjustments and information provision in response to changes in users' emotions.

[0489] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0490] In this invention, the server includes means for collecting individual user preference information, means for evaluating emotions using an emotion analysis engine that analyzes the user's facial expressions and speech, and means for dynamically adjusting the travel plan based on the emotional state. This enables personalized information provision and plan adjustment in response to the user's preferences and instantaneous emotional changes.

[0491] "Preference information" refers to data about users' interests and preferences, and is fundamental information in generating travel plans.

[0492] A "travel plan" refers to a plan that includes an itinerary, the order in which to visit tourist spots, and activities, all suggested based on the user's preferences.

[0493] An "emotion analysis engine" refers to software or a system that analyzes a user's facial expressions and speech to evaluate their emotional state.

[0494] A "virtual guide" refers to a program or agent that provides users with tourist information and advice via audio or text during their travels.

[0495] "Dynamic adjustment" refers to the process of modifying or changing travel plans in real time based on the user's emotional state and other conditions.

[0496] "Promotional activities" refer to marketing and advertising activities aimed at enhancing the appeal of a region or tourist destination and increasing the number of visitors.

[0497] "Information sharing" refers to the process of users exchanging experiences and knowledge gained during their travels with other users, thereby promoting communication and engagement.

[0498] This system provides personalized travel plans using user preference information and emotional data. Specifically, it consists of three components: a server, a terminal, and the user. The server collects preference information from user input and generates an initial travel plan based on it. Generating the travel plan involves querying a travel database and related information bases. The terminal is equipped with an emotional analysis engine that analyzes the user's facial expressions and speech. This allows the user's emotional state to be evaluated in real time. The evaluated emotional data is sent to the server, which dynamically adjusts the travel plan.

[0499] The virtual guide provides information about tourist destinations via voice or text, based on a pre-arranged plan. The information provided varies depending on the user's emotions, and a conversational algorithm is used to enable flexible communication. The user's impressions and feedback during the trip are shared with other users and stored on the server as sentiment-analyzed data. This data is used to generate new travel plans, enabling more personalized suggestions.

[0500] For example, if a user uses the system with the prompt, "I'd like you to introduce me to historical tourist attractions, but I'm also tired, so please suggest some relaxing spots," the sentiment analysis engine will detect the user's fatigue level during their trip. The server can then add activities and locations that provide comfort to the travel plan, and the virtual guide can provide this information to the user. This makes the user's travel experience more satisfying.

[0501] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0502] Step 1:

[0503] Users input preference information via their devices. This input includes genres of tourist destinations they are interested in and activities they enjoy. This input data is temporarily stored on the device and then transferred to the server. The device confirms the input data and prepares it for transmission to the server.

[0504] Step 2:

[0505] The server queries the tourism database based on the received preference information. Specifically, it executes a database query to retrieve a list of relevant tourist attractions and activities. As a result of this database query, it generates an initial travel plan. The server temporarily stores the generated plan along with the user's identification information.

[0506] Step 3:

[0507] The emotion analysis engine built into the device collects the user's facial expressions and speech in real time and analyzes the emotional data. Specifically, it acquires data using the camera and microphone, and infers the emotional state through image processing and voice analysis. The analysis results are quantified as an emotional state and sent to the server.

[0508] Step 4:

[0509] The server dynamically adjusts the travel plan in real time based on emotional data received from the emotion analysis engine. For example, if the user's emotional state indicates "fatigue," the server searches for and adds locations that offer a relaxing environment. This updates the travel plan, making it flexibly customized.

[0510] Step 5:

[0511] The device provides users with tourist information through a virtual guide based on a pre-arranged travel plan. The virtual guide presents the information in a tone and content that reflects sentiment analysis data. The device also functions as an interface for receiving further feedback from the user.

[0512] Step 6:

[0513] Users share their travel experiences and feedback with other users via their devices. This shared information is aggregated on a server and used as data to help generate future travel plans. This data is also used to improve the accuracy of travel suggestions and recommend new tourist destinations.

[0514] (Application Example 2)

[0515] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0516] Traditional travel itineraries offered to tourists often fail to take into account the emotional state and real-time reactions of individual travelers, making it difficult to provide them with the best possible experience. Furthermore, the lack of individualized information sharing among travelers and the absence of personalized local promotional activities make efficient marketing challenging.

[0517] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0518] In this invention, the server includes emotion recognition means for determining the emotional state of a user, means for dynamically adjusting the travel plan based on the emotional state, and means for providing tourist information appropriate to the emotional state based on the adjusted travel plan. This makes it possible to provide travel plans that respond to the user's emotions in real time, improving the quality of the tourist experience, and enabling the personalization of information sharing among users and local promotional activities.

[0519] "User preference information" refers to data that indicates the interests and preferences of individual users, and is information that allows for the provision of customized services based on this information.

[0520] A "travel plan" is a detailed plan outlining the destinations and activities a user will engage in during their trip.

[0521] A "virtual guide" is a digitized guide character that provides users with travel-related information.

[0522] "Emotion recognition means" refers to a technology or device that analyzes a user's facial expressions, voice, and actions to determine their emotional state in real time.

[0523] "Means of dynamic adjustment" refers to methods or devices for modifying plans or proposals in real time based on acquired data and circumstances.

[0524] This system combines multiple technologies to provide an optimal travel plan based on the user's preferences and emotional state. The server first stores the user's preferences in a database, and then uses this data to query tourist destination information and generate an initial travel plan. This plan is dynamically adjusted by the emotion recognition mechanism described later.

[0525] Users receive information from a virtual guide during their trip using devices such as smartphones or smart glasses. The emotion engine utilizes emotion recognition software, such as the Google Cloud Vision API, to determine the user's current emotional state in real time by analyzing facial expressions and voice input. The determined emotion data is sent to a server and used to adjust the travel plan. The server is built using programming languages ​​such as Python, and the backend is implemented using Flask or Django. A relational database management system such as PostgreSQL is used for organizing the tourist information.

[0526] During the trip, the virtual guide adjusts the content and presentation of information according to the user's emotional state. For example, if the user is feeling tired, it can suggest places to refresh themselves, such as a nearby cafe or park. This dynamic adjustment improves the quality of the sightseeing experience and optimizes information sharing among users and local promotional activities.

[0527] For example, suppose a user visits a city over the weekend. This user is wearing smart glasses while sightseeing. Based on the information sensed by the smart glasses during sightseeing, the server refers to the user's preference information and emotional data, and adjusts the travel plan to a route that allows the user to relax. In this way, a personalized experience can be provided.

[0528] An example of a prompt message to input into the generating AI model might be, "Create a program that suggests nearby refresh spots when it detects stress from the user's facial expression."

[0529] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0530] Step 1:

[0531] Users input their preferences using their smartphones or smart glasses. This information is temporarily stored on the device before being sent to a server. The server stores this preference information in a database and queries tourist destination information to generate an initial travel plan. The output is personalized initial travel plan data.

[0532] Step 2:

[0533] Users receive information from a virtual guide via their smartphone or smart glasses while sightseeing. The device uses its camera and microphone to collect emotional data from the user's facial expressions and voice. This data is processed by the Google Cloud Vision API through an emotion engine to determine the user's emotional state. The output is real-time updated emotional state data.

[0534] Step 3:

[0535] When the server receives emotional state data, it adjusts the travel plan stored in the database. Specifically, it optimizes sightseeing routes and destinations based on the user's current emotional state. This process involves selecting appropriate tourist spots and simplifying routes. The output is the adjusted travel plan data.

[0536] Step 4:

[0537] Based on a customized travel plan, a virtual guide provides information to the user through a terminal. The terminal modifies the content and presentation method of the guidance according to the customized travel plan data. The virtual guide provides guidance to the user using voice and images. This allows the user to obtain a real-time, optimized sightseeing experience. As output, it provides the user with customized sightseeing information.

[0538] Step 5:

[0539] Users can share information they gain while sightseeing with other users. The device sends experiential information, along with emotional data, to a server, which is then stored in a database as information that may be used to inform other users' travel plans. The output is experiential information data that facilitates sharing among users.

[0540] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0541] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0542] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0543] [Fourth Embodiment]

[0544] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0545] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0546] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0547] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0548] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0549] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0550] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0551] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0552] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0553] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0554] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0555] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0556] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0557] This invention is a system in which a virtual guide provides tourist information by collecting user preference information and formulating individual travel plans based on that information. The implementation of this system involves a server and terminal working together to provide users with a personalized travel experience.

[0558] The server receives preference information entered by the user through their terminal and queries the database based on that information. This generates a travel plan tailored to the user's interests and preferences. This travel plan includes suggestions for tourist destinations, available activities, and accommodations.

[0559] The generated travel plan is sent to the terminal, which not only displays it to the user but also activates a virtual guide. The virtual guide provides detailed information about the destinations based on the travel plan and responds to the user's questions in real time. For example, if the user asks about the history or highlights of a particular tourist spot, the virtual guide will provide that information.

[0560] Users can share information and experiences gained during their travels with other users via their devices. In this process, the server facilitates information exchange among users and collects data to generate new suggestions. This fosters the formation of a community among users.

[0561] For example, if a user selects city A as their travel destination and indicates an interest in art, the server generates a travel plan that includes famous museums and art events in city A. Based on this travel plan, the terminal uses a virtual guide to provide real-time information about museums and events, enriching the user's experience.

[0562] Furthermore, the virtual guide provides users with promotional information on local shops and tourist attractions, encouraging them to participate in sales and events. This promotional activity is designed to revitalize the local economy.

[0563] In this way, this system, which integrates servers, terminals, and virtual guides, realizes a form that can meet individual needs while also contributing to regional revitalization.

[0564] The following describes the processing flow.

[0565] Step 1:

[0566] The user accesses the system using a device and logs in. The device displays a screen for the user to enter their favorite characters, themes of interest, and places they would like to visit. The user enters this preference information and presses the submit button.

[0567] Step 2:

[0568] The device sends collected preference information to the server. Based on the received information, the server searches relevant tourism databases and generates a travel plan tailored to the user. The travel plan includes potential destinations, accommodations, and recommended activities.

[0569] Step 3:

[0570] The server sends the generated travel plan to the terminal. The terminal presents this plan to the user for review. Once the user approves the plan, the terminal prepares to activate the virtual guide.

[0571] Step 4:

[0572] Once the user begins their trip, the device activates a virtual guide that leads them based on their travel plan. The virtual guide combines the user's current location with their schedule to provide real-time information about tourist attractions and answer questions.

[0573] Step 5:

[0574] During their travels, users can share their experiences and interesting information with other users through their devices. The devices send this information to a server, where it is stored in a database. The server uses the collected data to analyze new information with AI models and provide useful suggestions to other users.

[0575] Step 6:

[0576] The server sends promotional information about tourist destinations and shops to a virtual guide, providing users with events and coupons. The terminal displays notifications to users encouraging participation in local benefits and events, and interested users can obtain more detailed information.

[0577] (Example 1)

[0578] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0579] In recent years, there has been a growing demand for more fulfilling travel experiences that cater to individual travel needs. However, conventional travel planning systems can only provide uniform information, making it difficult to propose itineraries optimized for individual user preferences. Furthermore, the lack of efficient means for regional promotion activities meant that these systems were not adequately contributing to the revitalization of local economies.

[0580] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0581] In this invention, the server includes means for collecting individual user preference information, means for generating a travel plan using a generative model based on the preference information, and means for a guide to provide destination information to the user according to the generated travel plan. This enables the provision of travel plans optimized for the user and real-time information responses. Furthermore, by efficiently conducting local promotional activities, it becomes possible to contribute to the revitalization of the local economy.

[0582] "Preference information" refers to information about each user's individual interests and preferences, and serves as basic data for individually optimizing travel plans.

[0583] A "generative model" is a data processing technique used to automatically generate appropriate travel plans based on user preference information.

[0584] A "travel plan" is an itinerary that compiles information on tourist destinations to visit, activities to participate in, and accommodations, tailored to the user's preferences.

[0585] A "guide" is an interface or virtual agent that provides users with detailed travel information based on their travel plan and answers their questions.

[0586] "Information exchange" is a communication process in which users share information and experiences gained during their travels to use as a reference for new travel plans.

[0587] "Promotional activities" refer to activities aimed at revitalizing the local economy by providing users with specific promotional information to encourage the purchase of products or participation in events.

[0588] This invention is a system that provides travel plans based on user preference information, and mainly consists of a server, terminals, and a virtual guide. The role and specific operation of each component are described below.

[0589] The server receives preference information entered by the user from their device and generates an appropriate travel plan based on that information. In doing so, the server accesses a database to indirectly obtain information related to the user. The generated travel plan is created by an AI model (e.g., a generative AI model), evolving from traditional fixed planning to a more flexible and personalized approach. In particular, it includes suggestions for tourist destinations, available activities, and accommodations.

[0590] The terminal receives travel plans sent from the server and displays them to the user. It also activates a virtual guide to provide detailed information about tourist destinations and events of interest to the user. The virtual guide uses natural language processing technology to respond to user questions in real time. For example, if the user asks, "I want to know more about the exhibits currently on display at the XX Museum in City A," the virtual guide will provide a detailed answer.

[0591] Users can share information and experiences gained during their travels with other users via their devices. This sharing function promotes community building and can generate potential travel ideas. By exchanging their experiences with others and gaining new information, users can enjoy a richer travel experience.

[0592] Furthermore, virtual guides can effectively provide users with local promotional information. This includes information on local sales and events, which users can use to consider participating in or making purchases.

[0593] For example, a possible prompt message could be, "The user wants to plan an art-related sightseeing trip in city A. Please list information on the art history, attractions, and related events." This would allow for the provision of information that meets diverse tourism needs while also considering the revitalization of the local economy.

[0594] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0595] Step 1:

[0596] Users use their devices to input their travel destination preferences and areas of interest. This input includes specific requests for tourist spots and categories of interest (e.g., art, culture, food). This information is processed and sent as data to the server.

[0597] Step 2:

[0598] The server analyzes preference information received from the terminal. Based on the received data, it refers to a database and generates queries to retrieve relevant tourist information. Text analysis and machine learning algorithms are used here to understand the user's preferences. The acquired data is used as material for generating travel plans.

[0599] Step 3:

[0600] The server uses a generative AI model based on the analysis results and acquired tourist information to generate individual travel plans. During this process, prompt statements are input to the AI ​​model, and a travel itinerary tailored to the user's preferences is output. For example, a prompt statement such as "Focus on art-related facilities in city A" might be used.

[0601] Step 4:

[0602] The server sends the generated travel plan to the terminal. This output information includes selections of tourist attractions, activities, and accommodations at the travel destination. The terminal then prepares to immediately display the received information to the user.

[0603] Step 5:

[0604] The terminal displays the received travel plan to the user. Furthermore, the terminal activates a virtual guide, ready to provide the user with detailed information about the planned tourist destinations and activities as needed. The guide internally maintains data to respond immediately to user inquiries.

[0605] Step 6:

[0606] Users can share information and experiences gained during their travels with others through their devices. This input information is sent to the server as shared data for other users and exchanged within the community. The shared data is then compiled into a database to help with future travel suggestions.

[0607] Step 7:

[0608] The virtual guide provides users with local promotional information. This includes specific store sale information and details of events taking place in tourist areas. The outputted information is used to encourage user participation and consumption.

[0609] (Application Example 1)

[0610] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0611] Traditional travel planning systems lacked the ability to provide travel experiences tailored to individual user preferences, and also had limited efficiency in real-time information provision and information sharing among users. Therefore, there is a need to respond to the diverse needs of users and effectively provide regional promotion and visual guidance experiences.

[0612] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0613] In this invention, the server includes means for collecting information on the preferences of individual users, means for generating travel plans based on said preferences, and means for a virtual guide to provide information on tourist destinations to the individual according to the generated travel plan. This enables a personalized travel experience based on the user's preferences, as well as immediate information provision and effective local promotion by a virtual guide.

[0614] "Preferences" refer to the specific interests and concerns that an individual has.

[0615] A "travel plan" is a schedule or itinerary for a trip or visit created based on an individual's preferences.

[0616] A "virtual guide" is a digital agent that provides travel information to individuals.

[0617] A "tourist destination" is an interesting region or landmark intended for individual visitors.

[0618] "Means of collecting information" refers to methods and techniques for obtaining information about an individual's preferences.

[0619] "Sales activities" refer to promotional and marketing methods aimed at stimulating the commercial aspects of a region.

[0620] A "visual guided experience" is a virtual travel or visiting experience conducted through visual means.

[0621] In this invention, the system mainly consists of a server, a terminal, and a virtual guide. The server collects individual user preference information and generates individual travel plans based on that data. This involves querying and analyzing data in a database, and is achieved by utilizing software technologies such as Python and SQL. The travel plan generated by the server is sent to the terminal, where it is displayed in a format that is easy for the user to view.

[0622] The terminal is typically a smartphone, tablet, or head-mounted display, and is a device used by the user while traveling. A virtual guide is activated on the terminal and provides information in real time. The virtual guide uses machine learning technology to perform natural language processing and respond to the user's questions. This utilizes generative AI models and performs data processing on a cloud server.

[0623] For example, if a user types, "I'm interested in art, where should I visit?", the virtual guide sends a prompt to the server, retrieves relevant tourist information and event information, and presents it to the user. Also, when a user shares their experiences at a tourist destination with other users, the information is uploaded to the server via the device, making it accessible to other users.

[0624] For example, a prompt such as, "Please provide detailed information about tourist destinations you are interested in. My interests are art events and museums," is sent to the AI ​​model, which then presents tourist spots and event information tailored to the user. This entire process provides users with a personalized travel experience and also contributes to supporting local business activities.

[0625] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0626] Step 1:

[0627] The server collects user preference information. The input is data about the user's interests and preferences entered through their terminal. The server receives this information and stores it in a database. The output here is the preference information stored in the database.

[0628] Step 2:

[0629] The server generates a travel plan based on the preference information it collects. The input is the preference information collected in step 1. The server uses this information to query the database for appropriate tourist destinations and activities and formulates the optimal travel plan. The output is a travel plan tailored to the user's preferences.

[0630] Step 3:

[0631] The server generates a travel plan and sends it to the terminal. The input is the travel plan created in step 2. The server sends this plan data to the terminal in real time and converts the format so that it can be displayed on the terminal. The output is a visually formatted travel plan on the terminal.

[0632] Step 4:

[0633] A virtual guide is activated on the terminal and provides information to the user. The input is the travel plan sent to the terminal in step 3. The virtual guide utilizes a generative AI model to provide information in natural language in response to the user's questions. The output is detailed information about tourist destinations and events presented to the user.

[0634] Step 5:

[0635] This system allows users to share their travel experiences and information with other users. Input is experience information reported by the user on their device. The device uploads this information to a server and processes it for sharing among users. Output is experience information accessible on the sharing platform.

[0636] Step 6:

[0637] Local business activity information is delivered to users via a virtual guide. The input is promotional data for each region. The virtual guide receives this data and provides promotional information relevant to the user's travel plans. The output is information about local business activities displayed to the user.

[0638] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0639] This invention is a system that generates travel plans based on user preference information, has a virtual guide provide sightseeing information, and uses an emotion engine to recognize the user's emotions and provide information and suggestions accordingly.

[0640] The emotion engine analyzes the user's facial expressions, speech, and actions, and sends the results to the server. The server then adjusts the virtual guide's responses in real time based on the acquired emotion data. This adjustment makes the travel experience more personalized and satisfying.

[0641] The server queries relevant tourism databases based on preference information entered by the user through their device and generates an initial travel plan. The emotion engine continuously detects the user's emotions during the trip, and the server dynamically adjusts the travel plan based on this data. For example, if the emotion engine determines that the user is tired, the server can add relaxing activities or destinations.

[0642] The device provides this information to the user, and a virtual guide provides directions to the tourist destination accordingly. The virtual guide customizes the content and tone of the information according to the user's current emotional state. This dynamic, emotion-based adjustment can enhance the user's satisfaction during their trip.

[0643] For example, if a user inputs an interest in history and begins planning a trip, but the emotion engine detects discomfort or fatigue along the way, the virtual guide can suggest nearby cafes or parks where the user can refresh themselves. This allows the user to continue their trip comfortably.

[0644] Furthermore, information sharing among users is also promoted. When users share their experiences and feelings, the emotional data analyzed by the emotion engine is used as reference, and the information is aggregated on the server as useful information for other users. This information is also used to generate new travel suggestions.

[0645] This system will allow for more personalized promotional activities for tourist destinations and shops, enabling approaches tailored to the emotions of users. In this way, the present invention provides travel support technology that takes user emotions into consideration, meeting individual needs while also contributing to regional revitalization.

[0646] The following describes the processing flow.

[0647] Step 1:

[0648] The user logs in using their device and accesses the system. The device displays a screen where the user can enter their preferences, such as favorite themes, categories of interest, and places they plan to visit. The user enters the information and presses the submit button.

[0649] Step 2:

[0650] The terminal sends the collected preference information to the server. Based on the received preference information, the server searches relevant tourism databases and generates a personalized travel plan for the user. This plan includes information such as tourist destinations to visit, available activities, and transportation options.

[0651] Step 3:

[0652] The server sends the generated travel plan to the terminal. The terminal displays the plan to the user and activates a virtual guide. The virtual guide begins providing tourist information based on the user's interests.

[0653] Step 4:

[0654] The emotion engine activates and analyzes the user's emotions in real time based on their facial expressions and speech. The device periodically sends the user's emotion data to the server via the emotion engine.

[0655] Step 5:

[0656] The server dynamically adjusts the travel plan based on the emotional data it collects. For example, if the server determines that the user is feeling tired, it will add relaxing spots and activities to the plan.

[0657] Step 6:

[0658] Users can share information and new emotions they experience during their travels with other users through their devices. The device sends the user experience, along with emotional data, to a server. The server stores this data in a database and provides it to other users as valuable information.

[0659] Step 7:

[0660] The virtual guide adjusts the tone and content of information provided based on acquired emotional data, offering optimal tourism support tailored to the user's state. It also provides promotional information for local businesses, matching the user's emotions to encourage participation. By participating in promotions that interest the user, it contributes to the revitalization of the local economy.

[0661] (Example 2)

[0662] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0663] In recent years, providing travel plans tailored to the individual preferences of users has become increasingly important. However, current systems fail to adequately consider users' instantaneous emotions and lack the flexibility to respond to unexpected situations. As a result, satisfaction during travel is not fully achieved. In particular, there are problems with the flexibility of dynamic plan adjustments and information provision in response to changes in users' emotions.

[0664] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0665] In this invention, the server includes means for collecting individual user preference information, means for evaluating emotions using an emotion analysis engine that analyzes the user's facial expressions and speech, and means for dynamically adjusting the travel plan based on the emotional state. This enables personalized information provision and plan adjustment in response to the user's preferences and instantaneous emotional changes.

[0666] "Preference information" refers to data about users' interests and preferences, and is fundamental information in generating travel plans.

[0667] A "travel plan" refers to a plan that includes an itinerary, the order in which to visit tourist spots, and activities, all suggested based on the user's preferences.

[0668] An "emotion analysis engine" refers to software or a system that analyzes a user's facial expressions and speech to evaluate their emotional state.

[0669] A "virtual guide" refers to a program or agent that provides users with tourist information and advice via audio or text during their travels.

[0670] "Dynamic adjustment" refers to the process of modifying or changing travel plans in real time based on the user's emotional state and other conditions.

[0671] "Promotional activities" refer to marketing and advertising activities aimed at enhancing the appeal of a region or tourist destination and increasing the number of visitors.

[0672] "Information sharing" refers to the process of users exchanging experiences and knowledge gained during their travels with other users, thereby promoting communication and engagement.

[0673] This system provides personalized travel plans using user preference information and emotional data. Specifically, it consists of three components: a server, a terminal, and the user. The server collects preference information from user input and generates an initial travel plan based on it. Generating the travel plan involves querying a travel database and related information bases. The terminal is equipped with an emotional analysis engine that analyzes the user's facial expressions and speech. This allows the user's emotional state to be evaluated in real time. The evaluated emotional data is sent to the server, which dynamically adjusts the travel plan.

[0674] The virtual guide provides information about tourist destinations via voice or text, based on a pre-arranged plan. The information provided varies depending on the user's emotions, and a conversational algorithm is used to enable flexible communication. The user's impressions and feedback during the trip are shared with other users and stored on the server as sentiment-analyzed data. This data is used to generate new travel plans, enabling more personalized suggestions.

[0675] For example, if a user uses the system with the prompt, "I'd like you to introduce me to historical tourist attractions, but I'm also tired, so please suggest some relaxing spots," the sentiment analysis engine will detect the user's fatigue level during their trip. The server can then add activities and locations that provide comfort to the travel plan, and the virtual guide can provide this information to the user. This makes the user's travel experience more satisfying.

[0676] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0677] Step 1:

[0678] Users input preference information via their devices. This input includes genres of tourist destinations they are interested in and activities they enjoy. This input data is temporarily stored on the device and then transferred to the server. The device confirms the input data and prepares it for transmission to the server.

[0679] Step 2:

[0680] The server queries the tourism database based on the received preference information. Specifically, it executes a database query to retrieve a list of relevant tourist attractions and activities. As a result of this database query, it generates an initial travel plan. The server temporarily stores the generated plan along with the user's identification information.

[0681] Step 3:

[0682] The emotion analysis engine built into the device collects the user's facial expressions and speech in real time and analyzes the emotional data. Specifically, it acquires data using the camera and microphone, and infers the emotional state through image processing and voice analysis. The analysis results are quantified as an emotional state and sent to the server.

[0683] Step 4:

[0684] The server dynamically adjusts the travel plan in real time based on emotional data received from the emotion analysis engine. For example, if the user's emotional state indicates "fatigue," the server searches for and adds locations that offer a relaxing environment. This updates the travel plan, making it flexibly customized.

[0685] Step 5:

[0686] The device provides users with tourist information through a virtual guide based on a pre-arranged travel plan. The virtual guide presents the information in a tone and content that reflects sentiment analysis data. The device also functions as an interface for receiving further feedback from the user.

[0687] Step 6:

[0688] Users share their travel experiences and feedback with other users via their devices. This shared information is aggregated on a server and used as data to help generate future travel plans. This data is also used to improve the accuracy of travel suggestions and recommend new tourist destinations.

[0689] (Application Example 2)

[0690] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0691] Traditional travel itineraries offered to tourists often fail to take into account the emotional state and real-time reactions of individual travelers, making it difficult to provide them with the best possible experience. Furthermore, the lack of individualized information sharing among travelers and the absence of personalized local promotional activities make efficient marketing challenging.

[0692] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0693] In this invention, the server includes emotion recognition means for determining the emotional state of a user, means for dynamically adjusting the travel plan based on the emotional state, and means for providing tourist information appropriate to the emotional state based on the adjusted travel plan. This makes it possible to provide travel plans that respond to the user's emotions in real time, improving the quality of the tourist experience, and enabling the personalization of information sharing among users and local promotional activities.

[0694] "User preference information" refers to data that indicates the interests and preferences of individual users, and is information that allows for the provision of customized services based on this information.

[0695] A "travel plan" is a detailed plan outlining the destinations and activities a user will engage in during their trip.

[0696] A "virtual guide" is a digitized guide character that provides users with travel-related information.

[0697] "Emotion recognition means" refers to a technology or device that analyzes a user's facial expressions, voice, and actions to determine their emotional state in real time.

[0698] "Means of dynamic adjustment" refers to methods or devices for modifying plans or proposals in real time based on acquired data and circumstances.

[0699] This system combines multiple technologies to provide an optimal travel plan based on the user's preferences and emotional state. The server first stores the user's preferences in a database, and then uses this data to query tourist destination information and generate an initial travel plan. This plan is dynamically adjusted by the emotion recognition mechanism described later.

[0700] Users receive information from a virtual guide during their trip using devices such as smartphones or smart glasses. The emotion engine utilizes emotion recognition software, such as the Google Cloud Vision API, to determine the user's current emotional state in real time by analyzing facial expressions and voice input. The determined emotion data is sent to a server and used to adjust the travel plan. The server is built using programming languages ​​such as Python, and the backend is implemented using Flask or Django. A relational database management system such as PostgreSQL is used for organizing the tourist information.

[0701] During the trip, the virtual guide adjusts the content and presentation of information according to the user's emotional state. For example, if the user is feeling tired, it can suggest places to refresh themselves, such as a nearby cafe or park. This dynamic adjustment improves the quality of the sightseeing experience and optimizes information sharing among users and local promotional activities.

[0702] For example, suppose a user visits a city over the weekend. This user is wearing smart glasses while sightseeing. Based on the information sensed by the smart glasses during sightseeing, the server refers to the user's preference information and emotional data, and adjusts the travel plan to a route that allows the user to relax. In this way, a personalized experience can be provided.

[0703] An example of a prompt message to input into the generating AI model might be, "Create a program that suggests nearby refresh spots when it detects stress from the user's facial expression."

[0704] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0705] Step 1:

[0706] Users input their preferences using their smartphones or smart glasses. This information is temporarily stored on the device before being sent to a server. The server stores this preference information in a database and queries tourist destination information to generate an initial travel plan. The output is personalized initial travel plan data.

[0707] Step 2:

[0708] Users receive information from a virtual guide via their smartphone or smart glasses while sightseeing. The device uses its camera and microphone to collect emotional data from the user's facial expressions and voice. This data is processed by the Google Cloud Vision API through an emotion engine to determine the user's emotional state. The output is real-time updated emotional state data.

[0709] Step 3:

[0710] When the server receives emotional state data, it adjusts the travel plan stored in the database. Specifically, it optimizes sightseeing routes and destinations based on the user's current emotional state. This process involves selecting appropriate tourist spots and simplifying routes. The output is the adjusted travel plan data.

[0711] Step 4:

[0712] Based on a customized travel plan, a virtual guide provides information to the user through a terminal. The terminal modifies the content and presentation method of the guidance according to the customized travel plan data. The virtual guide provides guidance to the user using voice and images. This allows the user to obtain a real-time, optimized sightseeing experience. As output, it provides the user with customized sightseeing information.

[0713] Step 5:

[0714] Users can share information they gain while sightseeing with other users. The device sends experiential information, along with emotional data, to a server, which is then stored in a database as information that may be used to inform other users' travel plans. The output is experiential information data that facilitates sharing among users.

[0715] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0716] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0717] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0718] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0719] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0720] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0721] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0722] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0723] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0724] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0725] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0726] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0727] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0728] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0729] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0730] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0731] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0732] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0733] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0734] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0735] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0736] The following is further disclosed regarding the embodiments described above.

[0737] (Claim 1)

[0738] A means of collecting information on individual users' preferences,

[0739] Means for generating a travel plan based on the aforementioned preference information,

[0740] A means by which a virtual guide provides tourist information to the user according to the generated travel plan,

[0741] A means for users to share information they obtained during their travels with other users,

[0742] A means of conducting regional promotion activities through virtual guides,

[0743] A system that includes this.

[0744] (Claim 2)

[0745] The system according to claim 1, wherein the virtual guide provides information in real time using a conversational algorithm.

[0746] (Claim 3)

[0747] The system according to claim 1, which facilitates information sharing among users by using means for exchanging information between agents.

[0748] "Example 1"

[0749] (Claim 1)

[0750] A means of collecting information on individual users' preferences,

[0751] A means for generating a travel plan using a generative model based on the aforementioned preference information,

[0752] A means by which a guide provides destination information to users according to the generated travel plan,

[0753] A means for users to exchange information they obtain during their travels with other users,

[0754] A means of conducting local sales promotion activities through guides,

[0755] A system that includes this.

[0756] (Claim 2)

[0757] The system according to claim 1, wherein the aforementioned guide provides information immediately using interactive processing.

[0758] (Claim 3)

[0759] The system according to claim 1, which facilitates information exchange among users by using means for exchanging information between things.

[0760] "Application Example 1"

[0761] (Claim 1)

[0762] Means for collecting information about the preferences of individual users,

[0763] Means for generating a travel plan based on the aforementioned preferences,

[0764] A means by which a virtual guide provides information about tourist destinations to individuals according to a generated travel plan,

[0765] A means for individuals to share information they obtain while traveling with other individuals,

[0766] A means of conducting local sales activities through a virtual guide,

[0767] A means of providing a visual guidance experience tailored to individual interests,

[0768] A system that includes this.

[0769] (Claim 2)

[0770] The system according to claim 1, wherein the virtual guide provides information immediately using an interactive algorithm.

[0771] (Claim 3)

[0772] The system according to claim 1, which facilitates information sharing among individuals by using means for exchanging information among guides.

[0773] "Example 2 of combining an emotion engine"

[0774] (Claim 1)

[0775] A means of collecting information on individual users' preferences,

[0776] Means for generating a travel plan based on the aforementioned preference information,

[0777] A means of evaluating emotional state using an emotion analysis engine that analyzes the user's facial expressions and speech,

[0778] Means for dynamically adjusting the travel plan based on the aforementioned emotional state,

[0779] A means by which a virtual guide provides tourist information to users according to a coordinated travel plan,

[0780] A means for users to share information they obtained during their travels with other users,

[0781] A means of conducting regional promotion activities through virtual guides,

[0782] A system that includes this.

[0783] (Claim 2)

[0784] The system according to claim 1, wherein the virtual guide provides information in a tone that corresponds to the user's emotions using a conversational algorithm.

[0785] (Claim 3)

[0786] The system according to claim 1, which facilitates information sharing among users by using means for exchanging data including emotional information between agents.

[0787] "Application example 2 when combining with an emotional engine"

[0788] (Claim 1)

[0789] A means of collecting information on individual users' preferences,

[0790] Means for generating a travel plan based on the aforementioned preference information,

[0791] A means by which a virtual guide provides tourist information to the user according to the generated travel plan,

[0792] An emotion recognition means for determining the emotional state of the user,

[0793] Means for dynamically adjusting the travel plan based on the aforementioned emotional state,

[0794] A means of providing tourist information appropriate to the emotional state based on a tailored travel plan,

[0795] A means for users to share information they obtained during their travels with other users,

[0796] A means of conducting local promotional activities through virtual guides,

[0797] A system that includes this.

[0798] (Claim 2)

[0799] The system according to claim 1, wherein the virtual guide provides information in real time using a conversational algorithm and further adjusts the content and presentation method of the information based on the emotion recognition results.

[0800] (Claim 3)

[0801] The system according to claim 1, which facilitates information sharing among users by using means for exchanging information among agents, and further provides new means of facilitating information sharing by utilizing emotional data. [Explanation of Symbols]

[0802] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. Means for collecting information about the preferences of individual users, Means for generating a travel plan based on the aforementioned preferences, A means by which a virtual guide provides information about tourist destinations to individuals according to a generated travel plan, A means for individuals to share information they obtain while traveling with other individuals, A means of conducting local sales activities through a virtual guide, A means of providing a visual guidance experience tailored to individual interests, A system that includes this.

2. The system according to claim 1, wherein the virtual guide provides information immediately using an interactive algorithm.

3. The system according to claim 1, which facilitates information sharing among individuals by using means for exchanging information among guides.

Images