System

Abstract

A system according to an embodiment is directed to integrating traveler information and providing personalized travel plans.SOLUTION: A system according to an embodiment includes an information integrator, a plan provider, and an information updater. The information integration unit integrates information of travelers. The plan provider provides a personalized travel plan based on the information integrated by the information integrator. The information updating unit updates information in real time based on the travel plan provided by the plan providing unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional technology has had the problem that traveler information is scattered, making it difficult to provide personalized travel plans.

[0005] The system according to the embodiment aims to integrate information of travelers and provide personalized travel plans. [Means for solving the problem]

[0006] The system according to the embodiment includes an information integration unit, a plan providing unit, and an information updating unit. The information integration unit integrates information about travelers. The plan providing unit provides personalized travel plans based on the information integrated by the information integration unit. The information updating unit updates information in real time based on the travel plans provided by the plan providing unit. [Effects of the Invention]

[0007] The system according to the embodiment can integrate traveler information and provide personalized travel plans. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. DETAILED DESCRIPTION OF THE INVENTION

[0009] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0010] First, the terms used in the following description will be explained.

[0011] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (Tensor Processing Unit).

[0012] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0013] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0014] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), and Bluetooth (registered trademark).

[0015] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0016] [First embodiment] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0017] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0018] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0019] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0020] The reception device 38 includes a touch panel 38A and a microphone 38B, and receives user input. The touch panel 38A detects contact with a pointer (for example, a pen or a finger) to receive user input by the touch of the pointer. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 (see FIG. 2) acquires the data indicating the user input.

[0021] Output device 40 includes a display 40A and a speaker 40B, and presents data to a user by outputting the data in a form of expression that the user can perceive (e.g., audio and / or text). Display 40A displays visible information such as text and images in accordance with instructions from processor 46. Speaker 40B outputs audio in accordance with instructions from processor 46. Camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0022] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0023] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0024] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0025] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. The identification processing unit 290 can estimate a user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion. The emotion estimation function (emotion identification function) using the emotion identification model 59 performs various estimations and predictions regarding the user's emotion, including estimation and prediction of the user's emotion, but is not limited to these examples. Furthermore, the estimation and prediction of emotion also includes, for example, emotion analysis.

[0026] In the smart device 14, the specific processing is performed by the processor 46. The storage 50 stores a specific processing program 60. The specific processing program 60 is used together with the specific processing program 56 by the data processing system 10. The processor 46 reads the specific processing program 60 from the storage 50 and executes the read specific processing program 60 on the RAM 48. The specific processing is realized by the processor 46 operating as the control unit 46A in accordance with the specific processing program 60 executed on the RAM 48. Note that the smart device 14 has a data generation model and an emotion identification model similar to the data generation model 58 and the emotion identification model 59, and can also perform processing similar to that of the specific processing unit 290 using these models.

[0027] Note that a device other than the data processing device 12 may have the data generation model 58. For example, a server device (e.g., a generation server) may have the data generation model 58. In this case, the data processing device 12 obtains a processing result (prediction result, etc.) using the data generation model 58 by communicating with the server device having the data generation model 58. Furthermore, the data processing device 12 may be a server device, or may be a terminal device owned by a user (e.g., a mobile phone, a robot, a home appliance, etc.). Next, an example of processing by the data processing system 10 according to the first embodiment will be described.

[0028] (Example 1) The AI ​​travel concierge according to an embodiment of the present invention is a system that integrates traveler information, generates personalized travel plans using AI, and updates the information in real time, thereby providing travelers with a convenient and comfortable travel experience.

[0029] The AI ​​travel concierge according to the embodiment includes an information integration unit, a plan providing unit, and an information updating unit. The information integration unit integrates traveler information. For example, it integrates the traveler's personal information, travel history, preferences, etc. into a database. The information integration unit can also analyze the traveler's past search history and social media posts to automatically collect and integrate individual travel information. For example, it can analyze the traveler's past search history to automatically list tourist spots and activities that the traveler is interested in. It can also analyze social media posts to collect information on places the traveler has visited and events they have participated in. The plan providing unit provides personalized travel plans based on the information integrated by the information integration unit. For example, it can analyze the traveler's preferences and past travel history to provide individually customized travel plans. If a traveler inputs information such as "I like visiting museums," the generation AI can propose an optimal museum tour plan based on that information. The plan providing unit can also analyze the traveler's biometric data (e.g., heart rate, stress level) and propose optimal travel plans. For example, it can monitor the traveler's heart rate and stress level and propose relaxing travel plans based on that data. The information update unit updates information in real time based on the travel plan provided by the plan provision unit. For example, it notifies users of flight delays, weather changes, and the congestion status of tourist attractions in real time. The information update unit can also provide real-time information on nearby events and activities based on the traveler's location information. For example, it provides information on nearby events and activities in real time based on the traveler's location information. This allows the travel AI concierge according to the embodiment to provide travelers with a convenient and comfortable travel experience. For example, if a traveler gets lost, the information update unit provides navigation in real time. If a traveler has difficulty communicating in the local language, the information update unit provides a translation function. If a traveler needs to contact a medical institution or receive first aid instructions in an emergency, the information update unit provides appropriate support.

[0030] The information integration unit can analyze a traveler's past search history and social media posts to automatically collect and integrate individual travel information. For example, the information integration unit analyzes a traveler's past search history to automatically list tourist attractions and activities of interest. For example, it integrates information about museums and restaurants searched for in the past. The information integration unit also analyzes social media posts to collect information about places visited and events attended by a traveler. For example, it extracts information about tourist attractions visited by a traveler from Instagram posts. The information integration unit also combines a traveler's past search history and social media posts to automatically integrate travel information based on the traveler's interests and preferences. For example, it identifies a traveler's favorite tourist attractions from the search history and post content. This allows individual travel information to be automatically collected and integrated by analyzing a traveler's past search history and social media posts.

[0031] The information integration unit can integrate appropriate medical facilities and dining options by taking into account the traveler's health condition and allergy information. For example, the information integration unit inputs the traveler's health condition in advance and lists appropriate medical facilities based on that information. For example, it provides information on hospitals and clinics near the travel destination. The information integration unit also considers the traveler's allergy information and suggests restaurants and dining options that accommodate allergies. For example, it lists gluten-free and vegetarian restaurants. The information integration unit also provides information on medicines and first aid needed during the trip based on the health condition and allergy information. For example, it integrates information on pharmacies and first aid kits that can be purchased at the travel destination. In this way, appropriate medical facilities and dining options can be integrated by taking into account the traveler's health condition and allergy information.

[0032] The information integrator can be combined with a voice assistant to enable information collection through voice input. The information integrator, for example, uses a voice assistant to enable travelers to input information through voice. For example, it collects information through voice commands such as "Tell me about nearby restaurants." The information integrator also provides necessary information in real time when travelers ask questions through the voice assistant. For example, it provides an immediate answer to a question such as "What time is the next flight?" The information integrator also uses a voice assistant to enable travelers to plan their trip through voice. For example, it generates a trip plan through a voice command such as "Tell me about tomorrow's sightseeing plans." In this way, by combining a voice assistant, it becomes possible to collect information through voice input.

[0033] The information integration unit can be linked with AR technology to provide visual guides for local areas. For example, the information integration unit uses AR technology to visually display information about tourist attractions and restaurants when a traveler holds their smartphone over a local area. For example, the information integration unit displays the history and business hours of the tourist attraction. The information integration unit also uses AR technology to provide visual navigation when a traveler gets lost at a local area. For example, the information integration unit displays the direction to go using the smartphone's camera. The information integration unit also utilizes AR technology to enable a traveler to visually check information about local activities and events. For example, when the traveler holds their smartphone over a local area, information about events being held nearby is displayed. In this way, by linking with AR technology, a visual guide for local areas can be provided.

[0034] The plan providing unit can analyze the traveler's biometric data (heart rate, stress level, etc.) and propose the optimal travel plan. For example, the plan providing unit monitors the traveler's heart rate and stress level and proposes a relaxing travel plan based on that data. For example, it can propose a plan that includes spa and relaxation facilities. The plan providing unit also analyzes the biometric data and proposes activities tailored to the traveler's physical condition. For example, if the heart rate is high, it can propose a light activity, and if the stress level is low, it can propose an adventure activity. The plan providing unit also proposes a meal plan based on the traveler's health condition based on the traveler's biometric data. For example, if the stress level is high, it can propose a restaurant that serves meals that have a relaxing effect. In this way, the optimal travel plan can be proposed by analyzing the traveler's biometric data.

[0035] The plan providing unit can generate more accurate personalized plans based on the traveler's past reviews and ratings. The plan providing unit, for example, analyzes the traveler's past reviews and ratings to understand the traveler's preferences and trends and generate personalized plans. For example, tourist spots and restaurants that have been highly rated in the past are preferentially incorporated into the plan. The plan providing unit also generates plans based on the traveler's past reviews and with reference to ratings from other travelers with similar preferences. For example, it suggests spots that have been highly rated by travelers with the same hobbies. The plan providing unit also analyzes the traveler's past rating data and generates plans that emphasize points that the traveler found particularly satisfying. For example, it re-suggests spots that were particularly satisfying among places visited in the past. This makes it possible to generate more accurate personalized plans based on the traveler's past reviews and ratings.

[0036] The plan providing unit can combine reviews and ratings from other travelers to provide more reliable plans. The plan providing unit provides highly reliable personalized plans based on, for example, the reviews and ratings of other travelers. For example, it prioritizes incorporating highly rated tourist spots and restaurants into the plan. The plan providing unit also generates optimal travel plans by combining the traveler's preferences with the ratings of other travelers. For example, it suggests spots that have been highly rated by travelers with the same hobbies. The plan providing unit also analyzes the reviews of other travelers to provide personalized plans based on highly reliable information. For example, it prioritizes incorporating spots that have been highly rated by travelers who have visited in the past into the plan. In this way, by combining the reviews and ratings of other travelers, it is possible to provide more reliable plans.

[0037] The plan providing unit can add a function that allows travel plans to be shared with family and friends and to collaboratively customize the plan. The plan providing unit, for example, provides a function that allows travel plans to be shared with family and friends and to collaboratively customize the plan. For example, it allows comments and suggestions to be added to the shared plan. The plan providing unit also provides a function that allows travel plans to be shared in real time and to be adjusted together with family and friends. For example, it allows changes to be made to the shared plan in real time. The plan providing unit also provides an interface for sharing travel plans and collaboratively customizing them with family and friends. For example, it adds a voting function for shared plans and adopts the most popular suggestions. In this way, by adding a function that allows travel plans to be shared with family and friends and to collaboratively customize them, it is possible to provide more satisfying travel plans.

[0038] The information update unit can provide real-time information on nearby events and activities based on the traveler's location information. The information update unit, for example, provides information on nearby events and activities based on the traveler's location information in real time. For example, it notifies the traveler of information on nearby festivals and concerts. The information update unit also analyzes the traveler's location information and provides information on nearby tourist spots and activities in real time. For example, it displays the opening hours and congestion status of nearby tourist spots and activities. The information update unit also provides information on nearby restaurants and cafes in real time based on the traveler's location information. For example, it notifies the traveler of the menus and reservation status of nearby restaurants. This makes it possible to provide real-time information on nearby events and activities based on the traveler's location information.

[0039] The information updating unit can propose optimal means of transportation and routes in real time according to the traveler's schedule. The information updating unit, for example, analyzes the traveler's schedule and proposes optimal means of transportation and routes in real time. For example, it proposes the optimal means of transportation to arrive on time for the next appointment. The information updating unit also provides traffic information in real time based on the traveler's schedule and proposes the optimal route. For example, it adjusts the route based on traffic congestion information and public transportation delay information. The information updating unit also takes the traveler's schedule into consideration and proposes the optimal route in real time to minimize travel time. For example, it proposes the shortest route or the most efficient means of transportation. This makes it possible to propose optimal means of transportation and routes in real time according to the traveler's schedule.

[0040] The information update unit can link IoT devices and provide local environmental information (temperature, humidity, etc.). For example, the information update unit uses IoT devices to provide environmental information such as local temperature and humidity in real time. For example, it notifies travelers of the current temperature and humidity when they go out. The information update unit also links IoT devices and provides travelers with appropriate advice based on local environmental information. For example, it suggests cooler places when the temperature is high. The information update unit also uses IoT devices to collect local environmental information in real time and provide it to travelers. For example, it notifies travelers to bring an umbrella if it looks like it might rain. In this way, local environmental information can be provided by linking IoT devices.

[0041] The information update unit can link with the traveler's social media account to obtain and provide real-time information from friends and followers. For example, the information update unit can link with the traveler's social media account to obtain and provide real-time information from friends and followers. For example, it can notify the traveler of information and reviews of tourist spots visited by friends. The information update unit also enables the traveler to receive information from friends and followers in real time through the social media account. For example, it can share information about places that friends are currently visiting. The information update unit also links with the traveler's social media account to adjust travel plans based on real-time information from friends and followers. For example, it can add restaurants that friends have given high ratings to the plans. In this way, by linking with the traveler's social media account, it is possible to obtain and provide real-time information from friends and followers.

[0042] The information updating unit can monitor the traveler's health condition and provide instructions to contact a medical institution or administer first aid as necessary. The information updating unit, for example, monitors the traveler's health condition and automatically contacts a medical institution if an abnormality is detected. For example, if the heart rate is abnormally high, it will contact a nearby hospital. The information updating unit also analyzes the health condition in real time and provides instructions for first aid as necessary. For example, if the traveler shows symptoms of heatstroke, it will instruct appropriate first aid. The information updating unit also monitors the traveler's health condition and notifies the traveler if an abnormality is detected, urging them to contact a medical institution. For example, if blood pressure is abnormally high, it will recommend contacting a medical institution. This makes it possible to monitor the traveler's health condition and provide instructions to contact a medical institution or administer first aid as necessary.

[0043] The information update unit can analyze the language skills of travelers and enhance the translation function that supports communication in the local language. The information update unit, for example, analyzes the language skills of travelers and provides a translation function that supports communication in the local language. For example, it performs real-time translation when travelers converse with local people. The information update unit also supports travelers to communicate smoothly in the local language based on their language skills. For example, it provides menu translations when travelers order at restaurants. The information update unit also analyzes the language skills of travelers and provides a phrasebook to support communication in the local language. For example, it allows travelers to learn frequently used phrases in advance. This allows the translation function that analyzes the language skills of travelers and supports communication in the local language to be enhanced.

[0044] The information update unit can add collaboration with local guides and local experts to provide more detailed information. The information update unit, for example, collaborates with local guides and local experts to provide travelers with more detailed information. For example, it can provide recommended information on local tourist attractions and restaurants. The information update unit can also collaborate with local experts to support travelers in participating in local activities and events. For example, it can provide information on local guided tours and workshops. The information update unit can also collaborate with local guides to support travelers in dealing with local problems. For example, a local guide can provide navigation if a traveler gets lost. In this way, by adding collaboration with local guides and local experts, more detailed information can be provided.

[0045] The information update unit can work in conjunction with a traveler's smartwatch or fitness tracker to support health management. The information update unit, for example, works in conjunction with a traveler's smartwatch or fitness tracker to monitor their health condition. For example, it analyzes their heart rate and step count in real time to support health management. The information update unit also provides appropriate health advice to travelers based on data from the smartwatch or fitness tracker. For example, it can suggest walking courses if they are not getting enough exercise. The information update unit also works in conjunction with a fitness tracker to monitor the traveler's health condition in real time and notify them if an abnormality is detected. For example, it recommends taking a break if an abnormally high heart rate is detected. In this way, health management can be supported by working in conjunction with a traveler's smartwatch or fitness tracker.

[0046] The information updating unit can analyze traveler feedback and generate a detailed report to be reflected in the next travel plan. The information updating unit, for example, analyzes traveler feedback and generates a detailed report to be reflected in the next travel plan. For example, it incorporates spots and activities that the traveler has given high ratings into the next plan. The information updating unit also analyzes the traveler's preferences and tendencies in detail based on the content of the feedback and customizes the next travel plan. For example, it reflects restaurants and tourist spots that the traveler was particularly satisfied with in the next plan. The information updating unit also analyzes traveler feedback and automatically generates a report to be reflected in the next travel plan. For example, it creates a report that includes suggestions for improving points that the traveler was dissatisfied with. This makes it possible to analyze traveler feedback and generate a detailed report to be reflected in the next travel plan.

[0047] The information updating unit can analyze the traveler's preferences and trends in more detail based on the content of the feedback, and highly personalize the next travel plan. The information updating unit, for example, analyzes the preferences and trends in more detail based on the traveler's feedback, and highly personalize the next travel plan. For example, it incorporates activities that the traveler is particularly interested in into the next plan. The information updating unit also analyzes the content of the feedback, understands the traveler's preferences and trends, and customizes the next travel plan. For example, it reflects tourist spots and restaurants that the traveler has given high ratings in the next plan. The information updating unit also analyzes the traveler's feedback in more detail, and builds a system for highly personalizing the next travel plan. For example, it automatically generates an optimal plan based on the traveler's preferences and trends. This allows the traveler's preferences and trends to be analyzed in more detail based on the content of the feedback, and highly personalize the next travel plan.

[0048] The information updating unit can include photos and videos of travelers in the feedback collection, enabling visual feedback. For example, the information updating unit allows travelers to upload photos and videos when providing feedback. For example, photos of tourist spots and restaurants visited by the travelers are included in the feedback. The information updating unit also adds visual elements to the feedback collection, enabling travelers to provide detailed feedback through photos and videos. For example, videos taken by the travelers are included in the feedback. The information updating unit also customizes the next travel plan based on visual information by including photos and videos in the travelers' feedback. For example, tourist spots are evaluated based on photos taken by the travelers. In this way, visual feedback is enabled by including photos and videos of travelers in the feedback collection.

[0049] The information update unit can add a function to generate and share recommended information for other travelers based on feedback. The information update unit provides a function to generate and share recommended information for other travelers based on traveler feedback, for example. For example, information about highly rated tourist spots and restaurants is shared with other travelers. The information update unit also analyzes the content of the feedback and builds a system that generates recommended information for other travelers. For example, it suggests to other travelers spots that the traveler was particularly satisfied with. The information update unit also adds a function to generate and share recommended information for other travelers based on traveler feedback. For example, it introduces activities that the traveler has given a high rating to other travelers. In this way, by adding a function to generate and share recommended information for other travelers based on feedback, it is possible to provide useful information to other travelers as well.

[0050] The system according to the embodiment is not limited to the above-described example, and various modifications are possible, for example, as follows.

[0051] The information integration unit can integrate appropriate medical facilities and dining options by taking into account the traveler's health condition and allergy information. For example, a traveler can enter their health condition in advance and use that information to list appropriate medical facilities. It provides information on hospitals and clinics near the travel destination. It also takes into account the traveler's allergy information and suggests restaurants and dining options that cater to allergies. It can also list gluten-free and vegetarian restaurants. It also provides information on medicines and first aid needed during the trip based on the traveler's health condition and allergy information. It can also integrate information on pharmacies and first aid kits that can be purchased at the travel destination.

[0052] The information integration unit can be combined with a voice assistant to enable information collection through voice input. For example, a voice assistant can be used to allow travelers to input information through voice. Information can be collected through voice commands such as "Tell me about nearby restaurants." Travelers can also ask questions through the voice assistant, which provides the necessary information in real time. Questions such as "What time is the next flight?" can be answered instantly. Furthermore, the voice assistant can be used to allow travelers to plan their trips through voice. It is also possible to generate a trip plan through a voice command such as "Tell me about tomorrow's sightseeing plans."

[0053] The information integration unit can be linked with AR technology to provide visual guidance on-site. For example, AR technology can be used to visually display information about tourist attractions and restaurants when a traveler holds their smartphone over a tourist spot. The history and opening hours of the tourist spot can be displayed. AR technology can also be used to provide visual navigation when a traveler gets lost on-site. The direction to go can be displayed using the smartphone's camera. AR technology can also be used to visually check information about local activities and events. It is also possible to display information about nearby events by holding a smartphone over the location.

[0054] The information integration unit can generate more accurate personalized plans based on travelers' past reviews and ratings. For example, it can analyze travelers' past reviews and ratings to understand their preferences and trends and generate personalized plans. It can prioritize tourist spots and restaurants that have been highly rated in the past and incorporate them into the plan. It can also generate plans based on travelers' past reviews and taking into account the ratings of other travelers with similar preferences. It can suggest spots that have been highly rated by travelers with the same hobbies. It can also analyze travelers' past rating data and generate plans that emphasize points that travelers found particularly satisfying. It can also re-suggest spots that travelers have visited in the past that they found particularly satisfying.

[0055] The information integration unit can link with travelers' social media accounts to obtain and provide real-time information from friends and followers. For example, it can link with travelers' social media accounts to obtain and provide real-time information from friends and followers. It can notify users of information and reviews about tourist spots visited by friends. It also allows travelers to receive information from friends and followers in real time through their social media accounts. Friends can share information about places they are currently visiting. It can also link with travelers' social media accounts to adjust travel plans based on real-time information from friends and followers. It can also add restaurants that friends have given high ratings to plans.

[0056] The information integration unit can add collaboration with local guides and local experts to provide more detailed information. For example, by collaborating with local guides and local experts, detailed information can be provided to travelers. Recommendations for local tourist attractions and restaurants can be provided. Collaboration with local experts can also be used to support travelers in participating in local activities and events. Information on local guided tours and workshops can be provided. Furthermore, collaboration with local guides can be used to support travelers in dealing with problems while they are in the area. Local guides can also provide navigation if travelers get lost.

[0057] The information integration unit can analyze traveler feedback and generate detailed reports to be reflected in the next travel plan. For example, the information integration unit can analyze traveler feedback and generate detailed reports to be reflected in the next travel plan. Spots and activities that travelers have given high ratings can be incorporated into the next plan. In addition, based on the content of the feedback, the traveler's preferences and tendencies can be analyzed in detail and the next travel plan can be customized. Restaurants and tourist spots that travelers were particularly satisfied with can be reflected in the next plan. Furthermore, the information integration unit can analyze traveler feedback and automatically generate reports to be reflected in the next travel plan. It is also possible to create a report that includes suggestions for improving areas that travelers were dissatisfied with.

[0058] The processing flow of the first embodiment will be briefly explained below.

[0059] Step 1: The information integration unit integrates traveler information. For example, it integrates traveler personal information, travel history, preferences, etc. into a database. The information integration unit can also analyze traveler's past search history and social media posts to automatically collect and integrate individual travel information. For example, it can analyze traveler's past search history and automatically list tourist spots and activities that interest them. It can also analyze social media posts to collect information on places traveler has visited and events they have attended. Step 2: The plan provider provides a personalized travel plan based on the information integrated by the information integration unit. For example, it analyzes the traveler's preferences and past travel history to provide an individually customized travel plan. If a traveler inputs information such as "I like visiting museums," the generation AI will suggest the optimal museum tour plan based on that information. The plan provider can also analyze the traveler's biometric data (heart rate, stress level, etc.) to suggest the optimal travel plan. For example, it can monitor the traveler's heart rate and stress level and suggest a relaxing travel plan based on that data. Step 3: The information update unit updates information in real time based on the travel plan provided by the plan provision unit. For example, it notifies the traveler of flight delay information, weather changes, and congestion at tourist spots in real time. The information update unit can also provide real-time information on nearby events and activities based on the traveler's location information. For example, it provides information on nearby events and activities in real time based on the traveler's location information. This allows the travel AI concierge according to the embodiment to provide travelers with a convenient and comfortable travel experience. For example, if a traveler gets lost, the information update unit provides navigation in real time. If a traveler has difficulty communicating in the local language, the information update unit provides a translation function. If a traveler needs to contact a medical institution or receive first aid instructions in an emergency, the information update unit provides appropriate support.

[0060] (Example 2) The AI ​​travel concierge according to an embodiment of the present invention is a system that integrates traveler information, generates personalized travel plans using AI, and updates the information in real time, thereby providing travelers with a convenient and comfortable travel experience.

[0061] The AI ​​travel concierge according to the embodiment includes an information integration unit, a plan providing unit, and an information updating unit. The information integration unit integrates traveler information. For example, it integrates the traveler's personal information, travel history, preferences, etc. into a database. The information integration unit can also analyze the traveler's past search history and social media posts to automatically collect and integrate individual travel information. For example, it can analyze the traveler's past search history to automatically list tourist spots and activities that the traveler is interested in. It can also analyze social media posts to collect information on places the traveler has visited and events they have participated in. The plan providing unit provides personalized travel plans based on the information integrated by the information integration unit. For example, it can analyze the traveler's preferences and past travel history to provide individually customized travel plans. If a traveler inputs information such as "I like visiting museums," the generation AI can propose an optimal museum tour plan based on that information. The plan providing unit can also analyze the traveler's biometric data (e.g., heart rate, stress level) and propose optimal travel plans. For example, it can monitor the traveler's heart rate and stress level and propose relaxing travel plans based on that data. The information update unit updates information in real time based on the travel plan provided by the plan provision unit. For example, it notifies users of flight delays, weather changes, and the congestion status of tourist attractions in real time. The information update unit can also provide real-time information on nearby events and activities based on the traveler's location information. For example, it provides information on nearby events and activities in real time based on the traveler's location information. This allows the travel AI concierge according to the embodiment to provide travelers with a convenient and comfortable travel experience. For example, if a traveler gets lost, the information update unit provides navigation in real time. If a traveler has difficulty communicating in the local language, the information update unit provides a translation function. If a traveler needs to contact a medical institution or receive first aid instructions in an emergency, the information update unit provides appropriate support.

[0062] The information integration unit can analyze a traveler's past search history and social media posts to automatically collect and integrate individual travel information. For example, the information integration unit analyzes a traveler's past search history to automatically list tourist attractions and activities of interest. For example, it integrates information about museums and restaurants searched for in the past. The information integration unit also analyzes social media posts to collect information about places visited and events attended by a traveler. For example, it extracts information about tourist attractions visited by a traveler from Instagram posts. The information integration unit also combines a traveler's past search history and social media posts to automatically integrate travel information based on the traveler's interests and preferences. For example, it identifies a traveler's favorite tourist attractions from the search history and post content. This allows individual travel information to be automatically collected and integrated by analyzing a traveler's past search history and social media posts.

[0063] The information integration unit can integrate appropriate medical facilities and dining options by taking into account the traveler's health condition and allergy information. For example, the information integration unit inputs the traveler's health condition in advance and lists appropriate medical facilities based on that information. For example, it provides information on hospitals and clinics near the travel destination. The information integration unit also considers the traveler's allergy information and suggests restaurants and dining options that accommodate allergies. For example, it lists gluten-free and vegetarian restaurants. The information integration unit also provides information on medicines and first aid needed during the trip based on the health condition and allergy information. For example, it integrates information on pharmacies and first aid kits that can be purchased at the travel destination. In this way, appropriate medical facilities and dining options can be integrated by taking into account the traveler's health condition and allergy information.

[0064] The information integration unit uses the emotion estimation function to prioritize displaying information that the traveler is most interested in, thereby optimizing the travel plan. The information integration unit, for example, uses the emotion estimation function to prioritize displaying tourist spots and activities that the traveler is interested in. For example, it prioritizes listing information to which the traveler has a positive reaction. The information integration unit also analyzes the emotional state of the traveler and updates the information of interest in real time. For example, it prioritizes displaying information about tourist spots that the traveler has an interest in. The information integration unit also uses the emotion estimation function to optimize the travel plan based on the information that the traveler is most interested in. For example, it prioritizes incorporating tourist spots and activities to which the traveler has a positive reaction. In this way, by using the emotion estimation function, the information that the traveler is most interested in can be prioritized and the travel plan can be optimized.

[0065] The information integrator can be combined with a voice assistant to enable information collection through voice input. The information integrator, for example, uses a voice assistant to enable travelers to input information through voice. For example, it collects information through voice commands such as "Tell me about nearby restaurants." The information integrator also provides necessary information in real time when travelers ask questions through the voice assistant. For example, it provides an immediate answer to a question such as "What time is the next flight?" The information integrator also uses a voice assistant to enable travelers to plan their trip through voice. For example, it generates a trip plan through a voice command such as "Tell me about tomorrow's sightseeing plans." In this way, by combining a voice assistant, it becomes possible to collect information through voice input.

[0066] The information integration unit can be linked with AR technology to provide visual guides for local areas. For example, the information integration unit uses AR technology to visually display information about tourist attractions and restaurants when a traveler holds their smartphone over a local area. For example, the information integration unit displays the history and business hours of the tourist attraction. The information integration unit also uses AR technology to provide visual navigation when a traveler gets lost at a local area. For example, the information integration unit displays the direction to go using the smartphone's camera. The information integration unit also utilizes AR technology to enable a traveler to visually check information about local activities and events. For example, when the traveler holds their smartphone over a local area, information about events being held nearby is displayed. In this way, by linking with AR technology, a visual guide for local areas can be provided.

[0067] The information integration unit uses the emotion estimation function to analyze the emotions of travelers when they enter information in real time and provide information that elicits positive emotions. The information integration unit, for example, uses the emotion estimation function to analyze the emotions of travelers when they enter information in real time and provide information that elicits positive emotions. For example, if a traveler looks happy, entertainment information is preferentially displayed. The information integration unit also analyzes the emotional state of a traveler and provides information that elicits positive emotions. For example, if a traveler feels like relaxing, information about relaxation spots is displayed. The information integration unit also uses the emotion estimation function to optimize travel plans based on information that most interests the traveler. For example, if a traveler is excited, information about adventure activities is provided. In this way, by using the emotion estimation function, the emotions of travelers when they enter information can be analyzed in real time and information that elicits positive emotions can be provided.

[0068] The plan providing unit can analyze the traveler's biometric data (heart rate, stress level, etc.) and propose the optimal travel plan. For example, the plan providing unit monitors the traveler's heart rate and stress level and proposes a relaxing travel plan based on that data. For example, it can propose a plan that includes spa and relaxation facilities. The plan providing unit also analyzes the biometric data and proposes activities tailored to the traveler's physical condition. For example, if the heart rate is high, it can propose a light activity, and if the stress level is low, it can propose an adventure activity. The plan providing unit also proposes a meal plan based on the traveler's health condition based on the traveler's biometric data. For example, if the stress level is high, it can propose a restaurant that serves meals that have a relaxing effect. In this way, the optimal travel plan can be proposed by analyzing the traveler's biometric data.

[0069] The plan providing unit can generate more accurate personalized plans based on the traveler's past reviews and ratings. The plan providing unit, for example, analyzes the traveler's past reviews and ratings to understand the traveler's preferences and trends and generate personalized plans. For example, tourist spots and restaurants that have been highly rated in the past are preferentially incorporated into the plan. The plan providing unit also generates plans based on the traveler's past reviews and with reference to ratings from other travelers with similar preferences. For example, it suggests spots that have been highly rated by travelers with the same hobbies. The plan providing unit also analyzes the traveler's past rating data and generates plans that emphasize points that the traveler found particularly satisfying. For example, it re-suggests spots that were particularly satisfying among places visited in the past. This makes it possible to generate more accurate personalized plans based on the traveler's past reviews and ratings.

[0070] The plan providing unit can use the emotion estimation function to adjust the plan in real time according to the emotional state of the traveler. For example, the plan providing unit uses the emotion estimation function to analyze the emotional state of the traveler in real time and adjust the travel plan based on the results. For example, if the traveler is tired, it adds a relaxing activity. The plan providing unit also monitors the emotional state of the traveler and adjusts the plan in real time to elicit positive emotions. For example, if the traveler is excited, it adds an adventure activity. The plan providing unit also uses the emotion estimation function to optimize the plan in real time according to the emotional state of the traveler. For example, if the traveler feels like relaxing, it adds a spa or relaxation facility. In this way, by using the emotion estimation function, the plan can be adjusted in real time according to the emotional state of the traveler.

[0071] The plan providing unit can combine reviews and ratings from other travelers to provide more reliable plans. The plan providing unit provides highly reliable personalized plans based on, for example, the reviews and ratings of other travelers. For example, it prioritizes incorporating highly rated tourist spots and restaurants into the plan. The plan providing unit also generates optimal travel plans by combining the traveler's preferences with the ratings of other travelers. For example, it suggests spots that have been highly rated by travelers with the same hobbies. The plan providing unit also analyzes the reviews of other travelers to provide personalized plans based on highly reliable information. For example, it prioritizes incorporating spots that have been highly rated by travelers who have visited in the past into the plan. In this way, by combining the reviews and ratings of other travelers, it is possible to provide more reliable plans.

[0072] The plan providing unit can add a function that allows travel plans to be shared with family and friends and to collaboratively customize the plan. The plan providing unit, for example, provides a function that allows travel plans to be shared with family and friends and to collaboratively customize the plan. For example, it allows comments and suggestions to be added to the shared plan. The plan providing unit also provides a function that allows travel plans to be shared in real time and to be adjusted together with family and friends. For example, it allows changes to be made to the shared plan in real time. The plan providing unit also provides an interface for sharing travel plans and collaboratively customizing them with family and friends. For example, it adds a voting function for shared plans and adopts the most popular suggestions. In this way, by adding a function that allows travel plans to be shared with family and friends and to collaboratively customize them, it is possible to provide more satisfying travel plans.

[0073] The plan providing unit can use the emotion estimation function to analyze the emotion of a traveler when selecting a plan and propose a plan that will elicit the most positive response. For example, the plan providing unit can use the emotion estimation function to analyze the emotion of a traveler when selecting a plan in real time and propose a plan that will elicit the most positive response. For example, if a traveler has a happy expression, the plan providing unit can preferentially propose that plan. The plan providing unit can also analyze the emotional state of a traveler in real time and propose a plan that will elicit a positive response. For example, if a traveler is excited, the plan providing unit can propose a plan that includes adventure activities. The plan providing unit can also use the emotion estimation function to analyze the emotion of a traveler when selecting a plan and propose a plan that will elicit the most positive response. For example, if a traveler feels like relaxing, the plan providing unit can propose a plan that includes a spa or relaxation facility. In this way, the emotion estimation function can be used to analyze the emotion of a traveler when selecting a plan and propose a plan that will elicit the most positive response.

[0074] The information update unit can provide real-time information on nearby events and activities based on the traveler's location information. The information update unit, for example, provides information on nearby events and activities based on the traveler's location information in real time. For example, it notifies the traveler of information on nearby festivals and concerts. The information update unit also analyzes the traveler's location information and provides information on nearby tourist spots and activities in real time. For example, it displays the opening hours and congestion status of nearby tourist spots and activities. The information update unit also provides information on nearby restaurants and cafes in real time based on the traveler's location information. For example, it notifies the traveler of the menus and reservation status of nearby restaurants. This makes it possible to provide real-time information on nearby events and activities based on the traveler's location information.

[0075] The information updating unit can propose optimal means of transportation and routes in real time according to the traveler's schedule. The information updating unit, for example, analyzes the traveler's schedule and proposes optimal means of transportation and routes in real time. For example, it proposes the optimal means of transportation to arrive on time for the next appointment. The information updating unit also provides traffic information in real time based on the traveler's schedule and proposes the optimal route. For example, it adjusts the route based on traffic congestion information and public transportation delay information. The information updating unit also takes the traveler's schedule into consideration and proposes the optimal route in real time to minimize travel time. For example, it proposes the shortest route or the most efficient means of transportation. This makes it possible to propose optimal means of transportation and routes in real time according to the traveler's schedule.

[0076] The information updating unit can use the emotion estimation function to prioritize notify information according to the emotional state of the traveler. For example, the information updating unit uses the emotion estimation function to analyze the emotional state of the traveler in real time and prioritize notify information based on the results. For example, if the traveler feels like relaxing, the information updating unit notifies the traveler of information about relaxation spots. The information updating unit also monitors the emotional state of the traveler and prioritizes notifying the traveler of information that will elicit positive emotions. For example, if the traveler is excited, the information updating unit notifies the traveler of information about adventure activities. The information updating unit also uses the emotion estimation function to optimize information according to the traveler's emotional state in real time and prioritize notifying the traveler. For example, if the traveler looks happy, the information updating unit notifies the traveler of entertainment information. In this way, by using the emotion estimation function, it is possible to prioritize notifying information according to the traveler's emotional state.

[0077] The information update unit can link IoT devices and provide local environmental information (temperature, humidity, etc.). For example, the information update unit uses IoT devices to provide environmental information such as local temperature and humidity in real time. For example, it notifies travelers of the current temperature and humidity when they go out. The information update unit also links IoT devices and provides travelers with appropriate advice based on local environmental information. For example, it suggests cooler places when the temperature is high. The information update unit also uses IoT devices to collect local environmental information in real time and provide it to travelers. For example, it notifies travelers to bring an umbrella if it looks like it might rain. In this way, local environmental information can be provided by linking IoT devices.

[0078] The information update unit can link with the traveler's social media account to obtain and provide real-time information from friends and followers. For example, the information update unit can link with the traveler's social media account to obtain and provide real-time information from friends and followers. For example, it can notify the traveler of information and reviews of tourist spots visited by friends. The information update unit also enables the traveler to receive information from friends and followers in real time through the social media account. For example, it can share information about places that friends are currently visiting. The information update unit also links with the traveler's social media account to adjust travel plans based on real-time information from friends and followers. For example, it can add restaurants that friends have given high ratings to the plans. In this way, by linking with the traveler's social media account, it is possible to obtain and provide real-time information from friends and followers.

[0079] The information updating unit uses the emotion estimation function to analyze the emotions of travelers when receiving information and provide information that will elicit the most positive response. For example, the information updating unit uses the emotion estimation function to analyze the emotions of travelers when receiving information in real time and provide information that will elicit the most positive response. For example, if the traveler looks happy, the information updating unit notifies the traveler of entertainment information. The information updating unit also monitors the emotional state of the traveler and provides information to elicit positive emotions in real time. For example, if the traveler feels like relaxing, the information updating unit notifies the traveler of information about relaxation spots. The information updating unit also uses the emotion estimation function to analyze the emotions of travelers when receiving information and provide information that will elicit the most positive response. For example, if the traveler is excited, the information updating unit notifies the traveler of information about adventure activities. In this way, by using the emotion estimation function, the emotion estimation function can analyze the emotions of travelers when receiving information and provide information that will elicit the most positive response.

[0080] The information updating unit can monitor the traveler's health condition and provide instructions to contact a medical institution or administer first aid as necessary. The information updating unit, for example, monitors the traveler's health condition and automatically contacts a medical institution if an abnormality is detected. For example, if the heart rate is abnormally high, it will contact a nearby hospital. The information updating unit also analyzes the health condition in real time and provides instructions for first aid as necessary. For example, if the traveler shows symptoms of heatstroke, it will instruct appropriate first aid. The information updating unit also monitors the traveler's health condition and notifies the traveler if an abnormality is detected, urging them to contact a medical institution. For example, if blood pressure is abnormally high, it will recommend contacting a medical institution. This makes it possible to monitor the traveler's health condition and provide instructions to contact a medical institution or administer first aid as necessary.

[0081] The information update unit can analyze the language skills of travelers and enhance the translation function that supports communication in the local language. The information update unit, for example, analyzes the language skills of travelers and provides a translation function that supports communication in the local language. For example, it performs real-time translation when travelers converse with local people. The information update unit also supports travelers to communicate smoothly in the local language based on their language skills. For example, it provides menu translations when travelers order at restaurants. The information update unit also analyzes the language skills of travelers and provides a phrasebook to support communication in the local language. For example, it allows travelers to learn frequently used phrases in advance. This allows the translation function that analyzes the language skills of travelers and supports communication in the local language to be enhanced.

[0082] The information updating unit can use the emotion estimation function to analyze the stress level of the traveler and suggest relaxing activities. The information updating unit, for example, uses the emotion estimation function to analyze the stress level of the traveler in real time and suggest relaxing activities. For example, if the traveler is feeling stressed, it suggests spa or relaxation facilities. The information updating unit also monitors the stress level of the traveler and suggests relaxing activities in real time. For example, if the traveler is tired, it suggests tourist spots where they can relax. The information updating unit also uses the emotion estimation function to analyze the stress level of the traveler and suggest relaxing activities. For example, if the traveler feels like relaxing, it suggests yoga or meditation classes. In this way, the emotion estimation function can be used to analyze the stress level of the traveler and suggest relaxing activities.

[0083] The information update unit can add collaboration with local guides and local experts to provide more detailed information. The information update unit, for example, collaborates with local guides and local experts to provide travelers with more detailed information. For example, it can provide recommended information on local tourist attractions and restaurants. The information update unit can also collaborate with local experts to support travelers in participating in local activities and events. For example, it can provide information on local guided tours and workshops. The information update unit can also collaborate with local guides to support travelers in dealing with local problems. For example, a local guide can provide navigation if a traveler gets lost. In this way, by adding collaboration with local guides and local experts, more detailed information can be provided.

[0084] The information update unit can work in conjunction with a traveler's smartwatch or fitness tracker to support health management. The information update unit, for example, works in conjunction with a traveler's smartwatch or fitness tracker to monitor their health condition. For example, it analyzes their heart rate and step count in real time to support health management. The information update unit also provides appropriate health advice to travelers based on data from the smartwatch or fitness tracker. For example, it can suggest walking courses if they are not getting enough exercise. The information update unit also works in conjunction with a fitness tracker to monitor the traveler's health condition in real time and notify them if an abnormality is detected. For example, it recommends taking a break if an abnormally high heart rate is detected. In this way, health management can be supported by working in conjunction with a traveler's smartwatch or fitness tracker.

[0085] The information updating unit can use the emotion estimation function to analyze the emotions of travelers when receiving support and provide support that elicits the most positive response. For example, the information updating unit can use the emotion estimation function to analyze the emotions of travelers when receiving support in real time and provide support that elicits the most positive response. For example, if the traveler feels like relaxing, the information updating unit can suggest relaxation spots. The information updating unit can also monitor the emotional state of the traveler and provide support in real time to elicit positive emotions. For example, if the traveler is excited, the information updating unit can suggest adventure activities. The information updating unit can also use the emotion estimation function to analyze the emotions of travelers when receiving support and provide support that elicits the most positive response. For example, if the traveler looks happy, the information updating unit can provide entertainment information. In this way, the emotion estimation function can be used to analyze the emotions of travelers when receiving support and provide support that elicits the most positive response.

[0086] The information updating unit can analyze traveler feedback and generate a detailed report to be reflected in the next travel plan. The information updating unit, for example, analyzes traveler feedback and generates a detailed report to be reflected in the next travel plan. For example, it incorporates spots and activities that the traveler has given high ratings into the next plan. The information updating unit also analyzes the traveler's preferences and tendencies in detail based on the content of the feedback and customizes the next travel plan. For example, it reflects restaurants and tourist spots that the traveler was particularly satisfied with in the next plan. The information updating unit also analyzes traveler feedback and automatically generates a report to be reflected in the next travel plan. For example, it creates a report that includes suggestions for improving points that the traveler was dissatisfied with. This makes it possible to analyze traveler feedback and generate a detailed report to be reflected in the next travel plan.

[0087] The information updating unit can analyze the traveler's preferences and trends in more detail based on the content of the feedback, and highly personalize the next travel plan. The information updating unit, for example, analyzes the preferences and trends in more detail based on the traveler's feedback, and highly personalize the next travel plan. For example, it incorporates activities that the traveler is particularly interested in into the next plan. The information updating unit also analyzes the content of the feedback, understands the traveler's preferences and trends, and customizes the next travel plan. For example, it reflects tourist spots and restaurants that the traveler has given high ratings in the next plan. The information updating unit also analyzes the traveler's feedback in more detail, and builds a system for highly personalizing the next travel plan. For example, it automatically generates an optimal plan based on the traveler's preferences and trends. This allows the traveler's preferences and trends to be analyzed in more detail based on the content of the feedback, and highly personalize the next travel plan.

[0088] The information updating unit can use the emotion estimation function to analyze the emotional aspects of the feedback and make suggestions to enhance the positive experience. For example, the information updating unit can use the emotion estimation function to analyze the emotional aspects of the traveler's feedback and make suggestions to enhance the positive experience. For example, activities that the traveler particularly enjoyed can be incorporated into the next plan. The information updating unit can also analyze the emotional aspects of the feedback and make suggestions to enhance the positive experience. For example, spots and activities that the traveler gave a high rating can be reflected in the next plan. The information updating unit can also use the emotion estimation function to analyze the emotional aspects of the traveler's feedback and make suggestions to enhance the positive experience. For example, restaurants and tourist spots that the traveler was particularly satisfied with can be incorporated into the next plan. In this way, the emotion estimation function can be used to analyze the emotional aspects of the feedback and make suggestions to enhance the positive experience.

[0089] The information updating unit can include photos and videos of travelers in the feedback collection, enabling visual feedback. For example, the information updating unit allows travelers to upload photos and videos when providing feedback. For example, photos of tourist spots and restaurants visited by the travelers are included in the feedback. The information updating unit also adds visual elements to the feedback collection, enabling travelers to provide detailed feedback through photos and videos. For example, videos taken by the travelers are included in the feedback. The information updating unit also customizes the next travel plan based on visual information by including photos and videos in the travelers' feedback. For example, tourist spots are evaluated based on photos taken by the travelers. In this way, visual feedback is enabled by including photos and videos of travelers in the feedback collection.

[0090] The information update unit can add a function to generate and share recommended information for other travelers based on feedback. The information update unit provides a function to generate and share recommended information for other travelers based on traveler feedback, for example. For example, information about highly rated tourist spots and restaurants is shared with other travelers. The information update unit also analyzes the content of the feedback and builds a system that generates recommended information for other travelers. For example, it suggests to other travelers spots that the traveler was particularly satisfied with. The information update unit also adds a function to generate and share recommended information for other travelers based on traveler feedback. For example, it introduces activities that the traveler has given a high rating to other travelers. In this way, by adding a function to generate and share recommended information for other travelers based on feedback, it is possible to provide useful information to other travelers as well.

[0091] The information updating unit can use the emotion estimation function to analyze emotions when providing feedback and suggest a feedback method that will elicit the most positive response. For example, the information updating unit can use the emotion estimation function to analyze emotions when a traveler provides feedback in real time and suggest a feedback method that will elicit the most positive response. For example, if a traveler has a happy expression, the information updating unit can suggest a feedback method that emphasizes that emotion. The information updating unit can also analyze emotions when providing feedback and suggest a feedback method that will elicit a positive response. For example, if a traveler feels like they want to relax, the information updating unit can suggest feedback about relaxation spots. The information updating unit can also use the emotion estimation function to analyze emotions when a traveler provides feedback and suggest a feedback method that will elicit the most positive response. For example, if a traveler is excited, the information updating unit can suggest feedback about adventure activities. In this way, the emotion estimation function can be used to analyze emotions when providing feedback and suggest a feedback method that will elicit the most positive response.

[0092] The system according to the embodiment is not limited to the above-described example, and various modifications are possible, for example, as follows.

[0093] The information integration unit can integrate appropriate medical facilities and dining options by taking into account the traveler's health condition and allergy information. For example, a traveler can enter their health condition in advance and use that information to list appropriate medical facilities. It provides information on hospitals and clinics near the travel destination. It also takes into account the traveler's allergy information and suggests restaurants and dining options that cater to allergies. It can also list gluten-free and vegetarian restaurants. It also provides information on medicines and first aid needed during the trip based on the traveler's health condition and allergy information. It can also integrate information on pharmacies and first aid kits that can be purchased at the travel destination.

[0094] The information integration unit can be combined with a voice assistant to enable information collection through voice input. For example, a voice assistant can be used to allow travelers to input information through voice. Information can be collected through voice commands such as "Tell me about nearby restaurants." Travelers can also ask questions through the voice assistant, which provides the necessary information in real time. Questions such as "What time is the next flight?" can be answered instantly. Furthermore, the voice assistant can be used to allow travelers to plan their trips through voice. It is also possible to generate a trip plan through a voice command such as "Tell me about tomorrow's sightseeing plans."

[0095] The information integration unit can be linked with AR technology to provide visual guidance on-site. For example, AR technology can be used to visually display information about tourist attractions and restaurants when a traveler holds their smartphone over a tourist spot. The history and opening hours of the tourist spot can be displayed. AR technology can also be used to provide visual navigation when a traveler gets lost on-site. The direction to go can be displayed using the smartphone's camera. AR technology can also be used to visually check information about local activities and events. It is also possible to display information about nearby events by holding a smartphone over the location.

[0096] The information integration unit can use the emotion estimation function to prioritize displaying information that travelers find most interesting and optimize travel plans. For example, the emotion estimation function can be used to prioritize displaying tourist spots and activities that travelers find interesting. It can prioritize listing information to which travelers have responded positively. It can also analyze the emotional state of travelers and update information of interest in real time. It can prioritize displaying information about tourist spots that travelers have shown interest in. Furthermore, the emotion estimation function can be used to optimize travel plans based on the information that travelers find most interesting. It can also prioritize incorporating tourist spots and activities to which travelers have responded positively.

[0097] The information integration unit can generate more accurate personalized plans based on travelers' past reviews and ratings. For example, it can analyze travelers' past reviews and ratings to understand their preferences and trends and generate personalized plans. It can prioritize tourist spots and restaurants that have been highly rated in the past and incorporate them into the plan. It can also generate plans based on travelers' past reviews and taking into account the ratings of other travelers with similar preferences. It can suggest spots that have been highly rated by travelers with the same hobbies. It can also analyze travelers' past rating data and generate plans that emphasize points that travelers found particularly satisfying. It can also re-suggest spots that travelers have visited in the past that they found particularly satisfying.

[0098] The information integration unit can use the emotion estimation function to analyze the emotions of travelers when they enter information in real time and provide information that elicits positive emotions. For example, the emotion estimation function can be used to analyze the emotions of travelers when they enter information in real time and provide information that elicits positive emotions. If a traveler looks happy, entertainment information can be displayed preferentially. The emotional state of the traveler can also be analyzed and information that elicits positive emotions can be provided. If a traveler feels like relaxing, information about relaxation spots can be displayed. Furthermore, the emotion estimation function can be used to optimize travel plans based on the information that most interests the traveler. If a traveler is excited, it is also possible to provide information about adventure activities.

[0099] The information integration unit can link with travelers' social media accounts to obtain and provide real-time information from friends and followers. For example, it can link with travelers' social media accounts to obtain and provide real-time information from friends and followers. It can notify users of information and reviews about tourist spots visited by friends. It also allows travelers to receive information from friends and followers in real time through their social media accounts. Friends can share information about places they are currently visiting. It can also link with travelers' social media accounts to adjust travel plans based on real-time information from friends and followers. It can also add restaurants that friends have given high ratings to plans.

[0100] The information integration unit can add collaboration with local guides and local experts to provide more detailed information. For example, by collaborating with local guides and local experts, detailed information can be provided to travelers. Recommendations for local tourist attractions and restaurants can be provided. Collaboration with local experts can also be used to support travelers in participating in local activities and events. Information on local guided tours and workshops can be provided. Furthermore, collaboration with local guides can be used to support travelers in dealing with problems while they are in the area. Local guides can also provide navigation if travelers get lost.

[0101] The information integration unit can use the emotion estimation function to adjust the plan in real time according to the traveler's emotional state. For example, the emotion estimation function can be used to analyze the traveler's emotional state in real time and adjust the travel plan based on the results. If the traveler is tired, relaxing activities can be added. The emotional state of the traveler can also be monitored and the plan adjusted in real time to bring out positive emotions. If the traveler is excited, adventure activities can be added. Furthermore, the emotion estimation function can be used to optimize the plan in real time according to the traveler's emotional state. If the traveler feels like relaxing, spa and relaxation facilities can also be added.

[0102] The information integration unit can analyze traveler feedback and generate detailed reports to be reflected in the next travel plan. For example, the information integration unit can analyze traveler feedback and generate detailed reports to be reflected in the next travel plan. Spots and activities that travelers have given high ratings can be incorporated into the next plan. In addition, based on the content of the feedback, the traveler's preferences and tendencies can be analyzed in detail and the next travel plan can be customized. Restaurants and tourist spots that travelers were particularly satisfied with can be reflected in the next plan. Furthermore, the information integration unit can analyze traveler feedback and automatically generate reports to be reflected in the next travel plan. It is also possible to create a report that includes suggestions for improving areas that travelers were dissatisfied with.

[0103] The processing flow of the second embodiment will be briefly explained below.

[0104] Step 1: The information integration unit integrates traveler information. For example, it integrates traveler personal information, travel history, preferences, etc. into a database. The information integration unit can also analyze traveler's past search history and social media posts to automatically collect and integrate individual travel information. For example, it can analyze traveler's past search history and automatically list tourist spots and activities that interest them. It can also analyze social media posts to collect information on places traveler has visited and events they have attended. Step 2: The plan provider provides a personalized travel plan based on the information integrated by the information integration unit. For example, it analyzes the traveler's preferences and past travel history to provide an individually customized travel plan. If a traveler inputs information such as "I like visiting museums," the generation AI will suggest the optimal museum tour plan based on that information. The plan provider can also analyze the traveler's biometric data (heart rate, stress level, etc.) to suggest the optimal travel plan. For example, it can monitor the traveler's heart rate and stress level and suggest a relaxing travel plan based on that data. Step 3: The information update unit updates information in real time based on the travel plan provided by the plan provision unit. For example, it notifies the traveler of flight delay information, weather changes, and congestion at tourist spots in real time. The information update unit can also provide real-time information on nearby events and activities based on the traveler's location information. For example, it provides information on nearby events and activities in real time based on the traveler's location information. This allows the travel AI concierge according to the embodiment to provide travelers with a convenient and comfortable travel experience. For example, if a traveler gets lost, the information update unit provides navigation in real time. If a traveler has difficulty communicating in the local language, the information update unit provides a translation function. If a traveler needs to contact a medical institution or receive first aid instructions in an emergency, the information update unit provides appropriate support.

[0105] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0106] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> Examples of generative AIs include the data generation model 58, such as a neural network model (e.g., a neural network model), and a neural network model (e.g., a neural network model). The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating speech, text data indicating text, and image data indicating an image is also input to the data generation model 58. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. The specification processing unit 290 performs the above-mentioned specification processing using the data generation model 58. The data generation model 58 may be a fine-tuned model so as to output an inference result from a prompt that does not include an instruction. In this case, the data generation model 58 can output an inference result from a prompt that does not include an instruction. The data processing device 12 and the like include multiple types of data generation models 58, and the data generation model 58 includes AIs other than the generative AI. The AI ​​other than the generative AI may be, for example, linear regression, logistic regression, decision tree, random forest, support vector machine (SVM), k-means clustering, convolutional neural network (CNN), recurrent neural network (RNN), generative adversarial network (GAN), or naive Bayes, and can perform various processes, but is not limited to these examples. The AI ​​may also be an AI agent. When the processes of each of the above-mentioned parts are performed by AI, the processes may be performed in part or entirely by AI, but are not limited to these examples. The processes performed by AI, including the generative AI, may be replaced with rule-based processes.

[0107] Furthermore, the processing by the data processing system 10 described above is executed by the specific processing unit 290 of the data processing device 12 or the control unit 46A of the smart device 14, but may also be executed by the specific processing unit 290 of the data processing device 12 and the control unit 46A of the smart device 14. Furthermore, the specific processing unit 290 of the data processing device 12 acquires or collects information necessary for processing from the smart device 14 or an external device, and the smart device 14 acquires or collects information necessary for processing from the data processing device 12 or an external device.

[0108] [Second embodiment] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0109] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0110] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN and / or a LAN.

[0111] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0112] The microphone 238 receives instructions and the like from the user by receiving voice uttered by the user. The microphone 238 captures the voice uttered by the user, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to instructions from the processor 46.

[0113] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the user's surroundings (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0114] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0115] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0116] The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0117] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. The identification processing unit 290 can estimate a user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion. The emotion estimation function (emotion identification function) using the emotion identification model 59 performs various estimations and predictions regarding the user's emotion, including estimation and prediction of the user's emotion, but is not limited to these examples. Furthermore, the estimation and prediction of emotion also includes, for example, emotion analysis.

[0118] In the smart glasses 214, the specific processing is performed by the processor 46. A specific processing program 60 is stored in the storage 50. The processor 46 reads the specific processing program 60 from the storage 50 and executes the read specific processing program 60 on the RAM 48. The specific processing is realized by the processor 46 operating as the control unit 46A in accordance with the specific processing program 60 executed on the RAM 48. The smart glasses 214 also have a data generation model and an emotion identification model similar to the data generation model 58 and the emotion identification model 59, and can perform processing similar to that of the specific processing unit 290 using these models.

[0119] Note that a device other than the data processing device 12 may have the data generation model 58. For example, a server device may have the data generation model 58. In this case, the data processing device 12 communicates with the server device having the data generation model 58 to obtain a processing result (such as a prediction result) using the data generation model 58. Furthermore, the data processing device 12 may be a server device, or may be a terminal device (for example, a mobile phone, a robot, a home appliance, etc.) owned by a user.

[0120] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0121] The data generation model 58 is a so-called generative AI. An example of the data generation model 58 is a generative AI such as ChatGPT. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 receives a prompt containing an instruction, as well as inference data such as voice data representing speech, text data representing text, and image data representing an image. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. The identification processing unit 290 performs the above-mentioned identification processing using the data generation model 58. The data generation model 58 may be a fine-tuned model so as to output an inference result from a prompt that does not include an instruction. In this case, the data generation model 58 can output an inference result from a prompt that does not include an instruction. The data processing device 12 and the like include multiple types of data generation models 58, and the data generation model 58 includes AIs other than the generative AI. The AI ​​other than the generative AI may be, for example, linear regression, logistic regression, decision tree, random forest, support vector machine (SVM), k-means clustering, convolutional neural network (CNN), recurrent neural network (RNN), generative adversarial network (GAN), or naive Bayes, and can perform various processes, but is not limited to these examples. The AI ​​may also be an AI agent. When the processes of each of the above-mentioned parts are performed by AI, the processes may be performed in part or entirely by AI, but are not limited to these examples. The processes performed by AI, including the generative AI, may be replaced with rule-based processes.

[0122] The data processing system 210 according to the second embodiment performs the same processing as the data processing system 10 according to the first embodiment. The processing by the data processing system 210 is executed by the specific processing unit 290 of the data processing device 12 or the control unit 46A of the smart glasses 214, but may also be executed by the specific processing unit 290 of the data processing device 12 and the control unit 46A of the smart glasses 214. Furthermore, the specific processing unit 290 of the data processing device 12 acquires or collects information required for processing from the smart glasses 214 or an external device, etc., and the smart glasses 214 acquires or collects information required for processing from the data processing device 12 or an external device, etc.

[0123] [Third embodiment] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0124] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0125] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN and / or a LAN.

[0126] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0127] The microphone 238 receives instructions and the like from the user by receiving voice uttered by the user. The microphone 238 captures the voice uttered by the user, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to instructions from the processor 46.

[0128] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the user's surroundings (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0129] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0130] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0131] The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0132] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. The identification processing unit 290 can estimate a user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion. The emotion estimation function (emotion identification function) using the emotion identification model 59 performs various estimations and predictions regarding the user's emotion, including estimation and prediction of the user's emotion, but is not limited to these examples. Furthermore, the estimation and prediction of emotion also includes, for example, emotion analysis.

[0133] In the headset type terminal 314, the specific processing is performed by the processor 46. A specific processing program 60 is stored in the storage 50. The processor 46 reads the specific processing program 60 from the storage 50 and executes the read specific processing program 60 on the RAM 48. The specific processing is realized by the processor 46 operating as the control unit 46A in accordance with the specific processing program 60 executed on the RAM 48. Note that the headset type terminal 314 has a data generation model and an emotion identification model similar to the data generation model 58 and the emotion identification model 59, and can also perform processing similar to that of the specific processing unit 290 using these models.

[0134] Note that a device other than the data processing device 12 may have the data generation model 58. For example, a server device may have the data generation model 58. In this case, the data processing device 12 communicates with the server device having the data generation model 58 to obtain a processing result (such as a prediction result) using the data generation model 58. Furthermore, the data processing device 12 may be a server device, or may be a terminal device (for example, a mobile phone, a robot, a home appliance, etc.) owned by a user.

[0135] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0136] The data generation model 58 is a so-called generative AI. An example of the data generation model 58 is a generative AI such as ChatGPT. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 receives a prompt containing an instruction, as well as inference data such as voice data representing speech, text data representing text, and image data representing an image. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. The identification processing unit 290 performs the above-mentioned identification processing using the data generation model 58. The data generation model 58 may be a fine-tuned model so as to output an inference result from a prompt that does not include an instruction. In this case, the data generation model 58 can output an inference result from a prompt that does not include an instruction. The data processing device 12 and the like include multiple types of data generation models 58, and the data generation model 58 includes AIs other than the generative AI. The AI ​​other than the generative AI may be, for example, linear regression, logistic regression, decision tree, random forest, support vector machine (SVM), k-means clustering, convolutional neural network (CNN), recurrent neural network (RNN), generative adversarial network (GAN), or naive Bayes, and can perform various processes, but is not limited to these examples. The AI ​​may also be an AI agent. When the processes of each of the above-mentioned parts are performed by AI, the processes may be performed in part or entirely by AI, but are not limited to these examples. The processes performed by AI, including the generative AI, may be replaced with rule-based processes.

[0137] The data processing system 310 according to the third embodiment performs the same processing as the data processing system 10 according to the first embodiment. The processing by the data processing system 310 is executed by the specific processing unit 290 of the data processing device 12 or the control unit 46A of the headset type terminal 314, but may also be executed by the specific processing unit 290 of the data processing device 12 and the control unit 46A of the headset type terminal 314. Furthermore, the specific processing unit 290 of the data processing device 12 acquires or collects information required for processing from the headset type terminal 314 or an external device, etc., and the headset type terminal 314 acquires or collects information required for processing from the data processing device 12 or an external device, etc.

[0138] [Fourth embodiment] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[0139] 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0140] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN and / or a LAN.

[0141] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[0142] The microphone 238 receives instructions and the like from the user by receiving voice uttered by the user. The microphone 238 captures the voice uttered by the user, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to instructions from the processor 46.

[0143] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS image sensor or a CCD image sensor, and captures images of the user's surroundings (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0144] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0145] The control object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[0146] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0147] The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0148] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. The identification processing unit 290 can estimate a user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion. The emotion estimation function (emotion identification function) using the emotion identification model 59 performs various estimations and predictions regarding the user's emotion, including estimation and prediction of the user's emotion, but is not limited to these examples. Furthermore, the estimation and prediction of emotion also includes, for example, emotion analysis.

[0149] In the robot 414, the specific processing is performed by the processor 46. A specific processing program 60 is stored in the storage 50. The processor 46 reads the specific processing program 60 from the storage 50 and executes the read specific processing program 60 on the RAM 48. The specific processing is realized by the processor 46 operating as the control unit 46A in accordance with the specific processing program 60 executed on the RAM 48. The robot 414 has a data generation model and an emotion identification model similar to the data generation model 58 and the emotion identification model 59, and can also perform processing similar to that of the specific processing unit 290 using these models.

[0150] Note that a device other than the data processing device 12 may have the data generation model 58. For example, a server device may have the data generation model 58. In this case, the data processing device 12 communicates with the server device having the data generation model 58 to obtain a processing result (such as a prediction result) using the data generation model 58. Furthermore, the data processing device 12 may be a server device, or may be a terminal device (for example, a mobile phone, a robot, a home appliance, etc.) owned by a user.

[0151] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0152] The data generation model 58 is a so-called generative AI. An example of the data generation model 58 is a generative AI such as ChatGPT. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 receives a prompt containing an instruction, as well as inference data such as voice data representing speech, text data representing text, and image data representing an image. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. The identification processing unit 290 performs the above-mentioned identification processing using the data generation model 58. The data generation model 58 may be a fine-tuned model so as to output an inference result from a prompt that does not include an instruction. In this case, the data generation model 58 can output an inference result from a prompt that does not include an instruction. The data processing device 12 and the like include multiple types of data generation models 58, and the data generation model 58 includes AIs other than the generative AI. The AI ​​other than the generative AI may be, for example, linear regression, logistic regression, decision tree, random forest, support vector machine (SVM), k-means clustering, convolutional neural network (CNN), recurrent neural network (RNN), generative adversarial network (GAN), or naive Bayes, and can perform various processes, but is not limited to these examples. The AI ​​may also be an AI agent. When the processes of each of the above-mentioned parts are performed by AI, the processes may be performed in part or entirely by AI, but are not limited to these examples. The processes performed by AI, including the generative AI, may be replaced with rule-based processes.

[0153] The data processing system 410 according to the fourth embodiment performs the same processing as the data processing system 10 according to the first embodiment. The processing by the data processing system 410 is executed by the specific processing unit 290 of the data processing device 12 or the control unit 46A of the robot 414, but may also be executed by the specific processing unit 290 of the data processing device 12 and the control unit 46A of the robot 414. Furthermore, the specific processing unit 290 of the data processing device 12 acquires or collects information required for processing from the robot 414 or an external device, etc., and the robot 414 acquires or collects information required for processing from the data processing device 12 or an external device, etc.

[0154] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0155] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion encompasses both emotions and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[0156] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[0157] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[0158] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is expressed, and when they approach the ideal, a state of pleasure is expressed. Emotions can also be created for robots, cars, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is expressed, and when they approach the ideal, a state of pleasure is expressed. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on speech emotion recognition and brain physiological signal analysis systems for emotions, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the area called "reaction," where sensation is dominant. The right half of the emotion map lists emotions belonging to the area called "situation," where situational awareness is dominant.

[0159] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[0160] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[0161] In the above embodiment, an example was given in which a specific process is performed by one computer 22, but the technology disclosed herein is not limited to this, and distributed processing of the specific process may be performed by multiple computers including computer 22.

[0162] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[0163] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0164] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[0165] The hardware resource for executing a specific process can be any of the following types of processors: A processor, for example, is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. A processor also includes a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[0166] The hardware resource that executes the specific process may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific process may be a single processor.

[0167] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[0168] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[0169] In the above example, the first to fourth embodiments have been described separately, but some or all of these embodiments may be combined. The smart device 14, smart glasses 214, headset terminal 314, and robot 414 are merely examples, and they may be combined, or other devices may be used. In the above example, the first and second embodiments have been described separately, but they may be combined.

[0170] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[0171] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference. [Explanation of symbols]

[0172] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot

Claims

1. an information integration unit that integrates traveler information; a plan providing unit that provides a personalized travel plan based on the information integrated by the information integrating unit; an information updating unit that updates information in real time based on the travel plan provided by the plan providing unit; A system characterized by:

2. The information integration unit Analyze the traveler's past search history and social media posts to automatically collect and integrate individual travel information.

2. The system of claim 1.

3. The information integration unit Integrate appropriate medical facilities and dining options, taking into account the traveler's health conditions and allergies.

2. The system of claim 1.

4. The information integration unit Prioritize displaying information that is of most interest to the traveler and optimize travel planning 2. The system of claim 1.

5. The information integration unit Combined with a voice assistant, it enables information gathering through voice input.

2. The system of claim 1.

Images