System

Abstract

A system is provided.SOLUTION: A system comprising: means for obtaining traveler location information; means for inputting traveler preferences and needs; means for collecting real-time weather forecast information, exchange rates information, and traffic information; means for generating tourist attraction and gourmet information based on traveler preferences and needs using a generative AI model; means for calculating optimal transportation means and routes from a traveler's current location to a destination; and means for providing information about the culture and habits of the travel destination.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] One of the major challenges facing modern travelers is the significant time and effort required to gather information about their destination and select their mode of transportation. In particular, first-time travelers and independent travelers often face anxiety and difficulties due to their unfamiliarity with the local language and culture. It is also difficult to effectively obtain real-time information (weather, exchange rates, traffic information, etc.) during their stay. Given this background, there is a demand for technology that can effectively resolve these challenges so that travelers can enjoy a smooth and comfortable travel experience. [Means for solving the problem]

[0005] To solve the above-mentioned problems, the present invention provides the following means. First, it provides a means for acquiring a traveler's location information and a means for inputting the traveler's preferences and needs. Next, it provides a means for collecting real-time weather information, exchange rate information, and traffic information. Finally, it provides a means for generating tourist destination and gourmet information based on the traveler's preferences and needs using a generative AI model. Furthermore, it constructs a system including a means for calculating the optimal means of transportation and route from the traveler's current location to the destination, and a means for providing information about the culture and customs of the travel destination. The present invention also includes a means for providing information about culture and customs to travelers via voice and on a screen, and a means for generating information about specific travel needs (e.g., vegetarian options, wheelchair accessibility). This system allows travelers to reduce anxiety and difficulties at their destination and allows them to gather information quickly and efficiently.

[0006] "Tourist" refers to an individual or group of people who travel and visit different places for tourism, business or other purposes.

[0007] "Location Information" means data indicating the latitude and longitude of a specific location using GPS or other technologies, which indicates a user's current geographic location.

[0008] "Preferences" refer to the things and activities that users are interested in at their travel destinations and during their trips, and include categories such as tourist spots, gourmet food, and shopping.

[0009] "Needs" refers to specific conditions or services that a User requires during their trip, including, for example, requirements such as vegetarian options or wheelchair accessibility.

[0010] "Weather information" means data about current weather conditions (such as temperature, humidity, and precipitation) in a particular location.

[0011] "Exchange rate information" refers to numerical data that indicates the exchange rates between different currencies, and is important for travelers when acquiring local currency.

[0012] "Transportation information" refers to data on public transportation operation status, road congestion information, transportation options, etc.

[0013] A "generative AI model" is an algorithm that has been trained using artificial intelligence techniques to perform a specific task (in this case, generating travel-related information).

[0014] A "tourist destination" is a destination visited by tourists, and generally includes natural landscapes, historical buildings, cultural facilities, etc.

[0015] "Gourmet information" refers to data about restaurants, local specialties, and cuisine at travel destinations, providing travelers with information to enjoy their meals.

[0016] "Transportation" refers to the means of transportation (train, bus, taxi, etc.) that a traveler uses to travel from their current location to their destination.

[0017] A "route" is the path or route a traveler must take to get from their current location to their destination.

[0018] "Culture" refers to the traditions, customs, and social behaviors unique to a particular region or country, and is information that helps travelers understand the local way of life.

[0019] "Customs" refer to the behavior and manners commonly observed in a particular region or society, and are knowledge that travelers should be aware of in order to facilitate smooth communication in the local area.

[0020] "Audio guide" is a function that provides travelers with guidance and information not only through text but also through audio.

[0021] "Screen display" refers to a means of visually presenting information to users using a terminal display. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0023] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0024] First, the terms used in the following description will be explained.

[0025] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0026] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0027] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0028] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0030] [First embodiment]

[0031] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0032] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0033] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0034] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0035] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0036] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0037] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0038] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0039] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0040] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0041] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0042] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0043] This invention is a system that utilizes generative AI models to provide appropriate travel information based on a traveler's location information and needs. This system helps travelers quickly and accurately obtain local information and smoothly select transportation methods.

[0044] System configuration

[0045] The system includes the following main components:

[0046] 1. Location information acquisition means

[0047] 2. How to input your preferences and needs

[0048] 3. Real-time information gathering methods

[0049] 4. Information generation method using generative AI models

[0050] 5. Transportation and Route Calculation

[0051] 6. Means of providing information on culture and customs

[0052] 7. Audio guide and on-screen display

[0053] Specific operation of each element

[0054] Location information acquisition means

[0055] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[0056] Input method for preferences and needs

[0057] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.) into the terminal, and the system then provides personalized information based on the user's requests.

[0058] Real-time information gathering means

[0059] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[0060] Information generation method using generative AI models

[0061] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs. This AI model learns from past travel data, local tourist guides, restaurant reviews, and more.

[0062] Transportation and route calculation

[0063] The server calculates the optimal means of transportation and route based on the user's current location and destination, for example, calculating the optimal method of using public transportation or the optimal taxi route, and sends the results to the device.

[0064] Culture and customs information provision method

[0065] The server uses a generative AI model to provide information about the culture and customs of the destination, such as general etiquette and points of caution for travelers, and displays them on the device.

[0066] Audio guide and on-screen display

[0067] The device provides the collected information and generated guides to the user via voice and on-screen display, for example, providing route guidance to the destination via voice and displaying a detailed map on the screen.

[0068] Specific examples

[0069] Specifically, consider a user traveling to Tokyo. When the user launches the app, the device uses GPS to obtain the user's current location. The user inputs into the device their preference to go to Tokyo and their interest in sightseeing spots and gourmet food.

[0070] Next, the server collects Tokyo weather information, the latest exchange rates, and traffic information, and uses this data to create a generative AI model to select appropriate tourist spots (e.g., Sensoji Temple, Skytree) and restaurants (e.g., famous sushi restaurants).

[0071] The server then calculates the optimal transportation method and route (e.g., limousine bus or train) from the airport to the hotel and sends that information to the device, which then displays the information on the screen and provides voice guidance to the user.

[0072] The server also generates information about the culture and customs of the destination, such as public manners and precautions in Tokyo (e.g., refrain from using mobile phones on trains), and displays it on the device, allowing users to take prompt and appropriate action during their trip.

[0073] As described above, by implementing the system of the present invention, travelers can enjoy a more comfortable and efficient travel experience. In addition, by providing real-time information, it is possible to flexibly respond to changes in travel plans and unexpected situations.

[0074] The processing flow will be explained below.

[0075] Step 1:

[0076] The user launches the app. When the app launches, a message appears requesting permission to use location information.

[0077] Step 2:

[0078] If the device receives permission from the user to use location information, it uses the GPS function to obtain the user's current location and sends the obtained latitude and longitude data to the app.

[0079] Step 3:

[0080] The user fills in the app's input form with their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.), then presses the submit button to confirm the settings.

[0081] Step 4:

[0082] The device sends the user's input information to the server, along with the user's location information.

[0083] Step 5:

[0084] Based on the received user information, the server collects real-time weather, exchange rate, and traffic information through related API services, and stores the collected information in a database.

[0085] Step 6:

[0086] The server uses the generative AI model to generate tourist and gourmet information based on the user's preferences and needs, and the generated information is then stored in an organized database.

[0087] Step 7:

[0088] The server calculates the optimal means of transportation and route from the user's current location to the destination, including how to use public transportation and taxis, and route information.

[0089] Step 8:

[0090] The server collects information from relevant databases and websites and compiles it using a generative AI model to generate information about the culture and customs of the destination.

[0091] Step 9:

[0092] The server then sends the generated information on tourist spots, gourmet food, transportation options and routes, and culture and customs to the device. The information sent is customized according to the user's request.

[0093] Step 10:

[0094] The device displays the received information on its screen, including photos and descriptions of tourist attractions, restaurant menus and ratings, and maps of transportation routes. If audio guidance is enabled, the information is also provided aloud.

[0095] Step 11:

[0096] Based on the displayed information, users can begin to plan their trip in detail. If necessary, they can refer to the displayed route to head to their destination. This allows users to enjoy their trip efficiently and with peace of mind.

[0097] Example 1

[0098] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0099] Conventional travel information systems lack the ability to provide personalized information based on users' location information and individual needs, and have difficulty providing real-time information quickly and accurately. As a result, travelers often struggle to find information about appropriate transportation methods and the culture and customs of their destinations, resulting in an inconvenient travel experience.

[0100] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0101] In this invention, the server includes means for collecting real-time weather information, exchange rate information, and traffic information from the Internet via API, means for generating tourist spot and gourmet information based on past data and local information using a generative AI model, and means for providing information on the culture and customs of the travel destination using the generative AI model, thereby enabling travelers to quickly and accurately obtain personalized information in real time.

[0102] A "terminal" is a device used by a traveler, such as a portable information terminal or smartphone, to obtain the traveler's current location and display necessary information.

[0103] "GPS" is an abbreviation for Global Positioning System, a technology that allows devices to receive and accurately measure their location on Earth from satellites.

[0104] "User" refers to the traveler who uses the system, and is the entity that inputs information into and operates the system.

[0105] "API" stands for Application Programming Interface, a means by which different software systems communicate with each other and exchange information.

[0106] "Real-time information" refers to information that is up to date at the present time, and includes, for example, weather information and traffic information.

[0107] A "generative AI model" is a model that uses artificial intelligence technology to recognize patterns and generate new information based on input data.

[0108] "Tourist destinations" refer to places and attractions that are popular destinations for tourists.

[0109] "Gourmet information" refers to information about restaurants and cuisine in the areas that travelers visit.

[0110] "Transportation" refers to the means of transportation that travelers use to travel from their current location to their destination, including public transportation and taxis.

[0111] A "route" refers to the path or route a traveler takes to get from their current location to their destination.

[0112] "Cultural and customs information" refers to information about the local culture, social customs, and behavioral norms at the travel destination.

[0113] "Audio guide" refers to a function that provides information and guidance to the user through audio.

[0114] "Screen display" refers to the function of visually displaying information on the device's display.

[0115] "Means" refers to the method or device used by the system to perform a particular function or operation.

[0116] The system utilizes a generative AI model based on the traveler's location and needs to provide appropriate travel information. An embodiment of the system is described in detail below.

[0117] System Components

[0118] The following major hardware and software are used to implement the system:

[0119] 1. Terminal: A mobile information terminal or smartphone used by a traveler. It has a GPS function and acquires location information and communicates between the user and the server.

[0120] 2. Server: A computing device located in the cloud that collects real-time information from the internet via APIs and generates and processes that information using generative AI models.

[0121] 3. Generative AI model: An artificial intelligence model that learns from past travel data and local information. For example, it uses large-scale language models (such as the GPT series).

[0122] 4. Internet: A communication network for obtaining real-time information (weather information, exchange rate information, traffic information) through APIs.

[0123] How it works

[0124] Location information acquisition

[0125] When a traveler launches the app, the device automatically obtains their current location using its built-in GPS function, and the obtained location information is sent to the server.

[0126] Input your preferences and needs

[0127] Users input their travel destinations, categories of interest (tourist spots, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.) into their devices. This input information is sent to the server.

[0128] Real-time information gathering

[0129] The server retrieves real-time weather, exchange rate, and traffic information from the Internet via multiple APIs, ensuring that the latest data is always available.

[0130] Information generation and provision

[0131] The server uses a generative AI model based on the user's preferences and needs to generate information about tourist spots and gourmet food. The generative AI model learns from past travel data and guide information, allowing it to provide the user with the most appropriate information.

[0132] For example, the following prompt sentence is input into the generative AI model: "The user is traveling to Tokyo and is interested in tourist spots and gourmet food. Please collect weather information, the latest exchange rates, and traffic information for Tokyo, and suggest suitable tourist spots and restaurants. In addition, please calculate the optimal means of transportation and route from the airport to the accommodation, and also provide information on public manners and things to be careful of in Tokyo."

[0133] Transportation and route calculation

[0134] The server calculates the optimal transportation method (e.g., public transportation, taxi) and route based on the user's current location and destination, and sends the calculation results to the device.

[0135] Providing information on culture and customs

[0136] The server uses a generative AI model to generate information about the culture and customs of the destination and provides it to the user as a guide for their travels.

[0137] Audio guide and on-screen display

[0138] The terminal displays the information sent from the server on its screen and provides audio guidance as needed, allowing users to receive easy-to-understand guidance both visually and audibly.

[0139] Specific operation example

[0140] For example, consider a user traveling to Tokyo. When the traveler launches the app, the device retrieves their current location information. Next, the user enters "Tokyo" as their destination, selects "tourist destinations" and "food" as categories of interest, and also enters "vegetarian-friendly" as a need. Based on this, the server collects real-time weather, exchange rates, and traffic information, uses a generative AI model to generate appropriate tourist destination and food information, calculates transportation methods and routes, and provides information on culture and customs. Finally, the device provides this information to the user via screen display and audio guidance.

[0141] By implementing the present invention in this way, travelers can obtain necessary information in real time and enjoy an efficient and comfortable trip.

[0142] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0143] Step 1:

[0144] (Location information acquisition)

[0145] When a traveler launches the app, the device automatically acquires the current location information using the built-in GPS function. The acquired location information (input) is sent to the server (output). This allows the server to grasp the traveler's current location.

[0146] Specific operation: The user launches the app and taps "Check current location." The device activates the GPS and sends the coordinate data (latitude and longitude) of the current location (e.g., Tokyo Station) to the server.

[0147] Step 2:

[0148] (Enter your preferences and needs)

[0149] Users input their travel destinations, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.) into their devices (input). This information is then sent from the device to the server (output).

[0150] Specific operation: The user enters "Tokyo" as the destination. On the category selection screen, select "Tourist Destinations" and "Gourmet." If necessary, check "Vegetarian Friendly."

[0151] Step 3:

[0152] (Real-time information gathering)

[0153] The server obtains real-time weather, exchange rate, and traffic information from the Internet via multiple APIs (input), which provides the latest data (output).

[0154] Specific operation: The server calls the Open Weather Map API to get the latest weather information for Tokyo, uses the Exchange Rate API to get the latest exchange rates, and uses the Traffic Information API to get real-time traffic information for Tokyo.

[0155] Step 4:

[0156] (Information generation using generative AI models)

[0157] The server inputs prompts into the generative AI model based on the user's preferences and needs (input), and generates tourist destination and gourmet information (output). The generative AI model learns from past travel data and guide information, and provides the user with the most appropriate information.

[0158] Specific operation: The server generates a prompt sentence: "The user is traveling to Tokyo and is interested in tourist spots and gourmet food. Please collect Tokyo weather information, the latest exchange rates, and traffic information, and suggest suitable tourist spots and restaurants." This prompt sentence is input into a generative AI model (e.g., GPT-4) to generate tourist spot and gourmet information.

[0159] Step 5:

[0160] (Transportation and route calculation)

[0161] The server calculates the optimal means of transportation (e.g., public transportation, taxi) and route based on the user's current location and destination (input). The optimal route information is obtained as a result of the calculation (output).

[0162] Specific operation: The server uses the Google Maps API to calculate the optimal public transportation route from Tokyo Station to Sensoji Temple, and generates detailed directions such as "Get on at Tokyo Station and take the Ginza Line to Asakusa Station."

[0163] Step 6:

[0164] (Providing information on culture and customs)

[0165] The server uses a generative AI model to generate information about the culture and customs of the travel destination (input), and the obtained information is sent from the server to the device (output).

[0166] Specific operation: The server generates a prompt sentence, "Please tell me about public manners and things to be careful about in Tokyo." This is input into the generative AI model, which generates information about things to be careful about and manners in Tokyo. The generated information is added to the response data.

[0167] Step 7:

[0168] (Audio guide and on-screen display)

[0169] The terminal provides the information received from the server to the user by displaying it on the screen and by voice (output).

[0170] Specific operation: The device displays the received tourist spots, gourmet information, route guidance, and cultural information on the app's UI. When the user taps on route guidance, the voice assistant will say, "Take the Ginza Line from Tokyo Station to Asakusa Station."

[0171] (Application example 1)

[0172] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0173] Travelers need a lot of information when they travel, such as choosing tourist attractions and restaurants, understanding the culture and customs, and choosing the best means of transportation. Information about specific travel needs (e.g., wheelchair accessibility or vegetarian options) is also important, but providing this information in real time is difficult. Furthermore, if the information provided is insufficient or inappropriate, the traveler's experience may be compromised. Therefore, to ensure travelers can enjoy their trip smoothly, a system is needed that provides real-time information based on their preferences and needs, as well as guidance on transportation and routes.

[0174] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0175] In this invention, the server includes means for acquiring the traveler's location information, means for inputting the traveler's preferences and needs, means for collecting real-time weather information, exchange rate information, and traffic information, means for generating tourist spot and restaurant information based on the traveler's preferences and needs using a generative AI model, means for calculating the optimal means of transportation and route from the traveler's current location to the destination, means for providing the generated tourist spot and restaurant information and travel route by voice guidance and on-screen display, and means for providing information on the culture and customs of the travel destination. This allows travelers to obtain more specific and personalized travel information in real time, enabling a comfortable and efficient travel experience.

[0176] "Location information" is data that indicates the traveler's current geographical location. It is mainly obtained using the GPS (Global Positioning System) function.

[0177] "Preferences and needs" refers to the personal interests and requirements that travelers want to fulfill during their trip, such as "tourist attractions," "food," and "wheelchair access."

[0178] "Real-time information" refers to the latest data available at the present time, including weather information, exchange rate information, traffic information, and so on.

[0179] "Weather Information" means data about current and future weather conditions at a destination, including temperature, precipitation, wind speed, etc.

[0180] "Exchange Rate Information" is up-to-date data on the exchange rates between different currencies, which helps travelers when exchanging currencies.

[0181] "Traffic information" refers to current information about public transportation and roads, including traffic congestion information, accident information, and operation status.

[0182] A "generative AI model" is a program that uses artificial intelligence to analyze data and generate information for a specific task.

[0183] "Tourist destinations" are places or facilities that tourists visit, including famous places, ruins, and natural parks.

[0184] "Restaurant information" is data about places where travelers can eat, including restaurants, cafes, food stands, etc.

[0185] "Transportation" refers to the means of transportation a traveler uses to travel from their current location to their destination, including walking, public transportation, and driving.

[0186] A "route" refers to the path a traveler takes from their current location to their destination, taking into account the shortest distance and the most optimal route.

[0187] "Audio guidance" is a method of providing specific information or instructions to travelers by voice, thereby providing information without relying on vision.

[0188] "Screen display" refers to a method of displaying information on the display of a traveler's device, allowing the information to be visually confirmed.

[0189] "Culture and customs" refers to the traditional ways of behavior and manners of a particular region or country. They serve as a guide for travelers on how to behave appropriately in that area.

[0190] This invention is a system that utilizes generative AI models to provide appropriate tourist destination and restaurant information based on travelers' location information and needs. The system helps travelers quickly and accurately obtain local information and select the best mode of transportation.

[0191] System configuration

[0192] The system has the following main components:

[0193] 1. Location information acquisition means

[0194] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[0195] 2. How to input your preferences and needs

[0196] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (wheelchair access, etc.) into the terminal, and the system then provides personalized information based on the user's requests.

[0197] 3. Real-time information gathering methods

[0198] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[0199] 4. Information generation method using generative AI models

[0200] The server generates tourist destination and restaurant information based on the user's preferences and needs using a generative AI model that learns from past travel data, local tourist guides, restaurant reviews, and more.

[0201] 5. Transportation and Route Calculation

[0202] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal method of using public transportation or the optimal taxi route, and sends the results to the device.

[0203] 6. Voice guidance and screen display means for generated information

[0204] The terminal provides the generated tourist spot and restaurant information and travel routes through voice guidance and on-screen display, allowing travelers to obtain information both visually and audibly.

[0205] 7. Means of providing information on culture and customs

[0206] The server uses generative AI models to provide information about the culture and customs of the travel destination, which users can view on screen and through voice guidance.

[0207] Processing Description

[0208] The server and device work together to perform the following process. First, the device obtains the user's location information and sends it to the server. Next, the user's preferences and needs information is also sent to the server. Based on this information, the server collects real-time information from the API. The generative AI model uses this data to generate optimal tourist destination and restaurant information for the user, and provides this information via voice guidance and on-screen display.

[0209] Specific examples

[0210] For example, consider a user traveling to Tokyo. When the user launches the app, the device uses GPS to obtain their current location. The user inputs their preference for visiting Tokyo and their interest in tourist spots and cuisine into the device. The server then collects Tokyo weather information, the latest exchange rates, and traffic information. Based on this data, the server uses a generative AI model to select appropriate tourist spots (e.g., Sensoji Temple, observation decks) and restaurants (e.g., famous sushi restaurants). The server calculates the optimal transportation method and route from the airport to the accommodation and sends this information to the device. The device displays this information on the screen and provides audio guidance to the user. The server also generates information about the culture and customs of the destination, such as public etiquette and precautions in Tokyo (e.g., refraining from using cell phones on trains), and displays this information on the device. This allows the user to take prompt and appropriate action during their trip.

[0211] Example prompt sentence:

[0212] The user's current location is Tokyo. Please suggest the best tourist spots and restaurants based on the following information:

[0213] Category: ["Tourist attractions", "Gourmet"]

[0214] Special Needs: ["Wheelchair accessible"]

[0215] Weather information: [Weather information data]

[0216] Exchange Rate: [Exchange Rate Data]

[0217] Traffic Information: [Traffic Information Data]

[0218] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0219] Step 1:

[0220] The device acquires the traveler's location information

[0221] Input: When a traveler launches the app, the device's GPS function is activated.

[0222] Data processing: Determine current latitude and longitude using GPS.

[0223] Output: The obtained location information is sent to the server.

[0224] Step 2:

[0225] Users input their preferences and needs into the device

[0226] Input: The user uses the app's interface to input their destination, interest categories, and specific needs (e.g., wheelchair accessibility).

[0227] Data processing: The entered information is saved as digital data.

[0228] Output: Preferences and needs information is sent to the server.

[0229] Step 3:

[0230] The server collects real-time information

[0231] Input: Location information and user preferences and needs information are received by the server.

[0232] Data processing: Use API to obtain weather information, exchange rate information, and traffic information.

[0233] Output: All real-time information is stored and updated in the server.

[0234] Step 4:

[0235] The server generates information using the generative AI model

[0236] Input: User preferences, needs and real-time information are stored in a database on the server.

[0237] Data processing: A generative AI model analyzes this data and creates a prompt. Example prompt: "The user's current location is Tokyo. Please suggest the best tourist spots and restaurants based on the following information: Category: ['Tourist Spot', 'Gourmet'], Special Needs: ['Wheelchair Accessible'], Weather Information: [Weather Information Data], Exchange Rates: [Exchange Rate Data], Traffic Information: [Traffic Information Data]."

[0238] Output: The generative AI model generates information about tourist spots and restaurants.

[0239] Step 5:

[0240] The server calculates the optimal means of transportation and route

[0241] Input: The latitude and longitude information of the current location and destination, as well as traffic information, are entered into the server.

[0242] Data processing: Using map APIs and traffic APIs, we calculate the optimal means of transportation and routes based on distance and traffic conditions.

[0243] Output: Trip and route information is calculated and sent to the device.

[0244] Step 6:

[0245] The device provides information through voice guidance and on-screen display

[0246] Input: Information on tourist spots and restaurants, transportation methods and routes, and culture and customs information sent from the server is received by the device.

[0247] Data processing: Maps and text information are displayed on the terminal screen, and voice guidance is generated using a speech synthesis engine.

[0248] Output: Information is presented to the user visually and audibly.

[0249] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0250] This invention utilizes a generative AI model to provide appropriate travel information based on a traveler's location information and preferences, and also optimizes the content of the information provided using an emotion engine that recognizes the user's emotions, allowing travelers to enjoy their trips in comfort and peace of mind.

[0251] System configuration

[0252] The system includes the following main components:

[0253] 1. Location information acquisition means

[0254] 2. How to input your preferences and needs

[0255] 3. Real-time information gathering methods

[0256] 4. Information generation method using generative AI models

[0257] 5. Transportation and Route Calculation

[0258] 6. Means of providing information on culture and customs

[0259] 7. Emotion Engine

[0260] 8. Audio guide and on-screen display

[0261] Specific operation of each element

[0262] Location information acquisition means

[0263] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[0264] Input method for preferences and needs

[0265] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair accessibility, etc.) into the device. After inputting, they press the send button to confirm the settings.

[0266] Real-time information gathering means

[0267] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[0268] Information generation method using generative AI models

[0269] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs. This AI model learns from past travel data, local tourist guides, restaurant reviews, and more.

[0270] Transportation and route calculation

[0271] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal way to use public transportation or the optimal taxi route, and sends the results to the device.

[0272] Culture and customs information provision method

[0273] The server uses a generative AI model to provide information about the culture and customs of the destination, such as general etiquette and points of caution for travelers, and displays them on the device.

[0274] Emotion Engine

[0275] The device uses facial expression analysis, voice tone analysis, and other emotion recognition technologies to recognize the user's emotions, which are then sent to a server and fed into a generative AI model.

[0276] Audio guide and on-screen display

[0277] The device provides the collected information and generated guides to the user by voice and on-screen display, for example, providing route guidance to the destination by voice and displaying a detailed map on-screen.

[0278] Emotion engine operation

[0279] User Emotion Recognition

[0280] The device uses a camera and microphone to analyze the user's facial expressions and voice, recognizing emotions in real time, which are then converted into parameters such as stress level, happiness, and interest.

[0281] Information Optimization

[0282] The server uses the emotional data obtained from the emotion engine to optimize the information provided to the user. For example, if the user is feeling stressed, it will suggest relaxation spots and quiet tourist spots. If the user is excited, it will suggest active activities and events.

[0283] Specific examples

[0284] Specifically, consider a user traveling to New York. When the user launches the app, the device acquires the user's current location using GPS. The user inputs into the device their preference to go to New York and their needs, such as interest in sightseeing spots and gourmet food.

[0285] Next, the server collects New York weather information, the latest exchange rates, and traffic information, and uses this data to create a generative AI model to select appropriate tourist spots (e.g., Central Park, Times Square) and restaurants (e.g., famous steakhouses).

[0286] The server then calculates the optimal transportation method and route (e.g., taxi or subway) from the airport to the hotel and sends that information to the device, which then displays the information on the screen and provides voice guidance to the user.

[0287] The server also generates information about the culture and customs of the destination, such as public manners and things to be aware of in New York (e.g., how to behave on the subway), and displays this information on the device.

[0288] Additionally, the device utilizes an emotion engine to recognize the user's emotions and suggest relaxation spots (e.g., quiet parks) and soothing music if the user's stress level is high, or suggest active activities (e.g., live shows or sporting events) if the user is excited, ensuring the user enjoys an optimal travel experience.

[0289] As described above, by implementing the system of the present invention, travelers can enjoy a more comfortable and efficient travel experience. In addition, real-time information provision and emotion recognition enable the system to flexibly respond to changes in travel plans and unexpected situations.

[0290] The processing flow will be explained below.

[0291] Step 1:

[0292] The user launches the app. When the app launches, a message appears requesting permission to use location information.

[0293] Step 2:

[0294] If the device receives permission from the user to use location information, it will use the GPS function to obtain the user's current location and pass the obtained latitude and longitude data to the app.

[0295] Step 3:

[0296] The user fills in the app's input form with their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.), then presses the submit button to confirm the settings.

[0297] Step 4:

[0298] The device sends the user's input information to the server, along with the user's location information.

[0299] Step 5:

[0300] The server collects real-time weather, exchange rate, and traffic information through various APIs based on the received user information, and stores the collected information in a database.

[0301] Step 6:

[0302] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs, and the generated information is stored in an organized database.

[0303] Step 7:

[0304] The server calculates the optimal means of transportation and route from the user's current location to the destination, including how to use public transportation and taxis, as well as route information.

[0305] Step 8:

[0306] The server collects information from relevant databases and websites and compiles it using a generative AI model to generate information about the culture and customs of the destination.

[0307] Step 9:

[0308] The device analyzes the user's facial expressions and voice through a camera and microphone, and generates emotional data using an emotion engine. This data is then sent to a server.

[0309] Step 10:

[0310] The server analyzes the emotional data and optimizes the information provided based on the user's stress level and happiness level. For example, if stress is high, it will recommend relaxation spots, and if excited, it will suggest active activities.

[0311] Step 11:

[0312] The server then sends the generated information on tourist spots, gourmet food, transportation options and routes, and culture and customs to the device. The information is customized according to the user's emotional data.

[0313] Step 12:

[0314] The device displays the received information on its screen, including photos and descriptions of tourist attractions, restaurant menus and ratings, and maps of transportation routes. If audio guidance is enabled, the information is also provided aloud.

[0315] Step 13:

[0316] Users can use the displayed information to plan their trip in detail, and if necessary, refer to the displayed route to head to their destination. This allows users to enjoy their trip efficiently and with peace of mind.

[0317] Specific examples

[0318] For example, if a user travels to New York:

[0319] In step 1, the user launches the app and grants permission to use location information.

[0320] In step 2, the device obtains its location in New York.

[0321] In step 3, the user enters that they are interested in tourist spots and gourmet food.

[0322] In step 4, the terminal sends the input information to the server.

[0323] In step 5, the server collects weather information, exchange rate information, and traffic information.

[0324] In step 6, the server uses the generative AI model to generate information about tourist attractions (Central Park, Times Square) and restaurants.

[0325] In step 7, the server calculates the optimal mode of transportation and route.

[0326] In step 8, the server generates information about New York's culture and customs.

[0327] In step 9, the device analyzes facial expressions and voice, generates emotional data, and sends it to the server.

[0328] In step 10, the server optimizes the information based on the emotion data.

[0329] In step 11, the server sends the generated information to the terminal.

[0330] In step 12, the terminal displays the information on the screen and provides voice guidance.

[0331] In step 13, the user finalizes their travel plans based on the information and enjoys their trip with peace of mind.

[0332] As described above, the present invention is a system that supports a comfortable travel experience by taking into account the emotional data of travelers and providing information optimized for each individual user.

[0333] Example 2

[0334] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0335] Modern travelers make travel plans based on diverse needs and preferences, but these plans often need to be changed, requiring real-time information provision. Furthermore, a lack of flexible support based on travelers' emotional states makes it difficult to provide a comfortable and secure travel experience. Therefore, a system that provides optimal travel information based on travelers' location information, preferences, real-time environmental information, and emotional state is needed.

[0336] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0337] In this invention, the server includes means for acquiring location information, means for inputting traveler preferences and needs, means for collecting real-time weather information, exchange rate information, and traffic information, means for generating tourist spot and restaurant information based on traveler preferences and needs using a generative model, means for calculating the optimal means of transportation and route from the traveler's current location to the destination, means for providing information on the culture and customs of the destination, means for emotion recognition, and means for optimizing information based on emotion data. This allows travelers to receive optimal information in real time and enables flexible adjustment of travel plans according to their emotional state.

[0338] "Means for obtaining location information" refers to a system that uses GPS functions and communication networks to identify a traveler's current location.

[0339] "Means for inputting traveler preferences and needs" refers to an interface that allows travelers to input their desired destinations, categories of interest, special requirements, etc.

[0340] "Means of collecting real-time weather information, exchange rate information, and traffic information" refers to a system that regularly obtains information such as the latest weather, currency fluctuations, and traffic conditions through external information providers and APIs.

[0341] "Means for generating tourist destination and restaurant information based on travelers' preferences and needs using generative models" refers to a system that uses artificial intelligence technology and machine learning algorithms to suggest optimal tourist destinations and restaurants based on travelers' input information.

[0342] "A means for calculating the optimal means of transportation and route from a traveler's current location to their destination" is a system that calculates and suggests the optimal means of transportation, such as public transportation or taxi, and route based on the traveler's current location and destination.

[0343] "A means of providing information on the culture and customs of a destination" is a system that provides travelers with a summary of the cultural manners, customs, and precautions of the destination.

[0344] The "means for emotion recognition" is a system that recognizes a traveler's emotional state in real time by analyzing the traveler's facial expressions and tone of voice.

[0345] The "means for optimizing information based on emotional data" is a system that analyzes travelers' emotional data and provides optimal travel information and suggestions based on the results.

[0346] This invention is a system that utilizes a generative AI model to provide appropriate travel information based on the traveler's location information and preferences. Furthermore, by optimizing the content of the information provided using an emotion engine that recognizes the user's emotions, travelers can enjoy their trip comfortably and with peace of mind.

[0347] System configuration

[0348] The system includes the following main components:

[0349] 1. Location information acquisition means

[0350] 2. How to input your preferences and needs

[0351] 3. Real-time information gathering methods

[0352] 4. Information generation method (generative AI model)

[0353] 5. Transportation and Route Calculation

[0354] 6. Means of providing information on culture and customs

[0355] 7. Emotion Engine

[0356] 8. Audio guide and on-screen display

[0357] Location information acquisition means

[0358] The device uses GPS to obtain the traveler's location. For example, if a user launches the app and is at JFK Airport in New York, the device will identify their location. This location information is updated in real time, ensuring the traveler's current location is accurately detected.

[0359] Input method for preferences and needs

[0360] Users input their travel destinations, categories of interest (tourist attractions, restaurants, shopping, etc.), and specific needs (vegetarian options, barrier-free access, etc.) into the device. The input information is saved and used to generate future information. For example, a user may input that they are interested in tourist attractions and food in New York.

[0361] Real-time information gathering means

[0362] The server uses APIs to collect real-time weather information, currency exchange rates, and traffic information from the Internet. This information collection is done periodically, so the latest data is always kept. For example, it can collect the latest weather information and subway operation status for New York.

[0363] Information generation means

[0364] The server uses a generative AI model to generate tourist destination and restaurant information based on the user's preferences and needs. The generative AI model learns from past travel data, local tourist guides, restaurant reviews, etc. For example, it generates information about Central Park and famous steakhouses.

[0365] Transportation and route calculation

[0366] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal taxi route from the airport to the hotel and sends the results to the device.

[0367] Culture and customs information provision method

[0368] The server uses a generative AI model to generate information about the culture and customs of the destination and provides it to the device, such as advice on how to behave on the New York subway and general precautions.

[0369] Emotion Engine

[0370] The device analyzes the user's facial expressions and voice to recognize their emotions. This recognized emotional data is sent to the server and reflected in the information generated. For example, if the user is feeling stressed, that data is sent to the server.

[0371] Audio guide and on-screen display

[0372] The terminal provides the user with information provided by the server through voice and on screen, for example, providing route guidance to the destination through voice and displaying a detailed map on screen.

[0373] Specific examples

[0374] Specifically, consider the case where a user is traveling to New York. When the user launches the app, the device acquires the current location information using GPS. The user inputs into the device their preference to go to New York and their needs, such as interest in sightseeing spots and gourmet food.

[0375] The server then collects New York weather information, the latest exchange rates, and traffic information, and uses this data to select appropriate tourist attractions (e.g., Central Park, Times Square) and restaurants (e.g., famous steakhouses) using a generative AI model.

[0376] Furthermore, the server calculates the optimal transportation method and route (e.g., taxi or subway) from the airport to the accommodation and sends that information to the device, which not only displays this information on the screen but also provides voice guidance to the user.

[0377] The server also generates information about the culture and customs of the destination, such as etiquette and things to be aware of in New York (e.g., how to behave on the subway), and displays this information on the device.

[0378] Additionally, the device uses an emotion engine to recognize the user's emotions and suggests relaxation spots (e.g., quiet parks) or soothing music if the user's stress level is high, or suggests active activities like live shows or sporting events if the user is excited.

[0379] Prompt Sentence Examples

[0380] "We have a traveler currently at JFK Airport in New York who is interested in sightseeing and food. The current weather is sunny and traffic is normal. Please suggest the best sightseeing spots and restaurants, as well as the best route from the airport to their accommodation. Also, please suggest relaxation spots as this traveler's stress level may be high."

[0381] Through the above process, travelers can receive the most appropriate information in real time and enjoy a comfortable and efficient trip.

[0382] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0383] Step 1: User launches the app and gets location information

[0384] Description: When a user launches the app, the device uses GPS to obtain the user's current location.

[0385] Input: User action to launch the app

[0386] Output: GPS data of the user's current location

[0387] Specific operation: The device will automatically display the message "Detecting current location" and activate the GPS sensor to acquire location information, which will be stored in the internal database and used in the next step.

[0388] Step 2: User enters travel preferences and needs

[0389] Description: Users enter their travel destination, interest categories, and specific needs on the app screen.

[0390] Input: Travel destination, interest category, specific needs (e.g., New York, tourist destination, gourmet, vegetarian)

[0391] Output: Data about user preferences and needs

[0392] Specific operation: The user enters "New York" as their destination in the form within the app, selects "tourist destinations" and "food" as their interest categories, and selects "vegetarian-friendly" as their specific need. The input is confirmed by pressing the "Submit" button and sent to the server.

[0393] Step 3: The server collects real-time information

[0394] Description: The server collects real-time weather information, currency exchange rates, and traffic information via API.

[0395] Input: Data about the user's current location and destination

[0396] Output: Real-time weather information, exchange rates, traffic information

[0397] How it works: The server uses an API that is updated every minute to collect information such as the weather in New York (sunny, temperature 25°C), subway operation status (normal), and the latest exchange rate (1 dollar = 110 yen).

[0398] Step 4: The server generates information using the generative AI model

[0399] Description: Uses a generative AI model to generate tourist destination and restaurant information based on user input.

[0400] Input: Data on user preferences and needs, real-time information

[0401] Output: A list of recommended tourist spots and restaurants

[0402] How it works: The server uses a generative AI model to generate recommended locations, such as Central Park and a famous steakhouse, based on past travel data and restaurant reviews. These results are then used in the next step.

[0403] Step 5: Server calculates mode and route

[0404] Description: Calculates the best mode of transportation and route based on the user's current location and destination.

[0405] Input: User's current location and destination data

[0406] Output: Optimal travel modes and route information

[0407] Specific operation: The server considers public transportation and taxi options and calculates and provides route information, such as "A taxi from JFK Airport to your hotel takes 45 minutes and costs approximately $50."

[0408] Step 6: The server provides information about culture and customs

[0409] Description: Provides information about the culture and customs of a destination using generative AI models.

[0410] Input: Destination data

[0411] Output: Information about culture and customs

[0412] Specific behavior: The server generates information about the culture and customs of the destination and provides specific behavioral etiquette, such as "Do not eat food while riding the New York subway."

[0413] Step 7: The device recognizes the user's emotions

[0414] Description: The device uses a camera and microphone to analyze the user's facial expressions and voice to recognize emotions.

[0415] Input: User's facial expression data, voice tone

[0416] Output: User's emotional data (stress level, happiness, interest, etc.)

[0417] Specific operation: The device captures the user's facial expressions and analyzes the audio from the microphone to determine whether the user is feeling stressed.

[0418] Step 8: The server optimizes the information based on the emotional data

[0419] Description: Uses data obtained from the emotion engine to optimize the information provided to the user.

[0420] Input: User emotion data

[0421] Output: Information optimized according to emotions (relaxation spots and activities)

[0422] Specific operation: The server receives data indicating that the user's stress level is high and suggests, for example, a "quiet park" or "comforting music."

[0423] Step 9: The device provides optimized information to the user

[0424] Description: Provides information sent from the server to the user via voice and screen display.

[0425] Input: Optimization information sent from the server

[0426] Output: Present information to the user (audio guide and screen display)

[0427] Specific operation: The device displays detailed maps and tourist information on the screen, and also provides an audio guide, saying, "Next, head to Central Park."

[0428] Through the above processing steps, the user receives optimal information in real time and can proceed with their trip while enjoying it.

[0429] (Application example 2)

[0430] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0431] Travelers have difficulty quickly obtaining information about tourist spots and gourmet food that match their preferences and needs while traveling. Furthermore, it is difficult to create flexible travel plans that accommodate stress and changes in physical condition during travel. Furthermore, there is a lack of suggestions for dining locations that match the traveler's mood. Until now, no system has existed that can solve these issues.

[0432] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring the traveler's location information, means for inputting the traveler's preferences and needs, means for collecting real-time weather information, exchange rate information, and transportation information, means for generating tourist spot and gourmet information based on the traveler's preferences and needs using a generative AI model, means for calculating the optimal means of transportation and route from the traveler's current location to the destination, means for providing information on the culture and customs of the travel destination, means for recognizing the user's emotions and optimizing the information provided, and means for suggesting food and drink in real time. This allows travelers to quickly obtain the optimal tourist spot and gourmet information that suits their emotions and needs at any given time, enabling them to enjoy a comfortable and stress-free trip.

[0433] A "traveler" is an individual traveling to a particular destination and visiting that place for tourism, business, or other purposes.

[0434] "Location information acquisition means" means a device or system that uses GPS or other location-determining technology to determine a traveler's current geographic location.

[0435] A "means for inputting preferences and needs" is an interface through which travelers can input their interests and requests, including, for example, a touchscreen or voice recognition system.

[0436] "Real-time weather information," "exchange rate information," and "means of collecting traffic information" refer to systems for obtaining the latest weather information, currency exchange rates, traffic conditions, etc. via the Internet or API.

[0437] A "generative AI model" is an artificial intelligence model that learns from large datasets and generates appropriate tourist destination and gourmet information based on user input and real-time information.

[0438] "Means for calculating the optimal means of transportation and route from current location to destination" refers to an algorithm or system that calculates and suggests the optimal means of transportation and route when a traveler travels.

[0439] "Means for providing information about the culture and customs of the destination" refers to a system for providing travelers with information about the culture, manners, and customs specific to the region they are visiting.

[0440] "Means for recognizing user emotions and optimizing information provided" refers to technology that recognizes travelers' emotions and mental state and adjusts the travel information and suggestions provided based on that information.

[0441] "Means for suggesting food and drink in real time" refers to a system that suggests appropriate restaurants and menus in real time based on the user's preferences and current situation.

[0442] The system of the present invention provides multiple means for travelers to enjoy a comfortable and stress-free travel experience. Specific components of the system and their operation will now be described.

[0443] System configuration

[0444] 1. Location information acquisition means

[0445] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[0446] 2. How to input your preferences and needs

[0447] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair accessibility, etc.) into the device. After inputting, they press the send button to confirm the settings.

[0448] 3. Real-time information gathering methods

[0449] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[0450] 4. Information generation method using generative AI models

[0451] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs. This AI model learns from past travel data, local tourist guides, restaurant reviews, and more.

[0452] 5. Transportation and Route Calculation

[0453] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal way to use public transportation or the optimal taxi route, and sends the results to the device.

[0454] 6. Means of providing information on culture and customs

[0455] The server uses a generative AI model to provide information about the culture and customs of the destination, such as general etiquette and points of caution for travelers, and displays them on the device.

[0456] 7. Emotion Engine

[0457] The device uses facial expression analysis, voice tone analysis, and other emotion recognition technologies to recognize the user's emotions, which are then sent to a server and fed into a generative AI model.

[0458] 8. Food and beverage suggestion means

[0459] The server will then make real-time recommendations for restaurants and food based on the user's emotional data and preferences, providing options that best suit the user's current mood and situation.

[0460] Processing Description

[0461] Hardware Configuration

[0462] Device: Smartphone, camera, microphone, GPS function

[0463] Server: Database system, AI model operation environment

[0464] Software Configuration

[0465] GPS-linked applications

[0466] API communication function for obtaining real-time information

[0467] Generative AI model (AI model name: Transformer-based Model)

[0468] Emotion engine (emotion analysis software: OpenFace, voice emotion analysis: OpenSMILE)

[0469] Scripts for data analysis and processing (Python-based)

[0470] Specific example explanation

[0471] If a traveler is in New York, the device will use GPS to pinpoint their current location. The user launches the app and inputs their interest in tourist spots and cuisine. The server collects real-time weather, currency exchange rates, and traffic information, and uses a generative AI model to suggest suitable tourist spots and restaurants.

[0472] At the same time, the device's camera and microphone are used to recognize the user's emotions and suggest relaxing cafes and activities based on their emotional state (for example, whether they want to relax or stay active).

[0473] Prompt Sentence Examples

[0474] "Generate a list of cafes that users want to visit when they feel like relaxing."

[0475] This allows users to enjoy activities that best suit their mood and situation at the time, resulting in a highly satisfying travel experience.

[0476] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0477] Step 1: Obtaining the user's location

[0478] Input: The user launches the app.

[0479] Operation: Uses the device's GPS function to obtain the user's current location.

[0480] Output: Current location of the user (latitude and longitude).

[0481] Step 2: Enter your preferences and needs

[0482] Input: The user enters a destination, interest category, or specific need.

[0483] Operation: Data is entered through the user interface and sent to the server.

[0484] Output: Travel destinations, interest categories, specific needs.

[0485] Step 3: Gathering real-time information

[0486] Input: location information, destination data.

[0487] How it works: The server collects weather, currency exchange rates, and traffic information through an API.

[0488] Data processing: The collected data is stored in a database and updated in real time.

[0489] Output: Latest weather information, exchange rate information, traffic information.

[0490] Step 4: Generate information using a generative AI model

[0491] Input: User location, preferences and needs, real-time information.

[0492] How it works: Using a generative AI model, it generates information about tourist spots and restaurants based on the user's preferences and needs.

[0493] Data calculations: Generate optimal suggestions based on past travel data, local tourist guides, and restaurant reviews.

[0494] Output: List of tourist attractions, list of restaurants.

[0495] Step 5: Calculate travel modes and routes

[0496] Input: User's current location, destination, real-time information.

[0497] How it works: The server uses a route calculation algorithm to calculate the optimal mode of transportation and route.

[0498] Data calculation: Consider public transport timetables and route information, as well as taxi route information.

[0499] Output: Optimal travel modes and route information.

[0500] Step 6: Providing information about culture and customs

[0501] Input: Destination data.

[0502] How it works: Generative AI models are used to generate cultural and custom information about a destination.

[0503] Data processing: Collecting and analyzing information about local culture, manners, and customs.

[0504] Output: Information about culture and customs.

[0505] Step 7: Emotion Recognition

[0506] Input: User's facial expression data, voice data.

[0507] How it works: Recognizes the user's emotions using the device's camera and microphone.

[0508] Data calculation: Facial expression analysis and voice tone analysis are performed to generate emotion data.

[0509] Output: User's emotional data (stress level, happiness, etc.).

[0510] Step 8: Optimize information delivery

[0511] Input: Emotion data, information from generative AI models.

[0512] How it works: The server adjusts the priority and content of information taking into account emotional data.

[0513] Data calculation: If stress levels are high, a relaxation spot is recommended, and if you are excited, an active activity is recommended.

[0514] Output: Optimized proposal information.

[0515] Step 9: Real-time food and drink suggestions

[0516] Input: Emotional data, user preferences and needs.

[0517] How it works: The server suggests the best restaurants and food options based on your emotional data and preferences.

[0518] Data calculations: Analyze real-time restaurant information and reviews.

[0519] Output: A list of suggested restaurants and food options.

[0520] Through the above processing steps, the user can quickly obtain information on tourist spots and gourmet food that best suits their feelings and needs at the time, allowing them to enjoy a comfortable and stress-free trip.

[0521] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0522] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0523] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0524] [Second embodiment]

[0525] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0526] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0527] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0528] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0529] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0530] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0531] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0532] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0533] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0534] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0535] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0536] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0537] This invention is a system that utilizes generative AI models to provide appropriate travel information based on a traveler's location information and needs. This system helps travelers quickly and accurately obtain local information and smoothly select transportation methods.

[0538] System configuration

[0539] The system includes the following main components:

[0540] 1. Location information acquisition means

[0541] 2. How to input your preferences and needs

[0542] 3. Real-time information gathering methods

[0543] 4. Information generation method using generative AI models

[0544] 5. Transportation and Route Calculation

[0545] 6. Means of providing information on culture and customs

[0546] 7. Audio guide and on-screen display

[0547] Specific operation of each element

[0548] Location information acquisition means

[0549] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[0550] Input method for preferences and needs

[0551] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.) into the terminal, and the system then provides personalized information based on the user's requests.

[0552] Real-time information gathering means

[0553] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[0554] Information generation method using generative AI models

[0555] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs. This AI model learns from past travel data, local tourist guides, restaurant reviews, and more.

[0556] Transportation and route calculation

[0557] The server calculates the optimal means of transportation and route based on the user's current location and destination, for example, calculating the optimal method of using public transportation or the optimal taxi route, and sends the results to the device.

[0558] Culture and customs information provision method

[0559] The server uses a generative AI model to provide information about the culture and customs of the destination, such as general etiquette and points of caution for travelers, and displays them on the device.

[0560] Audio guide and on-screen display

[0561] The device provides the collected information and generated guides to the user via voice and on-screen display, for example, providing route guidance to the destination via voice and displaying a detailed map on the screen.

[0562] Specific examples

[0563] Specifically, consider a user traveling to Tokyo. When the user launches the app, the device uses GPS to obtain the user's current location. The user inputs into the device their preference to go to Tokyo and their interest in sightseeing spots and gourmet food.

[0564] Next, the server collects Tokyo weather information, the latest exchange rates, and traffic information, and uses this data to create a generative AI model to select appropriate tourist spots (e.g., Sensoji Temple, Skytree) and restaurants (e.g., famous sushi restaurants).

[0565] The server then calculates the optimal transportation method and route (e.g., limousine bus or train) from the airport to the hotel and sends that information to the device, which then displays the information on the screen and provides voice guidance to the user.

[0566] The server also generates information about the culture and customs of the destination, such as public manners and precautions in Tokyo (e.g., refrain from using mobile phones on trains), and displays it on the device, allowing users to take prompt and appropriate action during their trip.

[0567] As described above, by implementing the system of the present invention, travelers can enjoy a more comfortable and efficient travel experience. In addition, by providing real-time information, it is possible to flexibly respond to changes in travel plans and unexpected situations.

[0568] The processing flow will be explained below.

[0569] Step 1:

[0570] The user launches the app. When the app launches, a message appears requesting permission to use location information.

[0571] Step 2:

[0572] If the device receives permission from the user to use location information, it uses the GPS function to obtain the user's current location and sends the obtained latitude and longitude data to the app.

[0573] Step 3:

[0574] The user fills in the app's input form with their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.), then presses the submit button to confirm the settings.

[0575] Step 4:

[0576] The device sends the user's input information to the server, along with the user's location information.

[0577] Step 5:

[0578] Based on the received user information, the server collects real-time weather, exchange rate, and traffic information through related API services, and stores the collected information in a database.

[0579] Step 6:

[0580] The server uses the generative AI model to generate tourist and gourmet information based on the user's preferences and needs, and the generated information is then stored in an organized database.

[0581] Step 7:

[0582] The server calculates the optimal means of transportation and route from the user's current location to the destination, including how to use public transportation and taxis, and route information.

[0583] Step 8:

[0584] The server collects information from relevant databases and websites and compiles it using a generative AI model to generate information about the culture and customs of the destination.

[0585] Step 9:

[0586] The server then sends the generated information on tourist spots, gourmet food, transportation options and routes, and culture and customs to the device. The information sent is customized according to the user's request.

[0587] Step 10:

[0588] The device displays the received information on its screen, including photos and descriptions of tourist attractions, restaurant menus and ratings, and maps of transportation routes. If audio guidance is enabled, the information is also provided aloud.

[0589] Step 11:

[0590] Based on the displayed information, users can begin to plan their trip in detail. If necessary, they can refer to the displayed route to head to their destination. This allows users to enjoy their trip efficiently and with peace of mind.

[0591] Example 1

[0592] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0593] Conventional travel information systems lack the ability to provide personalized information based on users' location information and individual needs, and have difficulty providing real-time information quickly and accurately. As a result, travelers often struggle to find information about appropriate transportation methods and the culture and customs of their destinations, resulting in an inconvenient travel experience.

[0594] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0595] In this invention, the server includes means for collecting real-time weather information, exchange rate information, and traffic information from the Internet via API, means for generating tourist spot and gourmet information based on past data and local information using a generative AI model, and means for providing information on the culture and customs of the travel destination using the generative AI model, thereby enabling travelers to quickly and accurately obtain personalized information in real time.

[0596] A "terminal" is a device used by a traveler, such as a portable information terminal or smartphone, to obtain the traveler's current location and display necessary information.

[0597] "GPS" is an abbreviation for Global Positioning System, a technology that allows devices to receive and accurately measure their location on Earth from satellites.

[0598] "User" refers to the traveler who uses the system, and is the entity that inputs information into and operates the system.

[0599] "API" stands for Application Programming Interface, a means by which different software systems communicate with each other and exchange information.

[0600] "Real-time information" refers to information that is up to date at the present time, and includes, for example, weather information and traffic information.

[0601] A "generative AI model" is a model that uses artificial intelligence technology to recognize patterns and generate new information based on input data.

[0602] "Tourist destinations" refer to places and attractions that are popular destinations for tourists.

[0603] "Gourmet information" refers to information about restaurants and cuisine in the areas that travelers visit.

[0604] "Transportation" refers to the means of transportation that travelers use to travel from their current location to their destination, including public transportation and taxis.

[0605] A "route" refers to the path or route a traveler takes to get from their current location to their destination.

[0606] "Cultural and customs information" refers to information about the local culture, social customs, and behavioral norms at the travel destination.

[0607] "Audio guide" refers to a function that provides information and guidance to the user through audio.

[0608] "Screen display" refers to the function of visually displaying information on the device's display.

[0609] "Means" refers to the method or device used by the system to perform a particular function or operation.

[0610] The system utilizes a generative AI model based on the traveler's location and needs to provide appropriate travel information. An embodiment of the system is described in detail below.

[0611] System Components

[0612] The following major hardware and software are used to implement the system:

[0613] 1. Terminal: A mobile information terminal or smartphone used by a traveler. It has a GPS function and acquires location information and communicates between the user and the server.

[0614] 2. Server: A computing device located in the cloud that collects real-time information from the internet via APIs and generates and processes that information using generative AI models.

[0615] 3. Generative AI model: An artificial intelligence model that learns from past travel data and local information. For example, it uses large-scale language models (such as the GPT series).

[0616] 4. Internet: A communication network for obtaining real-time information (weather information, exchange rate information, traffic information) through APIs.

[0617] How it works

[0618] Location information acquisition

[0619] When a traveler launches the app, the device automatically obtains their current location using its built-in GPS function, and the obtained location information is sent to the server.

[0620] Input your preferences and needs

[0621] Users input their travel destinations, categories of interest (tourist spots, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.) into their devices. This input information is sent to the server.

[0622] Real-time information gathering

[0623] The server retrieves real-time weather, exchange rate, and traffic information from the Internet via multiple APIs, ensuring that the latest data is always available.

[0624] Information generation and provision

[0625] The server uses a generative AI model based on the user's preferences and needs to generate information about tourist spots and gourmet food. The generative AI model learns from past travel data and guide information, allowing it to provide the user with the most appropriate information.

[0626] For example, the following prompt sentence is input into the generative AI model: "The user is traveling to Tokyo and is interested in tourist spots and gourmet food. Please collect weather information, the latest exchange rates, and traffic information for Tokyo, and suggest suitable tourist spots and restaurants. In addition, please calculate the optimal means of transportation and route from the airport to the accommodation, and also provide information on public manners and things to be careful of in Tokyo."

[0627] Transportation and route calculation

[0628] The server calculates the optimal transportation method (e.g., public transportation, taxi) and route based on the user's current location and destination, and sends the calculation results to the device.

[0629] Providing information on culture and customs

[0630] The server uses a generative AI model to generate information about the culture and customs of the destination and provides it to the user as a guide for their travels.

[0631] Audio guide and on-screen display

[0632] The terminal displays the information sent from the server on its screen and provides audio guidance as needed, allowing users to receive easy-to-understand guidance both visually and audibly.

[0633] Specific operation example

[0634] For example, consider a user traveling to Tokyo. When the traveler launches the app, the device retrieves their current location information. Next, the user enters "Tokyo" as their destination, selects "tourist destinations" and "food" as categories of interest, and also enters "vegetarian-friendly" as a need. Based on this, the server collects real-time weather, exchange rates, and traffic information, uses a generative AI model to generate appropriate tourist destination and food information, calculates transportation methods and routes, and provides information on culture and customs. Finally, the device provides this information to the user via screen display and audio guidance.

[0635] By implementing the present invention in this way, travelers can obtain necessary information in real time and enjoy an efficient and comfortable trip.

[0636] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0637] Step 1:

[0638] (Location information acquisition)

[0639] When a traveler launches the app, the device automatically acquires the current location information using the built-in GPS function. The acquired location information (input) is sent to the server (output). This allows the server to grasp the traveler's current location.

[0640] Specific operation: The user launches the app and taps "Check current location." The device activates the GPS and sends the coordinate data (latitude and longitude) of the current location (e.g., Tokyo Station) to the server.

[0641] Step 2:

[0642] (Enter your preferences and needs)

[0643] Users input their travel destinations, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.) into their devices (input). This information is then sent from the device to the server (output).

[0644] Specific operation: The user enters "Tokyo" as the destination. On the category selection screen, select "Tourist Destinations" and "Gourmet." If necessary, check "Vegetarian Friendly."

[0645] Step 3:

[0646] (Real-time information gathering)

[0647] The server obtains real-time weather, exchange rate, and traffic information from the Internet via multiple APIs (input), which provides the latest data (output).

[0648] Specific operation: The server calls the Open Weather Map API to get the latest weather information for Tokyo, uses the Exchange Rate API to get the latest exchange rates, and uses the Traffic Information API to get real-time traffic information for Tokyo.

[0649] Step 4:

[0650] (Information generation using generative AI models)

[0651] The server inputs prompts into the generative AI model based on the user's preferences and needs (input), and generates tourist destination and gourmet information (output). The generative AI model learns from past travel data and guide information, and provides the user with the most appropriate information.

[0652] Specific operation: The server generates a prompt sentence: "The user is traveling to Tokyo and is interested in tourist spots and gourmet food. Please collect Tokyo weather information, the latest exchange rates, and traffic information, and suggest suitable tourist spots and restaurants." This prompt sentence is input into a generative AI model (e.g., GPT-4) to generate tourist spot and gourmet information.

[0653] Step 5:

[0654] (Transportation and route calculation)

[0655] The server calculates the optimal means of transportation (e.g., public transportation, taxi) and route based on the user's current location and destination (input). The optimal route information is obtained as a result of the calculation (output).

[0656] Specific operation: The server uses the Google Maps API to calculate the optimal public transportation route from Tokyo Station to Sensoji Temple, and generates detailed directions such as "Get on at Tokyo Station and take the Ginza Line to Asakusa Station."

[0657] Step 6:

[0658] (Providing information on culture and customs)

[0659] The server uses a generative AI model to generate information about the culture and customs of the travel destination (input), and the obtained information is sent from the server to the device (output).

[0660] Specific operation: The server generates a prompt sentence, "Please tell me about public manners and things to be careful about in Tokyo." This is input into the generative AI model, which generates information about things to be careful about and manners in Tokyo. The generated information is added to the response data.

[0661] Step 7:

[0662] (Audio guide and on-screen display)

[0663] The terminal provides the information received from the server to the user by displaying it on the screen and by voice (output).

[0664] Specific operation: The device displays the received tourist spots, gourmet information, route guidance, and cultural information on the app's UI. When the user taps on route guidance, the voice assistant will say, "Take the Ginza Line from Tokyo Station to Asakusa Station."

[0665] (Application example 1)

[0666] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0667] Travelers need a lot of information when they travel, such as choosing tourist attractions and restaurants, understanding the culture and customs, and choosing the best means of transportation. Information about specific travel needs (e.g., wheelchair accessibility or vegetarian options) is also important, but providing this information in real time is difficult. Furthermore, if the information provided is insufficient or inappropriate, the traveler's experience may be compromised. Therefore, to ensure travelers can enjoy their trip smoothly, a system is needed that provides real-time information based on their preferences and needs, as well as guidance on transportation and routes.

[0668] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0669] In this invention, the server includes means for acquiring the traveler's location information, means for inputting the traveler's preferences and needs, means for collecting real-time weather information, exchange rate information, and traffic information, means for generating tourist spot and restaurant information based on the traveler's preferences and needs using a generative AI model, means for calculating the optimal means of transportation and route from the traveler's current location to the destination, means for providing the generated tourist spot and restaurant information and travel route by voice guidance and on-screen display, and means for providing information on the culture and customs of the travel destination. This allows travelers to obtain more specific and personalized travel information in real time, enabling a comfortable and efficient travel experience.

[0670] "Location information" is data that indicates the traveler's current geographical location. It is mainly obtained using the GPS (Global Positioning System) function.

[0671] "Preferences and needs" refers to the personal interests and requirements that travelers want to fulfill during their trip, such as "tourist attractions," "food," and "wheelchair access."

[0672] "Real-time information" refers to the latest data available at the present time, including weather information, exchange rate information, traffic information, and so on.

[0673] "Weather Information" means data about current and future weather conditions at a destination, including temperature, precipitation, wind speed, etc.

[0674] "Exchange Rate Information" is up-to-date data on the exchange rates between different currencies, which helps travelers when exchanging currencies.

[0675] "Traffic information" refers to current information about public transportation and roads, including traffic congestion information, accident information, and operation status.

[0676] A "generative AI model" is a program that uses artificial intelligence to analyze data and generate information for a specific task.

[0677] "Tourist destinations" are places or facilities that tourists visit, including famous places, ruins, and natural parks.

[0678] "Restaurant information" is data about places where travelers can eat, including restaurants, cafes, food stands, etc.

[0679] "Transportation" refers to the means of transportation a traveler uses to travel from their current location to their destination, including walking, public transportation, and driving.

[0680] A "route" refers to the path a traveler takes from their current location to their destination, taking into account the shortest distance and the most optimal route.

[0681] "Audio guidance" is a method of providing specific information or instructions to travelers by voice, thereby providing information without relying on vision.

[0682] "Screen display" refers to a method of displaying information on the display of a traveler's device, allowing the information to be visually confirmed.

[0683] "Culture and customs" refers to the traditional ways of behavior and manners of a particular region or country. They serve as a guide for travelers on how to behave appropriately in that area.

[0684] This invention is a system that utilizes generative AI models to provide appropriate tourist destination and restaurant information based on travelers' location information and needs. The system helps travelers quickly and accurately obtain local information and select the best mode of transportation.

[0685] System configuration

[0686] The system has the following main components:

[0687] 1. Location information acquisition means

[0688] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[0689] 2. How to input your preferences and needs

[0690] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (wheelchair access, etc.) into the terminal, and the system then provides personalized information based on the user's requests.

[0691] 3. Real-time information gathering methods

[0692] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[0693] 4. Information generation method using generative AI models

[0694] The server generates tourist destination and restaurant information based on the user's preferences and needs using a generative AI model that learns from past travel data, local tourist guides, restaurant reviews, and more.

[0695] 5. Transportation and Route Calculation

[0696] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal method of using public transportation or the optimal taxi route, and sends the results to the device.

[0697] 6. Voice guidance and screen display means for generated information

[0698] The terminal provides the generated tourist spot and restaurant information and travel routes through voice guidance and on-screen display, allowing travelers to obtain information both visually and audibly.

[0699] 7. Means of providing information on culture and customs

[0700] The server uses generative AI models to provide information about the culture and customs of the travel destination, which users can view on screen and through voice guidance.

[0701] Processing Description

[0702] The server and device work together to perform the following process. First, the device obtains the user's location information and sends it to the server. Next, the user's preferences and needs information is also sent to the server. Based on this information, the server collects real-time information from the API. The generative AI model uses this data to generate optimal tourist destination and restaurant information for the user, and provides this information via voice guidance and on-screen display.

[0703] Specific examples

[0704] For example, consider a user traveling to Tokyo. When the user launches the app, the device uses GPS to obtain their current location. The user inputs their preference for visiting Tokyo and their interest in tourist spots and cuisine into the device. The server then collects Tokyo weather information, the latest exchange rates, and traffic information. Based on this data, the server uses a generative AI model to select appropriate tourist spots (e.g., Sensoji Temple, observation decks) and restaurants (e.g., famous sushi restaurants). The server calculates the optimal transportation method and route from the airport to the accommodation and sends this information to the device. The device displays this information on the screen and provides audio guidance to the user. The server also generates information about the culture and customs of the destination, such as public etiquette and precautions in Tokyo (e.g., refraining from using cell phones on trains), and displays this information on the device. This allows the user to take prompt and appropriate action during their trip.

[0705] Example prompt sentence:

[0706] The user's current location is Tokyo. Please suggest the best tourist spots and restaurants based on the following information:

[0707] Category: ["Tourist attractions", "Gourmet"]

[0708] Special Needs: ["Wheelchair accessible"]

[0709] Weather information: [Weather information data]

[0710] Exchange Rate: [Exchange Rate Data]

[0711] Traffic Information: [Traffic Information Data]

[0712] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0713] Step 1:

[0714] The device acquires the traveler's location information

[0715] Input: When a traveler launches the app, the device's GPS function is activated.

[0716] Data processing: Determine current latitude and longitude using GPS.

[0717] Output: The obtained location information is sent to the server.

[0718] Step 2:

[0719] Users input their preferences and needs into the device

[0720] Input: The user uses the app's interface to input their destination, interest categories, and specific needs (e.g., wheelchair accessibility).

[0721] Data processing: The entered information is saved as digital data.

[0722] Output: Preferences and needs information is sent to the server.

[0723] Step 3:

[0724] The server collects real-time information

[0725] Input: Location information and user preferences and needs information are received by the server.

[0726] Data processing: Use API to obtain weather information, exchange rate information, and traffic information.

[0727] Output: All real-time information is stored and updated in the server.

[0728] Step 4:

[0729] The server generates information using the generative AI model

[0730] Input: User preferences, needs and real-time information are stored in a database on the server.

[0731] Data processing: A generative AI model analyzes this data and creates a prompt. Example prompt: "The user's current location is Tokyo. Please suggest the best tourist spots and restaurants based on the following information: Category: ['Tourist Spot', 'Gourmet'], Special Needs: ['Wheelchair Accessible'], Weather Information: [Weather Information Data], Exchange Rates: [Exchange Rate Data], Traffic Information: [Traffic Information Data]."

[0732] Output: The generative AI model generates information about tourist spots and restaurants.

[0733] Step 5:

[0734] The server calculates the optimal means of transportation and route

[0735] Input: The latitude and longitude information of the current location and destination, as well as traffic information, are entered into the server.

[0736] Data processing: Using map APIs and traffic APIs, we calculate the optimal means of transportation and routes based on distance and traffic conditions.

[0737] Output: Trip and route information is calculated and sent to the device.

[0738] Step 6:

[0739] The device provides information through voice guidance and on-screen display

[0740] Input: Information on tourist spots and restaurants, transportation methods and routes, and culture and customs information sent from the server is received by the device.

[0741] Data processing: Maps and text information are displayed on the terminal screen, and voice guidance is generated using a speech synthesis engine.

[0742] Output: Information is presented to the user visually and audibly.

[0743] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0744] This invention utilizes a generative AI model to provide appropriate travel information based on a traveler's location information and preferences, and also optimizes the content of the information provided using an emotion engine that recognizes the user's emotions, allowing travelers to enjoy their trips in comfort and peace of mind.

[0745] System configuration

[0746] The system includes the following main components:

[0747] 1. Location information acquisition means

[0748] 2. How to input your preferences and needs

[0749] 3. Real-time information gathering methods

[0750] 4. Information generation method using generative AI models

[0751] 5. Transportation and Route Calculation

[0752] 6. Means of providing information on culture and customs

[0753] 7. Emotion Engine

[0754] 8. Audio guide and on-screen display

[0755] Specific operation of each element

[0756] Location information acquisition means

[0757] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[0758] Input method for preferences and needs

[0759] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair accessibility, etc.) into the device. After inputting, they press the send button to confirm the settings.

[0760] Real-time information gathering means

[0761] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[0762] Information generation method using generative AI models

[0763] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs. This AI model learns from past travel data, local tourist guides, restaurant reviews, and more.

[0764] Transportation and route calculation

[0765] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal way to use public transportation or the optimal taxi route, and sends the results to the device.

[0766] Culture and customs information provision method

[0767] The server uses a generative AI model to provide information about the culture and customs of the destination, such as general etiquette and points of caution for travelers, and displays them on the device.

[0768] Emotion Engine

[0769] The device uses facial expression analysis, voice tone analysis, and other emotion recognition technologies to recognize the user's emotions, which are then sent to a server and fed into a generative AI model.

[0770] Audio guide and on-screen display

[0771] The device provides the collected information and generated guides to the user by voice and on-screen display, for example, providing route guidance to the destination by voice and displaying a detailed map on-screen.

[0772] Emotion engine operation

[0773] User Emotion Recognition

[0774] The device uses a camera and microphone to analyze the user's facial expressions and voice, recognizing emotions in real time, which are then converted into parameters such as stress level, happiness, and interest.

[0775] Information Optimization

[0776] The server uses the emotional data obtained from the emotion engine to optimize the information provided to the user. For example, if the user is feeling stressed, it will suggest relaxation spots and quiet tourist spots. If the user is excited, it will suggest active activities and events.

[0777] Specific examples

[0778] Specifically, consider a user traveling to New York. When the user launches the app, the device acquires the user's current location using GPS. The user inputs into the device their preference to go to New York and their needs, such as interest in sightseeing spots and gourmet food.

[0779] Next, the server collects New York weather information, the latest exchange rates, and traffic information, and uses this data to create a generative AI model to select appropriate tourist spots (e.g., Central Park, Times Square) and restaurants (e.g., famous steakhouses).

[0780] The server then calculates the optimal transportation method and route (e.g., taxi or subway) from the airport to the hotel and sends that information to the device, which then displays the information on the screen and provides voice guidance to the user.

[0781] The server also generates information about the culture and customs of the destination, such as public manners and things to be aware of in New York (e.g., how to behave on the subway), and displays this information on the device.

[0782] Additionally, the device utilizes an emotion engine to recognize the user's emotions and suggest relaxation spots (e.g., quiet parks) and soothing music if the user's stress level is high, or suggest active activities (e.g., live shows or sporting events) if the user is excited, ensuring the user enjoys an optimal travel experience.

[0783] As described above, by implementing the system of the present invention, travelers can enjoy a more comfortable and efficient travel experience. In addition, real-time information provision and emotion recognition enable the system to flexibly respond to changes in travel plans and unexpected situations.

[0784] The processing flow will be explained below.

[0785] Step 1:

[0786] The user launches the app. When the app launches, a message appears requesting permission to use location information.

[0787] Step 2:

[0788] If the device receives permission from the user to use location information, it will use the GPS function to obtain the user's current location and pass the obtained latitude and longitude data to the app.

[0789] Step 3:

[0790] The user fills in the app's input form with their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.), then presses the submit button to confirm the settings.

[0791] Step 4:

[0792] The device sends the user's input information to the server, along with the user's location information.

[0793] Step 5:

[0794] The server collects real-time weather, exchange rate, and traffic information through various APIs based on the received user information, and stores the collected information in a database.

[0795] Step 6:

[0796] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs, and the generated information is stored in an organized database.

[0797] Step 7:

[0798] The server calculates the optimal means of transportation and route from the user's current location to the destination, including how to use public transportation and taxis, as well as route information.

[0799] Step 8:

[0800] The server collects information from relevant databases and websites and compiles it using a generative AI model to generate information about the culture and customs of the destination.

[0801] Step 9:

[0802] The device analyzes the user's facial expressions and voice through a camera and microphone, and generates emotional data using an emotion engine. This data is then sent to a server.

[0803] Step 10:

[0804] The server analyzes the emotional data and optimizes the information provided based on the user's stress level and happiness level. For example, if stress is high, it will recommend relaxation spots, and if excited, it will suggest active activities.

[0805] Step 11:

[0806] The server then sends the generated information on tourist spots, gourmet food, transportation options and routes, and culture and customs to the device. The information is customized according to the user's emotional data.

[0807] Step 12:

[0808] The device displays the received information on its screen, including photos and descriptions of tourist attractions, restaurant menus and ratings, and maps of transportation routes. If audio guidance is enabled, the information is also provided aloud.

[0809] Step 13:

[0810] Users can use the displayed information to plan their trip in detail, and if necessary, refer to the displayed route to head to their destination. This allows users to enjoy their trip efficiently and with peace of mind.

[0811] Specific examples

[0812] For example, if a user travels to New York:

[0813] In step 1, the user launches the app and grants permission to use location information.

[0814] In step 2, the device obtains its location in New York.

[0815] In step 3, the user enters that they are interested in tourist spots and gourmet food.

[0816] In step 4, the terminal sends the input information to the server.

[0817] In step 5, the server collects weather information, exchange rate information, and traffic information.

[0818] In step 6, the server uses the generative AI model to generate information about tourist attractions (Central Park, Times Square) and restaurants.

[0819] In step 7, the server calculates the optimal mode of transportation and route.

[0820] In step 8, the server generates information about New York's culture and customs.

[0821] In step 9, the device analyzes facial expressions and voice, generates emotional data, and sends it to the server.

[0822] In step 10, the server optimizes the information based on the emotion data.

[0823] In step 11, the server sends the generated information to the terminal.

[0824] In step 12, the terminal displays the information on the screen and provides voice guidance.

[0825] In step 13, the user finalizes their travel plans based on the information and enjoys their trip with peace of mind.

[0826] As described above, the present invention is a system that supports a comfortable travel experience by taking into account the emotional data of travelers and providing information optimized for each individual user.

[0827] Example 2

[0828] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0829] Modern travelers make travel plans based on diverse needs and preferences, but these plans often need to be changed, requiring real-time information provision. Furthermore, a lack of flexible support based on travelers' emotional states makes it difficult to provide a comfortable and secure travel experience. Therefore, a system that provides optimal travel information based on travelers' location information, preferences, real-time environmental information, and emotional state is needed.

[0830] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0831] In this invention, the server includes means for acquiring location information, means for inputting traveler preferences and needs, means for collecting real-time weather information, exchange rate information, and traffic information, means for generating tourist spot and restaurant information based on traveler preferences and needs using a generative model, means for calculating the optimal means of transportation and route from the traveler's current location to the destination, means for providing information on the culture and customs of the destination, means for emotion recognition, and means for optimizing information based on emotion data. This allows travelers to receive optimal information in real time and enables flexible adjustment of travel plans according to their emotional state.

[0832] "Means for obtaining location information" refers to a system that uses GPS functions and communication networks to identify a traveler's current location.

[0833] "Means for inputting traveler preferences and needs" refers to an interface that allows travelers to input their desired destinations, categories of interest, special requirements, etc.

[0834] "Means of collecting real-time weather information, exchange rate information, and traffic information" refers to a system that regularly obtains information such as the latest weather, currency fluctuations, and traffic conditions through external information providers and APIs.

[0835] "Means for generating tourist destination and restaurant information based on travelers' preferences and needs using generative models" refers to a system that uses artificial intelligence technology and machine learning algorithms to suggest optimal tourist destinations and restaurants based on travelers' input information.

[0836] "A means for calculating the optimal means of transportation and route from a traveler's current location to their destination" is a system that calculates and suggests the optimal means of transportation, such as public transportation or taxi, and route based on the traveler's current location and destination.

[0837] "A means of providing information on the culture and customs of a destination" is a system that provides travelers with a summary of the cultural manners, customs, and precautions of the destination.

[0838] The "means for emotion recognition" is a system that recognizes a traveler's emotional state in real time by analyzing the traveler's facial expressions and tone of voice.

[0839] The "means for optimizing information based on emotional data" is a system that analyzes travelers' emotional data and provides optimal travel information and suggestions based on the results.

[0840] This invention is a system that utilizes a generative AI model to provide appropriate travel information based on the traveler's location information and preferences. Furthermore, by optimizing the content of the information provided using an emotion engine that recognizes the user's emotions, travelers can enjoy their trip comfortably and with peace of mind.

[0841] System configuration

[0842] The system includes the following main components:

[0843] 1. Location information acquisition means

[0844] 2. How to input your preferences and needs

[0845] 3. Real-time information gathering methods

[0846] 4. Information generation method (generative AI model)

[0847] 5. Transportation and Route Calculation

[0848] 6. Means of providing information on culture and customs

[0849] 7. Emotion Engine

[0850] 8. Audio guide and on-screen display

[0851] Location information acquisition means

[0852] The device uses GPS to obtain the traveler's location. For example, if a user launches the app and is at JFK Airport in New York, the device will identify their location. This location information is updated in real time, ensuring the traveler's current location is accurately detected.

[0853] Input method for preferences and needs

[0854] Users input their travel destinations, categories of interest (tourist attractions, restaurants, shopping, etc.), and specific needs (vegetarian options, barrier-free access, etc.) into the device. The input information is saved and used to generate future information. For example, a user may input that they are interested in tourist attractions and food in New York.

[0855] Real-time information gathering means

[0856] The server uses APIs to collect real-time weather information, currency exchange rates, and traffic information from the Internet. This information collection is done periodically, so the latest data is always kept. For example, it can collect the latest weather information and subway operation status for New York.

[0857] Information generation means

[0858] The server uses a generative AI model to generate tourist destination and restaurant information based on the user's preferences and needs. The generative AI model learns from past travel data, local tourist guides, restaurant reviews, etc. For example, it generates information about Central Park and famous steakhouses.

[0859] Transportation and route calculation

[0860] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal taxi route from the airport to the hotel and sends the results to the device.

[0861] Culture and customs information provision method

[0862] The server uses a generative AI model to generate information about the culture and customs of the destination and provides it to the device, such as advice on how to behave on the New York subway and general precautions.

[0863] Emotion Engine

[0864] The device analyzes the user's facial expressions and voice to recognize their emotions. This recognized emotional data is sent to the server and reflected in the information generated. For example, if the user is feeling stressed, that data is sent to the server.

[0865] Audio guide and on-screen display

[0866] The terminal provides the user with information provided by the server through voice and on screen, for example, providing route guidance to the destination through voice and displaying a detailed map on screen.

[0867] Specific examples

[0868] Specifically, consider the case where a user is traveling to New York. When the user launches the app, the device acquires the current location information using GPS. The user inputs into the device their preference to go to New York and their needs, such as interest in sightseeing spots and gourmet food.

[0869] The server then collects New York weather information, the latest exchange rates, and traffic information, and uses this data to select appropriate tourist attractions (e.g., Central Park, Times Square) and restaurants (e.g., famous steakhouses) using a generative AI model.

[0870] Furthermore, the server calculates the optimal transportation method and route (e.g., taxi or subway) from the airport to the accommodation and sends that information to the device, which not only displays this information on the screen but also provides voice guidance to the user.

[0871] The server also generates information about the culture and customs of the destination, such as etiquette and things to be aware of in New York (e.g., how to behave on the subway), and displays this information on the device.

[0872] Additionally, the device uses an emotion engine to recognize the user's emotions and suggests relaxation spots (e.g., quiet parks) or soothing music if the user's stress level is high, or suggests active activities like live shows or sporting events if the user is excited.

[0873] Prompt Sentence Examples

[0874] "We have a traveler currently at JFK Airport in New York who is interested in sightseeing and food. The current weather is sunny and traffic is normal. Please suggest the best sightseeing spots and restaurants, as well as the best route from the airport to their accommodation. Also, please suggest relaxation spots as this traveler's stress level may be high."

[0875] Through the above process, travelers can receive the most appropriate information in real time and enjoy a comfortable and efficient trip.

[0876] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0877] Step 1: User launches the app and gets location information

[0878] Description: When a user launches the app, the device uses GPS to obtain the user's current location.

[0879] Input: User action to launch the app

[0880] Output: GPS data of the user's current location

[0881] Specific operation: The device will automatically display the message "Detecting current location" and activate the GPS sensor to acquire location information, which will be stored in the internal database and used in the next step.

[0882] Step 2: User enters travel preferences and needs

[0883] Description: Users enter their travel destination, interest categories, and specific needs on the app screen.

[0884] Input: Travel destination, interest category, specific needs (e.g., New York, tourist destination, gourmet, vegetarian)

[0885] Output: Data about user preferences and needs

[0886] Specific operation: The user enters "New York" as their destination in the form within the app, selects "tourist destinations" and "food" as their interest categories, and selects "vegetarian-friendly" as their specific need. The input is confirmed by pressing the "Submit" button and sent to the server.

[0887] Step 3: The server collects real-time information

[0888] Description: The server collects real-time weather information, currency exchange rates, and traffic information via API.

[0889] Input: Data about the user's current location and destination

[0890] Output: Real-time weather information, exchange rates, traffic information

[0891] How it works: The server uses an API that is updated every minute to collect information such as the weather in New York (sunny, temperature 25°C), subway operation status (normal), and the latest exchange rate (1 dollar = 110 yen).

[0892] Step 4: The server generates information using the generative AI model

[0893] Description: Uses a generative AI model to generate tourist destination and restaurant information based on user input.

[0894] Input: Data on user preferences and needs, real-time information

[0895] Output: A list of recommended tourist spots and restaurants

[0896] How it works: The server uses a generative AI model to generate recommended locations, such as Central Park and a famous steakhouse, based on past travel data and restaurant reviews. These results are then used in the next step.

[0897] Step 5: Server calculates mode and route

[0898] Description: Calculates the best mode of transportation and route based on the user's current location and destination.

[0899] Input: User's current location and destination data

[0900] Output: Optimal travel modes and route information

[0901] Specific operation: The server considers public transportation and taxi options and calculates and provides route information, such as "A taxi from JFK Airport to your hotel takes 45 minutes and costs approximately $50."

[0902] Step 6: The server provides information about culture and customs

[0903] Description: Provides information about the culture and customs of a destination using generative AI models.

[0904] Input: Destination data

[0905] Output: Information about culture and customs

[0906] Specific behavior: The server generates information about the culture and customs of the destination and provides specific behavioral etiquette, such as "Do not eat food while riding the New York subway."

[0907] Step 7: The device recognizes the user's emotions

[0908] Description: The device uses a camera and microphone to analyze the user's facial expressions and voice to recognize emotions.

[0909] Input: User's facial expression data, voice tone

[0910] Output: User's emotional data (stress level, happiness, interest, etc.)

[0911] Specific operation: The device captures the user's facial expressions and analyzes the audio from the microphone to determine whether the user is feeling stressed.

[0912] Step 8: The server optimizes the information based on the emotional data

[0913] Description: Uses data obtained from the emotion engine to optimize the information provided to the user.

[0914] Input: User emotion data

[0915] Output: Information optimized according to emotions (relaxation spots and activities)

[0916] Specific operation: The server receives data indicating that the user's stress level is high and suggests, for example, a "quiet park" or "comforting music."

[0917] Step 9: The device provides optimized information to the user

[0918] Description: Provides information sent from the server to the user via voice and screen display.

[0919] Input: Optimization information sent from the server

[0920] Output: Present information to the user (audio guide and screen display)

[0921] Specific operation: The device displays detailed maps and tourist information on the screen, and also provides an audio guide, saying, "Next, head to Central Park."

[0922] Through the above processing steps, the user receives optimal information in real time and can proceed with their trip while enjoying it.

[0923] (Application example 2)

[0924] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0925] Travelers have difficulty quickly obtaining information about tourist spots and gourmet food that match their preferences and needs while traveling. Furthermore, it is difficult to create flexible travel plans that accommodate stress and changes in physical condition during travel. Furthermore, there is a lack of suggestions for dining locations that match the traveler's mood. Until now, no system has existed that can solve these issues.

[0926] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring the traveler's location information, means for inputting the traveler's preferences and needs, means for collecting real-time weather information, exchange rate information, and transportation information, means for generating tourist spot and gourmet information based on the traveler's preferences and needs using a generative AI model, means for calculating the optimal means of transportation and route from the traveler's current location to the destination, means for providing information on the culture and customs of the travel destination, means for recognizing the user's emotions and optimizing the information provided, and means for suggesting food and drink in real time. This allows travelers to quickly obtain the optimal tourist spot and gourmet information that suits their emotions and needs at any given time, enabling them to enjoy a comfortable and stress-free trip.

[0927] A "traveler" is an individual traveling to a particular destination and visiting that place for tourism, business, or other purposes.

[0928] "Location information acquisition means" means a device or system that uses GPS or other location-determining technology to determine a traveler's current geographic location.

[0929] A "means for inputting preferences and needs" is an interface through which travelers can input their interests and requests, including, for example, a touchscreen or voice recognition system.

[0930] "Real-time weather information," "exchange rate information," and "means of collecting traffic information" refer to systems for obtaining the latest weather information, currency exchange rates, traffic conditions, etc. via the Internet or API.

[0931] A "generative AI model" is an artificial intelligence model that learns from large datasets and generates appropriate tourist destination and gourmet information based on user input and real-time information.

[0932] "Means for calculating the optimal means of transportation and route from current location to destination" refers to an algorithm or system that calculates and suggests the optimal means of transportation and route when a traveler travels.

[0933] "Means for providing information about the culture and customs of the destination" refers to a system for providing travelers with information about the culture, manners, and customs specific to the region they are visiting.

[0934] "Means for recognizing user emotions and optimizing information provided" refers to technology that recognizes travelers' emotions and mental state and adjusts the travel information and suggestions provided based on that information.

[0935] "Means for suggesting food and drink in real time" refers to a system that suggests appropriate restaurants and menus in real time based on the user's preferences and current situation.

[0936] The system of the present invention provides multiple means for travelers to enjoy a comfortable and stress-free travel experience. Specific components of the system and their operation will now be described.

[0937] System configuration

[0938] 1. Location information acquisition means

[0939] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[0940] 2. How to input your preferences and needs

[0941] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair accessibility, etc.) into the device. After inputting, they press the send button to confirm the settings.

[0942] 3. Real-time information gathering methods

[0943] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[0944] 4. Information generation method using generative AI models

[0945] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs. This AI model learns from past travel data, local tourist guides, restaurant reviews, and more.

[0946] 5. Transportation and Route Calculation

[0947] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal way to use public transportation or the optimal taxi route, and sends the results to the device.

[0948] 6. Means of providing information on culture and customs

[0949] The server uses a generative AI model to provide information about the culture and customs of the destination, such as general etiquette and points of caution for travelers, and displays them on the device.

[0950] 7. Emotion Engine

[0951] The device uses facial expression analysis, voice tone analysis, and other emotion recognition technologies to recognize the user's emotions, which are then sent to a server and fed into a generative AI model.

[0952] 8. Food and beverage suggestion means

[0953] The server will then make real-time recommendations for restaurants and food based on the user's emotional data and preferences, providing options that best suit the user's current mood and situation.

[0954] Processing Description

[0955] Hardware Configuration

[0956] Device: Smartphone, camera, microphone, GPS function

[0957] Server: Database system, AI model operation environment

[0958] Software Configuration

[0959] GPS-linked applications

[0960] API communication function for obtaining real-time information

[0961] Generative AI model (AI model name: Transformer-based Model)

[0962] Emotion engine (emotion analysis software: OpenFace, voice emotion analysis: OpenSMILE)

[0963] Scripts for data analysis and processing (Python-based)

[0964] Specific example explanation

[0965] If a traveler is in New York, the device will use GPS to pinpoint their current location. The user launches the app and inputs their interest in tourist spots and cuisine. The server collects real-time weather, currency exchange rates, and traffic information, and uses a generative AI model to suggest suitable tourist spots and restaurants.

[0966] At the same time, the device's camera and microphone are used to recognize the user's emotions and suggest relaxing cafes and activities based on their emotional state (for example, whether they want to relax or stay active).

[0967] Prompt Sentence Examples

[0968] "Generate a list of cafes that users want to visit when they feel like relaxing."

[0969] This allows users to enjoy activities that best suit their mood and situation at the time, resulting in a highly satisfying travel experience.

[0970] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0971] Step 1: Obtaining the user's location

[0972] Input: The user launches the app.

[0973] Operation: Uses the device's GPS function to obtain the user's current location.

[0974] Output: Current location of the user (latitude and longitude).

[0975] Step 2: Enter your preferences and needs

[0976] Input: The user enters a destination, interest category, or specific need.

[0977] Operation: Data is entered through the user interface and sent to the server.

[0978] Output: Travel destinations, interest categories, specific needs.

[0979] Step 3: Gathering real-time information

[0980] Input: location information, destination data.

[0981] How it works: The server collects weather, currency exchange rates, and traffic information through an API.

[0982] Data processing: The collected data is stored in a database and updated in real time.

[0983] Output: Latest weather information, exchange rate information, traffic information.

[0984] Step 4: Generate information using a generative AI model

[0985] Input: User location, preferences and needs, real-time information.

[0986] How it works: Using a generative AI model, it generates information about tourist spots and restaurants based on the user's preferences and needs.

[0987] Data calculations: Generate optimal suggestions based on past travel data, local tourist guides, and restaurant reviews.

[0988] Output: List of tourist attractions, list of restaurants.

[0989] Step 5: Calculate travel modes and routes

[0990] Input: User's current location, destination, real-time information.

[0991] How it works: The server uses a route calculation algorithm to calculate the optimal mode of transportation and route.

[0992] Data calculation: Consider public transport timetables and route information, as well as taxi route information.

[0993] Output: Optimal travel modes and route information.

[0994] Step 6: Providing information about culture and customs

[0995] Input: Destination data.

[0996] How it works: Generative AI models are used to generate cultural and custom information about a destination.

[0997] Data processing: Collecting and analyzing information about local culture, manners, and customs.

[0998] Output: Information about culture and customs.

[0999] Step 7: Emotion Recognition

[1000] Input: User's facial expression data, voice data.

[1001] How it works: Recognizes the user's emotions using the device's camera and microphone.

[1002] Data calculation: Facial expression analysis and voice tone analysis are performed to generate emotion data.

[1003] Output: User's emotional data (stress level, happiness, etc.).

[1004] Step 8: Optimize information delivery

[1005] Input: Emotion data, information from generative AI models.

[1006] How it works: The server adjusts the priority and content of information taking into account emotional data.

[1007] Data calculation: If stress levels are high, a relaxation spot is recommended, and if you are excited, an active activity is recommended.

[1008] Output: Optimized proposal information.

[1009] Step 9: Real-time food and drink suggestions

[1010] Input: Emotional data, user preferences and needs.

[1011] How it works: The server suggests the best restaurants and food options based on your emotional data and preferences.

[1012] Data calculations: Analyze real-time restaurant information and reviews.

[1013] Output: A list of suggested restaurants and food options.

[1014] Through the above processing steps, the user can quickly obtain information on tourist spots and gourmet food that best suits their feelings and needs at the time, allowing them to enjoy a comfortable and stress-free trip.

[1015] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1016] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1017] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1018] [Third embodiment]

[1019] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1020] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1021] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1022] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1023] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1024] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1025] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1026] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1027] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1028] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1029] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1030] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1031] This invention is a system that utilizes generative AI models to provide appropriate travel information based on a traveler's location information and needs. This system helps travelers quickly and accurately obtain local information and smoothly select transportation methods.

[1032] System configuration

[1033] The system includes the following main components:

[1034] 1. Location information acquisition means

[1035] 2. How to input your preferences and needs

[1036] 3. Real-time information gathering methods

[1037] 4. Information generation method using generative AI models

[1038] 5. Transportation and Route Calculation

[1039] 6. Means of providing information on culture and customs

[1040] 7. Audio guide and on-screen display

[1041] Specific operation of each element

[1042] Location information acquisition means

[1043] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[1044] Input method for preferences and needs

[1045] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.) into the terminal, and the system then provides personalized information based on the user's requests.

[1046] Real-time information gathering means

[1047] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[1048] Information generation method using generative AI models

[1049] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs. This AI model learns from past travel data, local tourist guides, restaurant reviews, and more.

[1050] Transportation and route calculation

[1051] The server calculates the optimal means of transportation and route based on the user's current location and destination, for example, calculating the optimal method of using public transportation or the optimal taxi route, and sends the results to the device.

[1052] Culture and customs information provision method

[1053] The server uses a generative AI model to provide information about the culture and customs of the destination, such as general etiquette and points of caution for travelers, and displays them on the device.

[1054] Audio guide and on-screen display

[1055] The device provides the collected information and generated guides to the user via voice and on-screen display, for example, providing route guidance to the destination via voice and displaying a detailed map on the screen.

[1056] Specific examples

[1057] Specifically, consider a user traveling to Tokyo. When the user launches the app, the device uses GPS to obtain the user's current location. The user inputs into the device their preference to go to Tokyo and their interest in sightseeing spots and gourmet food.

[1058] Next, the server collects Tokyo weather information, the latest exchange rates, and traffic information, and uses this data to create a generative AI model to select appropriate tourist spots (e.g., Sensoji Temple, Skytree) and restaurants (e.g., famous sushi restaurants).

[1059] The server then calculates the optimal transportation method and route (e.g., limousine bus or train) from the airport to the hotel and sends that information to the device, which then displays the information on the screen and provides voice guidance to the user.

[1060] The server also generates information about the culture and customs of the destination, such as public manners and precautions in Tokyo (e.g., refrain from using mobile phones on trains), and displays it on the device, allowing users to take prompt and appropriate action during their trip.

[1061] As described above, by implementing the system of the present invention, travelers can enjoy a more comfortable and efficient travel experience. In addition, by providing real-time information, it is possible to flexibly respond to changes in travel plans and unexpected situations.

[1062] The processing flow will be explained below.

[1063] Step 1:

[1064] The user launches the app. When the app launches, a message appears requesting permission to use location information.

[1065] Step 2:

[1066] If the device receives permission from the user to use location information, it uses the GPS function to obtain the user's current location and sends the obtained latitude and longitude data to the app.

[1067] Step 3:

[1068] The user fills in the app's input form with their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.), then presses the submit button to confirm the settings.

[1069] Step 4:

[1070] The device sends the user's input information to the server, along with the user's location information.

[1071] Step 5:

[1072] Based on the received user information, the server collects real-time weather, exchange rate, and traffic information through related API services, and stores the collected information in a database.

[1073] Step 6:

[1074] The server uses the generative AI model to generate tourist and gourmet information based on the user's preferences and needs, and the generated information is then stored in an organized database.

[1075] Step 7:

[1076] The server calculates the optimal means of transportation and route from the user's current location to the destination, including how to use public transportation and taxis, and route information.

[1077] Step 8:

[1078] The server collects information from relevant databases and websites and compiles it using a generative AI model to generate information about the culture and customs of the destination.

[1079] Step 9:

[1080] The server then sends the generated information on tourist spots, gourmet food, transportation options and routes, and culture and customs to the device. The information sent is customized according to the user's request.

[1081] Step 10:

[1082] The device displays the received information on its screen, including photos and descriptions of tourist attractions, restaurant menus and ratings, and maps of transportation routes. If audio guidance is enabled, the information is also provided aloud.

[1083] Step 11:

[1084] Based on the displayed information, users can begin to plan their trip in detail. If necessary, they can refer to the displayed route to head to their destination. This allows users to enjoy their trip efficiently and with peace of mind.

[1085] Example 1

[1086] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1087] Conventional travel information systems lack the ability to provide personalized information based on users' location information and individual needs, and have difficulty providing real-time information quickly and accurately. As a result, travelers often struggle to find information about appropriate transportation methods and the culture and customs of their destinations, resulting in an inconvenient travel experience.

[1088] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1089] In this invention, the server includes means for collecting real-time weather information, exchange rate information, and traffic information from the Internet via API, means for generating tourist spot and gourmet information based on past data and local information using a generative AI model, and means for providing information on the culture and customs of the travel destination using the generative AI model, thereby enabling travelers to quickly and accurately obtain personalized information in real time.

[1090] A "terminal" is a device used by a traveler, such as a portable information terminal or smartphone, to obtain the traveler's current location and display necessary information.

[1091] "GPS" is an abbreviation for Global Positioning System, a technology that allows devices to receive and accurately measure their location on Earth from satellites.

[1092] "User" refers to the traveler who uses the system, and is the entity that inputs information into and operates the system.

[1093] "API" stands for Application Programming Interface, a means by which different software systems communicate with each other and exchange information.

[1094] "Real-time information" refers to information that is up to date at the present time, and includes, for example, weather information and traffic information.

[1095] A "generative AI model" is a model that uses artificial intelligence technology to recognize patterns and generate new information based on input data.

[1096] "Tourist destinations" refer to places and attractions that are popular destinations for tourists.

[1097] "Gourmet information" refers to information about restaurants and cuisine in the areas that travelers visit.

[1098] "Transportation" refers to the means of transportation that travelers use to travel from their current location to their destination, including public transportation and taxis.

[1099] A "route" refers to the path or route a traveler takes to get from their current location to their destination.

[1100] "Cultural and customs information" refers to information about the local culture, social customs, and behavioral norms at the travel destination.

[1101] "Audio guide" refers to a function that provides information and guidance to the user through audio.

[1102] "Screen display" refers to the function of visually displaying information on the device's display.

[1103] "Means" refers to the method or device used by the system to perform a particular function or operation.

[1104] The system utilizes a generative AI model based on the traveler's location and needs to provide appropriate travel information. An embodiment of the system is described in detail below.

[1105] System Components

[1106] The following major hardware and software are used to implement the system:

[1107] 1. Terminal: A mobile information terminal or smartphone used by a traveler. It has a GPS function and acquires location information and communicates between the user and the server.

[1108] 2. Server: A computing device located in the cloud that collects real-time information from the internet via APIs and generates and processes that information using generative AI models.

[1109] 3. Generative AI model: An artificial intelligence model that learns from past travel data and local information. For example, it uses large-scale language models (such as the GPT series).

[1110] 4. Internet: A communication network for obtaining real-time information (weather information, exchange rate information, traffic information) through APIs.

[1111] How it works

[1112] Location information acquisition

[1113] When a traveler launches the app, the device automatically obtains their current location using its built-in GPS function, and the obtained location information is sent to the server.

[1114] Input your preferences and needs

[1115] Users input their travel destinations, categories of interest (tourist spots, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.) into their devices. This input information is sent to the server.

[1116] Real-time information gathering

[1117] The server retrieves real-time weather, exchange rate, and traffic information from the Internet via multiple APIs, ensuring that the latest data is always available.

[1118] Information generation and provision

[1119] The server uses a generative AI model based on the user's preferences and needs to generate information about tourist spots and gourmet food. The generative AI model learns from past travel data and guide information, allowing it to provide the user with the most appropriate information.

[1120] For example, the following prompt sentence is input into the generative AI model: "The user is traveling to Tokyo and is interested in tourist spots and gourmet food. Please collect weather information, the latest exchange rates, and traffic information for Tokyo, and suggest suitable tourist spots and restaurants. In addition, please calculate the optimal means of transportation and route from the airport to the accommodation, and also provide information on public manners and things to be careful of in Tokyo."

[1121] Transportation and route calculation

[1122] The server calculates the optimal transportation method (e.g., public transportation, taxi) and route based on the user's current location and destination, and sends the calculation results to the device.

[1123] Providing information on culture and customs

[1124] The server uses a generative AI model to generate information about the culture and customs of the destination and provides it to the user as a guide for their travels.

[1125] Audio guide and on-screen display

[1126] The terminal displays the information sent from the server on its screen and provides audio guidance as needed, allowing users to receive easy-to-understand guidance both visually and audibly.

[1127] Specific operation example

[1128] For example, consider a user traveling to Tokyo. When the traveler launches the app, the device retrieves their current location information. Next, the user enters "Tokyo" as their destination, selects "tourist destinations" and "food" as categories of interest, and also enters "vegetarian-friendly" as a need. Based on this, the server collects real-time weather, exchange rates, and traffic information, uses a generative AI model to generate appropriate tourist destination and food information, calculates transportation methods and routes, and provides information on culture and customs. Finally, the device provides this information to the user via screen display and audio guidance.

[1129] By implementing the present invention in this way, travelers can obtain necessary information in real time and enjoy an efficient and comfortable trip.

[1130] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1131] Step 1:

[1132] (Location information acquisition)

[1133] When a traveler launches the app, the device automatically acquires the current location information using the built-in GPS function. The acquired location information (input) is sent to the server (output). This allows the server to grasp the traveler's current location.

[1134] Specific operation: The user launches the app and taps "Check current location." The device activates the GPS and sends the coordinate data (latitude and longitude) of the current location (e.g., Tokyo Station) to the server.

[1135] Step 2:

[1136] (Enter your preferences and needs)

[1137] Users input their travel destinations, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.) into their devices (input). This information is then sent from the device to the server (output).

[1138] Specific operation: The user enters "Tokyo" as the destination. On the category selection screen, select "Tourist Destinations" and "Gourmet." If necessary, check "Vegetarian Friendly."

[1139] Step 3:

[1140] (Real-time information gathering)

[1141] The server obtains real-time weather, exchange rate, and traffic information from the Internet via multiple APIs (input), which provides the latest data (output).

[1142] Specific operation: The server calls the Open Weather Map API to get the latest weather information for Tokyo, uses the Exchange Rate API to get the latest exchange rates, and uses the Traffic Information API to get real-time traffic information for Tokyo.

[1143] Step 4:

[1144] (Information generation using generative AI models)

[1145] The server inputs prompts into the generative AI model based on the user's preferences and needs (input), and generates tourist destination and gourmet information (output). The generative AI model learns from past travel data and guide information, and provides the user with the most appropriate information.

[1146] Specific operation: The server generates a prompt sentence: "The user is traveling to Tokyo and is interested in tourist spots and gourmet food. Please collect Tokyo weather information, the latest exchange rates, and traffic information, and suggest suitable tourist spots and restaurants." This prompt sentence is input into a generative AI model (e.g., GPT-4) to generate tourist spot and gourmet information.

[1147] Step 5:

[1148] (Transportation and route calculation)

[1149] The server calculates the optimal means of transportation (e.g., public transportation, taxi) and route based on the user's current location and destination (input). The optimal route information is obtained as a result of the calculation (output).

[1150] Specific operation: The server uses the Google Maps API to calculate the optimal public transportation route from Tokyo Station to Sensoji Temple, and generates detailed directions such as "Get on at Tokyo Station and take the Ginza Line to Asakusa Station."

[1151] Step 6:

[1152] (Providing information on culture and customs)

[1153] The server uses a generative AI model to generate information about the culture and customs of the travel destination (input), and the obtained information is sent from the server to the device (output).

[1154] Specific operation: The server generates a prompt sentence, "Please tell me about public manners and things to be careful about in Tokyo." This is input into the generative AI model, which generates information about things to be careful about and manners in Tokyo. The generated information is added to the response data.

[1155] Step 7:

[1156] (Audio guide and on-screen display)

[1157] The terminal provides the information received from the server to the user by displaying it on the screen and by voice (output).

[1158] Specific operation: The device displays the received tourist spots, gourmet information, route guidance, and cultural information on the app's UI. When the user taps on route guidance, the voice assistant will say, "Take the Ginza Line from Tokyo Station to Asakusa Station."

[1159] (Application example 1)

[1160] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1161] Travelers need a lot of information when they travel, such as choosing tourist attractions and restaurants, understanding the culture and customs, and choosing the best means of transportation. Information about specific travel needs (e.g., wheelchair accessibility or vegetarian options) is also important, but providing this information in real time is difficult. Furthermore, if the information provided is insufficient or inappropriate, the traveler's experience may be compromised. Therefore, to ensure travelers can enjoy their trip smoothly, a system is needed that provides real-time information based on their preferences and needs, as well as guidance on transportation and routes.

[1162] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1163] In this invention, the server includes means for acquiring the traveler's location information, means for inputting the traveler's preferences and needs, means for collecting real-time weather information, exchange rate information, and traffic information, means for generating tourist spot and restaurant information based on the traveler's preferences and needs using a generative AI model, means for calculating the optimal means of transportation and route from the traveler's current location to the destination, means for providing the generated tourist spot and restaurant information and travel route by voice guidance and on-screen display, and means for providing information on the culture and customs of the travel destination. This allows travelers to obtain more specific and personalized travel information in real time, enabling a comfortable and efficient travel experience.

[1164] "Location information" is data that indicates the traveler's current geographical location. It is mainly obtained using the GPS (Global Positioning System) function.

[1165] "Preferences and needs" refers to the personal interests and requirements that travelers want to fulfill during their trip, such as "tourist attractions," "food," and "wheelchair access."

[1166] "Real-time information" refers to the latest data available at the present time, including weather information, exchange rate information, traffic information, and so on.

[1167] "Weather Information" means data about current and future weather conditions at a destination, including temperature, precipitation, wind speed, etc.

[1168] "Exchange Rate Information" is up-to-date data on the exchange rates between different currencies, which helps travelers when exchanging currencies.

[1169] "Traffic information" refers to current information about public transportation and roads, including traffic congestion information, accident information, and operation status.

[1170] A "generative AI model" is a program that uses artificial intelligence to analyze data and generate information for a specific task.

[1171] "Tourist destinations" are places or facilities that tourists visit, including famous places, ruins, and natural parks.

[1172] "Restaurant information" is data about places where travelers can eat, including restaurants, cafes, food stands, etc.

[1173] "Transportation" refers to the means of transportation a traveler uses to travel from their current location to their destination, including walking, public transportation, and driving.

[1174] A "route" refers to the path a traveler takes from their current location to their destination, taking into account the shortest distance and the most optimal route.

[1175] "Audio guidance" is a method of providing specific information or instructions to travelers by voice, thereby providing information without relying on vision.

[1176] "Screen display" refers to a method of displaying information on the display of a traveler's device, allowing the information to be visually confirmed.

[1177] "Culture and customs" refers to the traditional ways of behavior and manners of a particular region or country. They serve as a guide for travelers on how to behave appropriately in that area.

[1178] This invention is a system that utilizes generative AI models to provide appropriate tourist destination and restaurant information based on travelers' location information and needs. The system helps travelers quickly and accurately obtain local information and select the best mode of transportation.

[1179] System configuration

[1180] The system has the following main components:

[1181] 1. Location information acquisition means

[1182] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[1183] 2. How to input your preferences and needs

[1184] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (wheelchair access, etc.) into the terminal, and the system then provides personalized information based on the user's requests.

[1185] 3. Real-time information gathering methods

[1186] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[1187] 4. Information generation method using generative AI models

[1188] The server generates tourist destination and restaurant information based on the user's preferences and needs using a generative AI model that learns from past travel data, local tourist guides, restaurant reviews, and more.

[1189] 5. Transportation and Route Calculation

[1190] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal method of using public transportation or the optimal taxi route, and sends the results to the device.

[1191] 6. Voice guidance and screen display means for generated information

[1192] The terminal provides the generated tourist spot and restaurant information and travel routes through voice guidance and on-screen display, allowing travelers to obtain information both visually and audibly.

[1193] 7. Means of providing information on culture and customs

[1194] The server uses generative AI models to provide information about the culture and customs of the travel destination, which users can view on screen and through voice guidance.

[1195] Processing Description

[1196] The server and device work together to perform the following process. First, the device obtains the user's location information and sends it to the server. Next, the user's preferences and needs information is also sent to the server. Based on this information, the server collects real-time information from the API. The generative AI model uses this data to generate optimal tourist destination and restaurant information for the user, and provides this information via voice guidance and on-screen display.

[1197] Specific examples

[1198] For example, consider a user traveling to Tokyo. When the user launches the app, the device uses GPS to obtain their current location. The user inputs their preference for visiting Tokyo and their interest in tourist spots and cuisine into the device. The server then collects Tokyo weather information, the latest exchange rates, and traffic information. Based on this data, the server uses a generative AI model to select appropriate tourist spots (e.g., Sensoji Temple, observation decks) and restaurants (e.g., famous sushi restaurants). The server calculates the optimal transportation method and route from the airport to the accommodation and sends this information to the device. The device displays this information on the screen and provides audio guidance to the user. The server also generates information about the culture and customs of the destination, such as public etiquette and precautions in Tokyo (e.g., refraining from using cell phones on trains), and displays this information on the device. This allows the user to take prompt and appropriate action during their trip.

[1199] Example prompt sentence:

[1200] The user's current location is Tokyo. Please suggest the best tourist spots and restaurants based on the following information:

[1201] Category: ["Tourist attractions", "Gourmet"]

[1202] Special Needs: ["Wheelchair accessible"]

[1203] Weather information: [Weather information data]

[1204] Exchange Rate: [Exchange Rate Data]

[1205] Traffic Information: [Traffic Information Data]

[1206] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1207] Step 1:

[1208] The device acquires the traveler's location information

[1209] Input: When a traveler launches the app, the device's GPS function is activated.

[1210] Data processing: Determine current latitude and longitude using GPS.

[1211] Output: The obtained location information is sent to the server.

[1212] Step 2:

[1213] Users input their preferences and needs into the device

[1214] Input: The user uses the app's interface to input their destination, interest categories, and specific needs (e.g., wheelchair accessibility).

[1215] Data processing: The entered information is saved as digital data.

[1216] Output: Preferences and needs information is sent to the server.

[1217] Step 3:

[1218] The server collects real-time information

[1219] Input: Location information and user preferences and needs information are received by the server.

[1220] Data processing: Use API to obtain weather information, exchange rate information, and traffic information.

[1221] Output: All real-time information is stored and updated in the server.

[1222] Step 4:

[1223] The server generates information using the generative AI model

[1224] Input: User preferences, needs and real-time information are stored in a database on the server.

[1225] Data processing: A generative AI model analyzes this data and creates a prompt. Example prompt: "The user's current location is Tokyo. Please suggest the best tourist spots and restaurants based on the following information: Category: ['Tourist Spot', 'Gourmet'], Special Needs: ['Wheelchair Accessible'], Weather Information: [Weather Information Data], Exchange Rates: [Exchange Rate Data], Traffic Information: [Traffic Information Data]."

[1226] Output: The generative AI model generates information about tourist spots and restaurants.

[1227] Step 5:

[1228] The server calculates the optimal means of transportation and route

[1229] Input: The latitude and longitude information of the current location and destination, as well as traffic information, are entered into the server.

[1230] Data processing: Using map APIs and traffic APIs, we calculate the optimal means of transportation and routes based on distance and traffic conditions.

[1231] Output: Trip and route information is calculated and sent to the device.

[1232] Step 6:

[1233] The device provides information through voice guidance and on-screen display

[1234] Input: Information on tourist spots and restaurants, transportation methods and routes, and culture and customs information sent from the server is received by the device.

[1235] Data processing: Maps and text information are displayed on the terminal screen, and voice guidance is generated using a speech synthesis engine.

[1236] Output: Information is presented to the user visually and audibly.

[1237] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1238] This invention utilizes a generative AI model to provide appropriate travel information based on a traveler's location information and preferences, and also optimizes the content of the information provided using an emotion engine that recognizes the user's emotions, allowing travelers to enjoy their trips in comfort and peace of mind.

[1239] System configuration

[1240] The system includes the following main components:

[1241] 1. Location information acquisition means

[1242] 2. How to input your preferences and needs

[1243] 3. Real-time information gathering methods

[1244] 4. Information generation method using generative AI models

[1245] 5. Transportation and Route Calculation

[1246] 6. Means of providing information on culture and customs

[1247] 7. Emotion Engine

[1248] 8. Audio guide and on-screen display

[1249] Specific operation of each element

[1250] Location information acquisition means

[1251] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[1252] Input method for preferences and needs

[1253] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair accessibility, etc.) into the device. After inputting, they press the send button to confirm the settings.

[1254] Real-time information gathering means

[1255] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[1256] Information generation method using generative AI models

[1257] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs. This AI model learns from past travel data, local tourist guides, restaurant reviews, and more.

[1258] Transportation and route calculation

[1259] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal way to use public transportation or the optimal taxi route, and sends the results to the device.

[1260] Culture and customs information provision method

[1261] The server uses a generative AI model to provide information about the culture and customs of the destination, such as general etiquette and points of caution for travelers, and displays them on the device.

[1262] Emotion Engine

[1263] The device uses facial expression analysis, voice tone analysis, and other emotion recognition technologies to recognize the user's emotions, which are then sent to a server and fed into a generative AI model.

[1264] Audio guide and on-screen display

[1265] The device provides the collected information and generated guides to the user by voice and on-screen display, for example, providing route guidance to the destination by voice and displaying a detailed map on-screen.

[1266] Emotion engine operation

[1267] User Emotion Recognition

[1268] The device uses a camera and microphone to analyze the user's facial expressions and voice, recognizing emotions in real time, which are then converted into parameters such as stress level, happiness, and interest.

[1269] Information Optimization

[1270] The server uses the emotional data obtained from the emotion engine to optimize the information provided to the user. For example, if the user is feeling stressed, it will suggest relaxation spots and quiet tourist spots. If the user is excited, it will suggest active activities and events.

[1271] Specific examples

[1272] Specifically, consider a user traveling to New York. When the user launches the app, the device acquires the user's current location using GPS. The user inputs into the device their preference to go to New York and their needs, such as interest in sightseeing spots and gourmet food.

[1273] Next, the server collects New York weather information, the latest exchange rates, and traffic information, and uses this data to create a generative AI model to select appropriate tourist spots (e.g., Central Park, Times Square) and restaurants (e.g., famous steakhouses).

[1274] The server then calculates the optimal transportation method and route (e.g., taxi or subway) from the airport to the hotel and sends that information to the device, which then displays the information on the screen and provides voice guidance to the user.

[1275] The server also generates information about the culture and customs of the destination, such as public manners and things to be aware of in New York (e.g., how to behave on the subway), and displays this information on the device.

[1276] Additionally, the device utilizes an emotion engine to recognize the user's emotions and suggest relaxation spots (e.g., quiet parks) and soothing music if the user's stress level is high, or suggest active activities (e.g., live shows or sporting events) if the user is excited, ensuring the user enjoys an optimal travel experience.

[1277] As described above, by implementing the system of the present invention, travelers can enjoy a more comfortable and efficient travel experience. In addition, real-time information provision and emotion recognition enable the system to flexibly respond to changes in travel plans and unexpected situations.

[1278] The processing flow will be explained below.

[1279] Step 1:

[1280] The user launches the app. When the app launches, a message appears requesting permission to use location information.

[1281] Step 2:

[1282] If the device receives permission from the user to use location information, it will use the GPS function to obtain the user's current location and pass the obtained latitude and longitude data to the app.

[1283] Step 3:

[1284] The user fills in the app's input form with their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.), then presses the submit button to confirm the settings.

[1285] Step 4:

[1286] The device sends the user's input information to the server, along with the user's location information.

[1287] Step 5:

[1288] The server collects real-time weather, exchange rate, and traffic information through various APIs based on the received user information, and stores the collected information in a database.

[1289] Step 6:

[1290] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs, and the generated information is stored in an organized database.

[1291] Step 7:

[1292] The server calculates the optimal means of transportation and route from the user's current location to the destination, including how to use public transportation and taxis, as well as route information.

[1293] Step 8:

[1294] The server collects information from relevant databases and websites and compiles it using a generative AI model to generate information about the culture and customs of the destination.

[1295] Step 9:

[1296] The device analyzes the user's facial expressions and voice through a camera and microphone, and generates emotional data using an emotion engine. This data is then sent to a server.

[1297] Step 10:

[1298] The server analyzes the emotional data and optimizes the information provided based on the user's stress level and happiness level. For example, if stress is high, it will recommend relaxation spots, and if excited, it will suggest active activities.

[1299] Step 11:

[1300] The server then sends the generated information on tourist spots, gourmet food, transportation options and routes, and culture and customs to the device. The information is customized according to the user's emotional data.

[1301] Step 12:

[1302] The device displays the received information on its screen, including photos and descriptions of tourist attractions, restaurant menus and ratings, and maps of transportation routes. If audio guidance is enabled, the information is also provided aloud.

[1303] Step 13:

[1304] Users can use the displayed information to plan their trip in detail, and if necessary, refer to the displayed route to head to their destination. This allows users to enjoy their trip efficiently and with peace of mind.

[1305] Specific examples

[1306] For example, if a user travels to New York:

[1307] In step 1, the user launches the app and grants permission to use location information.

[1308] In step 2, the device obtains its location in New York.

[1309] In step 3, the user enters that they are interested in tourist spots and gourmet food.

[1310] In step 4, the terminal sends the input information to the server.

[1311] In step 5, the server collects weather information, exchange rate information, and traffic information.

[1312] In step 6, the server uses the generative AI model to generate information about tourist attractions (Central Park, Times Square) and restaurants.

[1313] In step 7, the server calculates the optimal mode of transportation and route.

[1314] In step 8, the server generates information about New York's culture and customs.

[1315] In step 9, the device analyzes facial expressions and voice, generates emotional data, and sends it to the server.

[1316] In step 10, the server optimizes the information based on the emotion data.

[1317] In step 11, the server sends the generated information to the terminal.

[1318] In step 12, the terminal displays the information on the screen and provides voice guidance.

[1319] In step 13, the user finalizes their travel plans based on the information and enjoys their trip with peace of mind.

[1320] As described above, the present invention is a system that supports a comfortable travel experience by taking into account the emotional data of travelers and providing information optimized for each individual user.

[1321] Example 2

[1322] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1323] Modern travelers make travel plans based on diverse needs and preferences, but these plans often need to be changed, requiring real-time information provision. Furthermore, a lack of flexible support based on travelers' emotional states makes it difficult to provide a comfortable and secure travel experience. Therefore, a system that provides optimal travel information based on travelers' location information, preferences, real-time environmental information, and emotional state is needed.

[1324] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1325] In this invention, the server includes means for acquiring location information, means for inputting traveler preferences and needs, means for collecting real-time weather information, exchange rate information, and traffic information, means for generating tourist spot and restaurant information based on traveler preferences and needs using a generative model, means for calculating the optimal means of transportation and route from the traveler's current location to the destination, means for providing information on the culture and customs of the destination, means for emotion recognition, and means for optimizing information based on emotion data. This allows travelers to receive optimal information in real time and enables flexible adjustment of travel plans according to their emotional state.

[1326] "Means for obtaining location information" refers to a system that uses GPS functions and communication networks to identify a traveler's current location.

[1327] "Means for inputting traveler preferences and needs" refers to an interface that allows travelers to input their desired destinations, categories of interest, special requirements, etc.

[1328] "Means of collecting real-time weather information, exchange rate information, and traffic information" refers to a system that regularly obtains information such as the latest weather, currency fluctuations, and traffic conditions through external information providers and APIs.

[1329] "Means for generating tourist destination and restaurant information based on travelers' preferences and needs using generative models" refers to a system that uses artificial intelligence technology and machine learning algorithms to suggest optimal tourist destinations and restaurants based on travelers' input information.

[1330] "A means for calculating the optimal means of transportation and route from a traveler's current location to their destination" is a system that calculates and suggests the optimal means of transportation, such as public transportation or taxi, and route based on the traveler's current location and destination.

[1331] "A means of providing information on the culture and customs of a destination" is a system that provides travelers with a summary of the cultural manners, customs, and precautions of the destination.

[1332] The "means for emotion recognition" is a system that recognizes a traveler's emotional state in real time by analyzing the traveler's facial expressions and tone of voice.

[1333] The "means for optimizing information based on emotional data" is a system that analyzes travelers' emotional data and provides optimal travel information and suggestions based on the results.

[1334] This invention is a system that utilizes a generative AI model to provide appropriate travel information based on the traveler's location information and preferences. Furthermore, by optimizing the content of the information provided using an emotion engine that recognizes the user's emotions, travelers can enjoy their trip comfortably and with peace of mind.

[1335] System configuration

[1336] The system includes the following main components:

[1337] 1. Location information acquisition means

[1338] 2. How to input your preferences and needs

[1339] 3. Real-time information gathering methods

[1340] 4. Information generation method (generative AI model)

[1341] 5. Transportation and Route Calculation

[1342] 6. Means of providing information on culture and customs

[1343] 7. Emotion Engine

[1344] 8. Audio guide and on-screen display

[1345] Location information acquisition means

[1346] The device uses GPS to obtain the traveler's location. For example, if a user launches the app and is at JFK Airport in New York, the device will identify their location. This location information is updated in real time, ensuring the traveler's current location is accurately detected.

[1347] Input method for preferences and needs

[1348] Users input their travel destinations, categories of interest (tourist attractions, restaurants, shopping, etc.), and specific needs (vegetarian options, barrier-free access, etc.) into the device. The input information is saved and used to generate future information. For example, a user may input that they are interested in tourist attractions and food in New York.

[1349] Real-time information gathering means

[1350] The server uses APIs to collect real-time weather information, currency exchange rates, and traffic information from the Internet. This information collection is done periodically, so the latest data is always kept. For example, it can collect the latest weather information and subway operation status for New York.

[1351] Information generation means

[1352] The server uses a generative AI model to generate tourist destination and restaurant information based on the user's preferences and needs. The generative AI model learns from past travel data, local tourist guides, restaurant reviews, etc. For example, it generates information about Central Park and famous steakhouses.

[1353] Transportation and route calculation

[1354] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal taxi route from the airport to the hotel and sends the results to the device.

[1355] Culture and customs information provision method

[1356] The server uses a generative AI model to generate information about the culture and customs of the destination and provides it to the device, such as advice on how to behave on the New York subway and general precautions.

[1357] Emotion Engine

[1358] The device analyzes the user's facial expressions and voice to recognize their emotions. This recognized emotional data is sent to the server and reflected in the information generated. For example, if the user is feeling stressed, that data is sent to the server.

[1359] Audio guide and on-screen display

[1360] The terminal provides the user with information provided by the server through voice and on screen, for example, providing route guidance to the destination through voice and displaying a detailed map on screen.

[1361] Specific examples

[1362] Specifically, consider the case where a user is traveling to New York. When the user launches the app, the device acquires the current location information using GPS. The user inputs into the device their preference to go to New York and their needs, such as interest in sightseeing spots and gourmet food.

[1363] The server then collects New York weather information, the latest exchange rates, and traffic information, and uses this data to select appropriate tourist attractions (e.g., Central Park, Times Square) and restaurants (e.g., famous steakhouses) using a generative AI model.

[1364] Furthermore, the server calculates the optimal transportation method and route (e.g., taxi or subway) from the airport to the accommodation and sends that information to the device, which not only displays this information on the screen but also provides voice guidance to the user.

[1365] The server also generates information about the culture and customs of the destination, such as etiquette and things to be aware of in New York (e.g., how to behave on the subway), and displays this information on the device.

[1366] Additionally, the device uses an emotion engine to recognize the user's emotions and suggests relaxation spots (e.g., quiet parks) or soothing music if the user's stress level is high, or suggests active activities like live shows or sporting events if the user is excited.

[1367] Prompt Sentence Examples

[1368] "We have a traveler currently at JFK Airport in New York who is interested in sightseeing and food. The current weather is sunny and traffic is normal. Please suggest the best sightseeing spots and restaurants, as well as the best route from the airport to their accommodation. Also, please suggest relaxation spots as this traveler's stress level may be high."

[1369] Through the above process, travelers can receive the most appropriate information in real time and enjoy a comfortable and efficient trip.

[1370] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1371] Step 1: User launches the app and gets location information

[1372] Description: When a user launches the app, the device uses GPS to obtain the user's current location.

[1373] Input: User action to launch the app

[1374] Output: GPS data of the user's current location

[1375] Specific operation: The device will automatically display the message "Detecting current location" and activate the GPS sensor to acquire location information, which will be stored in the internal database and used in the next step.

[1376] Step 2: User enters travel preferences and needs

[1377] Description: Users enter their travel destination, interest categories, and specific needs on the app screen.

[1378] Input: Travel destination, interest category, specific needs (e.g., New York, tourist destination, gourmet, vegetarian)

[1379] Output: Data about user preferences and needs

[1380] Specific operation: The user enters "New York" as their destination in the form within the app, selects "tourist destinations" and "food" as their interest categories, and selects "vegetarian-friendly" as their specific need. The input is confirmed by pressing the "Submit" button and sent to the server.

[1381] Step 3: The server collects real-time information

[1382] Description: The server collects real-time weather information, currency exchange rates, and traffic information via API.

[1383] Input: Data about the user's current location and destination

[1384] Output: Real-time weather information, exchange rates, traffic information

[1385] How it works: The server uses an API that is updated every minute to collect information such as the weather in New York (sunny, temperature 25°C), subway operation status (normal), and the latest exchange rate (1 dollar = 110 yen).

[1386] Step 4: The server generates information using the generative AI model

[1387] Description: Uses a generative AI model to generate tourist destination and restaurant information based on user input.

[1388] Input: Data on user preferences and needs, real-time information

[1389] Output: A list of recommended tourist spots and restaurants

[1390] How it works: The server uses a generative AI model to generate recommended locations, such as Central Park and a famous steakhouse, based on past travel data and restaurant reviews. These results are then used in the next step.

[1391] Step 5: Server calculates mode and route

[1392] Description: Calculates the best mode of transportation and route based on the user's current location and destination.

[1393] Input: User's current location and destination data

[1394] Output: Optimal travel modes and route information

[1395] Specific operation: The server considers public transportation and taxi options and calculates and provides route information, such as "A taxi from JFK Airport to your hotel takes 45 minutes and costs approximately $50."

[1396] Step 6: The server provides information about culture and customs

[1397] Description: Provides information about the culture and customs of a destination using generative AI models.

[1398] Input: Destination data

[1399] Output: Information about culture and customs

[1400] Specific behavior: The server generates information about the culture and customs of the destination and provides specific behavioral etiquette, such as "Do not eat food while riding the New York subway."

[1401] Step 7: The device recognizes the user's emotions

[1402] Description: The device uses a camera and microphone to analyze the user's facial expressions and voice to recognize emotions.

[1403] Input: User's facial expression data, voice tone

[1404] Output: User's emotional data (stress level, happiness, interest, etc.)

[1405] Specific operation: The device captures the user's facial expressions and analyzes the audio from the microphone to determine whether the user is feeling stressed.

[1406] Step 8: The server optimizes the information based on the emotional data

[1407] Description: Uses data obtained from the emotion engine to optimize the information provided to the user.

[1408] Input: User emotion data

[1409] Output: Information optimized according to emotions (relaxation spots and activities)

[1410] Specific operation: The server receives data indicating that the user's stress level is high and suggests, for example, a "quiet park" or "comforting music."

[1411] Step 9: The device provides optimized information to the user

[1412] Description: Provides information sent from the server to the user via voice and screen display.

[1413] Input: Optimization information sent from the server

[1414] Output: Present information to the user (audio guide and screen display)

[1415] Specific operation: The device displays detailed maps and tourist information on the screen, and also provides an audio guide, saying, "Next, head to Central Park."

[1416] Through the above processing steps, the user receives optimal information in real time and can proceed with their trip while enjoying it.

[1417] (Application example 2)

[1418] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1419] Travelers have difficulty quickly obtaining information about tourist spots and gourmet food that match their preferences and needs while traveling. Furthermore, it is difficult to create flexible travel plans that accommodate stress and changes in physical condition during travel. Furthermore, there is a lack of suggestions for dining locations that match the traveler's mood. Until now, no system has existed that can solve these issues.

[1420] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring the traveler's location information, means for inputting the traveler's preferences and needs, means for collecting real-time weather information, exchange rate information, and transportation information, means for generating tourist spot and gourmet information based on the traveler's preferences and needs using a generative AI model, means for calculating the optimal means of transportation and route from the traveler's current location to the destination, means for providing information on the culture and customs of the travel destination, means for recognizing the user's emotions and optimizing the information provided, and means for suggesting food and drink in real time. This allows travelers to quickly obtain the optimal tourist spot and gourmet information that suits their emotions and needs at any given time, enabling them to enjoy a comfortable and stress-free trip.

[1421] A "traveler" is an individual traveling to a particular destination and visiting that place for tourism, business, or other purposes.

[1422] "Location information acquisition means" means a device or system that uses GPS or other location-determining technology to determine a traveler's current geographic location.

[1423] A "means for inputting preferences and needs" is an interface through which travelers can input their interests and requests, including, for example, a touchscreen or voice recognition system.

[1424] "Real-time weather information," "exchange rate information," and "means of collecting traffic information" refer to systems for obtaining the latest weather information, currency exchange rates, traffic conditions, etc. via the Internet or API.

[1425] A "generative AI model" is an artificial intelligence model that learns from large datasets and generates appropriate tourist destination and gourmet information based on user input and real-time information.

[1426] "Means for calculating the optimal means of transportation and route from current location to destination" refers to an algorithm or system that calculates and suggests the optimal means of transportation and route when a traveler travels.

[1427] "Means for providing information about the culture and customs of the destination" refers to a system for providing travelers with information about the culture, manners, and customs specific to the region they are visiting.

[1428] "Means for recognizing user emotions and optimizing information provided" refers to technology that recognizes travelers' emotions and mental state and adjusts the travel information and suggestions provided based on that information.

[1429] "Means for suggesting food and drink in real time" refers to a system that suggests appropriate restaurants and menus in real time based on the user's preferences and current situation.

[1430] The system of the present invention provides multiple means for travelers to enjoy a comfortable and stress-free travel experience. Specific components of the system and their operation will now be described.

[1431] System configuration

[1432] 1. Location information acquisition means

[1433] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[1434] 2. How to input your preferences and needs

[1435] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair accessibility, etc.) into the device. After inputting, they press the send button to confirm the settings.

[1436] 3. Real-time information gathering methods

[1437] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[1438] 4. Information generation method using generative AI models

[1439] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs. This AI model learns from past travel data, local tourist guides, restaurant reviews, and more.

[1440] 5. Transportation and Route Calculation

[1441] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal way to use public transportation or the optimal taxi route, and sends the results to the device.

[1442] 6. Means of providing information on culture and customs

[1443] The server uses a generative AI model to provide information about the culture and customs of the destination, such as general etiquette and points of caution for travelers, and displays them on the device.

[1444] 7. Emotion Engine

[1445] The device uses facial expression analysis, voice tone analysis, and other emotion recognition technologies to recognize the user's emotions, which are then sent to a server and fed into a generative AI model.

[1446] 8. Food and beverage suggestion means

[1447] The server will then make real-time recommendations for restaurants and food based on the user's emotional data and preferences, providing options that best suit the user's current mood and situation.

[1448] Processing Description

[1449] Hardware Configuration

[1450] Device: Smartphone, camera, microphone, GPS function

[1451] Server: Database system, AI model operation environment

[1452] Software Configuration

[1453] GPS-linked applications

[1454] API communication function for obtaining real-time information

[1455] Generative AI model (AI model name: Transformer-based Model)

[1456] Emotion engine (emotion analysis software: OpenFace, voice emotion analysis: OpenSMILE)

[1457] Scripts for data analysis and processing (Python-based)

[1458] Specific example explanation

[1459] If a traveler is in New York, the device will use GPS to pinpoint their current location. The user launches the app and inputs their interest in tourist spots and cuisine. The server collects real-time weather, currency exchange rates, and traffic information, and uses a generative AI model to suggest suitable tourist spots and restaurants.

[1460] At the same time, the device's camera and microphone are used to recognize the user's emotions and suggest relaxing cafes and activities based on their emotional state (for example, whether they want to relax or stay active).

[1461] Prompt Sentence Examples

[1462] "Generate a list of cafes that users want to visit when they feel like relaxing."

[1463] This allows users to enjoy activities that best suit their mood and situation at the time, resulting in a highly satisfying travel experience.

[1464] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1465] Step 1: Obtaining the user's location

[1466] Input: The user launches the app.

[1467] Operation: Uses the device's GPS function to obtain the user's current location.

[1468] Output: Current location of the user (latitude and longitude).

[1469] Step 2: Enter your preferences and needs

[1470] Input: The user enters a destination, interest category, or specific need.

[1471] Operation: Data is entered through the user interface and sent to the server.

[1472] Output: Travel destinations, interest categories, specific needs.

[1473] Step 3: Gathering real-time information

[1474] Input: location information, destination data.

[1475] How it works: The server collects weather, currency exchange rates, and traffic information through an API.

[1476] Data processing: The collected data is stored in a database and updated in real time.

[1477] Output: Latest weather information, exchange rate information, traffic information.

[1478] Step 4: Generate information using a generative AI model

[1479] Input: User location, preferences and needs, real-time information.

[1480] How it works: Using a generative AI model, it generates information about tourist spots and restaurants based on the user's preferences and needs.

[1481] Data calculations: Generate optimal suggestions based on past travel data, local tourist guides, and restaurant reviews.

[1482] Output: List of tourist attractions, list of restaurants.

[1483] Step 5: Calculate travel modes and routes

[1484] Input: User's current location, destination, real-time information.

[1485] How it works: The server uses a route calculation algorithm to calculate the optimal mode of transportation and route.

[1486] Data calculation: Consider public transport timetables and route information, as well as taxi route information.

[1487] Output: Optimal travel modes and route information.

[1488] Step 6: Providing information about culture and customs

[1489] Input: Destination data.

[1490] How it works: Generative AI models are used to generate cultural and custom information about a destination.

[1491] Data processing: Collecting and analyzing information about local culture, manners, and customs.

[1492] Output: Information about culture and customs.

[1493] Step 7: Emotion Recognition

[1494] Input: User's facial expression data, voice data.

[1495] How it works: Recognizes the user's emotions using the device's camera and microphone.

[1496] Data calculation: Facial expression analysis and voice tone analysis are performed to generate emotion data.

[1497] Output: User's emotional data (stress level, happiness, etc.).

[1498] Step 8: Optimize information delivery

[1499] Input: Emotion data, information from generative AI models.

[1500] How it works: The server adjusts the priority and content of information taking into account emotional data.

[1501] Data calculation: If stress levels are high, a relaxation spot is recommended, and if you are excited, an active activity is recommended.

[1502] Output: Optimized proposal information.

[1503] Step 9: Real-time food and drink suggestions

[1504] Input: Emotional data, user preferences and needs.

[1505] How it works: The server suggests the best restaurants and food options based on your emotional data and preferences.

[1506] Data calculations: Analyze real-time restaurant information and reviews.

[1507] Output: A list of suggested restaurants and food options.

[1508] Through the above processing steps, the user can quickly obtain information on tourist spots and gourmet food that best suits their feelings and needs at the time, allowing them to enjoy a comfortable and stress-free trip.

[1509] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1510] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1511] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1512] [Fourth embodiment]

[1513] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1514] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1515] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1516] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1517] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1518] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1519] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1520] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1521] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1522] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1523] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1524] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1525] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1526] This invention is a system that utilizes generative AI models to provide appropriate travel information based on a traveler's location information and needs. This system helps travelers quickly and accurately obtain local information and smoothly select transportation methods.

[1527] System configuration

[1528] The system includes the following main components:

[1529] 1. Location information acquisition means

[1530] 2. How to input your preferences and needs

[1531] 3. Real-time information gathering methods

[1532] 4. Information generation method using generative AI models

[1533] 5. Transportation and Route Calculation

[1534] 6. Means of providing information on culture and customs

[1535] 7. Audio guide and on-screen display

[1536] Specific operation of each element

[1537] Location information acquisition means

[1538] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[1539] Input method for preferences and needs

[1540] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.) into the terminal, and the system then provides personalized information based on the user's requests.

[1541] Real-time information gathering means

[1542] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[1543] Information generation method using generative AI models

[1544] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs. This AI model learns from past travel data, local tourist guides, restaurant reviews, and more.

[1545] Transportation and route calculation

[1546] The server calculates the optimal means of transportation and route based on the user's current location and destination, for example, calculating the optimal method of using public transportation or the optimal taxi route, and sends the results to the device.

[1547] Culture and customs information provision method

[1548] The server uses a generative AI model to provide information about the culture and customs of the destination, such as general etiquette and points of caution for travelers, and displays them on the device.

[1549] Audio guide and on-screen display

[1550] The device provides the collected information and generated guides to the user via voice and on-screen display, for example, providing route guidance to the destination via voice and displaying a detailed map on the screen.

[1551] Specific examples

[1552] Specifically, consider a user traveling to Tokyo. When the user launches the app, the device uses GPS to obtain the user's current location. The user inputs into the device their preference to go to Tokyo and their interest in sightseeing spots and gourmet food.

[1553] Next, the server collects Tokyo weather information, the latest exchange rates, and traffic information, and uses this data to create a generative AI model to select appropriate tourist spots (e.g., Sensoji Temple, Skytree) and restaurants (e.g., famous sushi restaurants).

[1554] The server then calculates the optimal transportation method and route (e.g., limousine bus or train) from the airport to the hotel and sends that information to the device, which then displays the information on the screen and provides voice guidance to the user.

[1555] The server also generates information about the culture and customs of the destination, such as public manners and precautions in Tokyo (e.g., refrain from using mobile phones on trains), and displays it on the device, allowing users to take prompt and appropriate action during their trip.

[1556] As described above, by implementing the system of the present invention, travelers can enjoy a more comfortable and efficient travel experience. In addition, by providing real-time information, it is possible to flexibly respond to changes in travel plans and unexpected situations.

[1557] The processing flow will be explained below.

[1558] Step 1:

[1559] The user launches the app. When the app launches, a message appears requesting permission to use location information.

[1560] Step 2:

[1561] If the device receives permission from the user to use location information, it uses the GPS function to obtain the user's current location and sends the obtained latitude and longitude data to the app.

[1562] Step 3:

[1563] The user fills in the app's input form with their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.), then presses the submit button to confirm the settings.

[1564] Step 4:

[1565] The device sends the user's input information to the server, along with the user's location information.

[1566] Step 5:

[1567] Based on the received user information, the server collects real-time weather, exchange rate, and traffic information through related API services, and stores the collected information in a database.

[1568] Step 6:

[1569] The server uses the generative AI model to generate tourist and gourmet information based on the user's preferences and needs, and the generated information is then stored in an organized database.

[1570] Step 7:

[1571] The server calculates the optimal means of transportation and route from the user's current location to the destination, including how to use public transportation and taxis, and route information.

[1572] Step 8:

[1573] The server collects information from relevant databases and websites and compiles it using a generative AI model to generate information about the culture and customs of the destination.

[1574] Step 9:

[1575] The server then sends the generated information on tourist spots, gourmet food, transportation options and routes, and culture and customs to the device. The information sent is customized according to the user's request.

[1576] Step 10:

[1577] The device displays the received information on its screen, including photos and descriptions of tourist attractions, restaurant menus and ratings, and maps of transportation routes. If audio guidance is enabled, the information is also provided aloud.

[1578] Step 11:

[1579] Based on the displayed information, users can begin to plan their trip in detail. If necessary, they can refer to the displayed route to head to their destination. This allows users to enjoy their trip efficiently and with peace of mind.

[1580] Example 1

[1581] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1582] Conventional travel information systems lack the ability to provide personalized information based on users' location information and individual needs, and have difficulty providing real-time information quickly and accurately. As a result, travelers often struggle to find information about appropriate transportation methods and the culture and customs of their destinations, resulting in an inconvenient travel experience.

[1583] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1584] In this invention, the server includes means for collecting real-time weather information, exchange rate information, and traffic information from the Internet via API, means for generating tourist spot and gourmet information based on past data and local information using a generative AI model, and means for providing information on the culture and customs of the travel destination using the generative AI model, thereby enabling travelers to quickly and accurately obtain personalized information in real time.

[1585] A "terminal" is a device used by a traveler, such as a portable information terminal or smartphone, to obtain the traveler's current location and display necessary information.

[1586] "GPS" is an abbreviation for Global Positioning System, a technology that allows devices to receive and accurately measure their location on Earth from satellites.

[1587] "User" refers to the traveler who uses the system, and is the entity that inputs information into and operates the system.

[1588] "API" stands for Application Programming Interface, a means by which different software systems communicate with each other and exchange information.

[1589] "Real-time information" refers to information that is up to date at the present time, and includes, for example, weather information and traffic information.

[1590] A "generative AI model" is a model that uses artificial intelligence technology to recognize patterns and generate new information based on input data.

[1591] "Tourist destinations" refer to places and attractions that are popular destinations for tourists.

[1592] "Gourmet information" refers to information about restaurants and cuisine in the areas that travelers visit.

[1593] "Transportation" refers to the means of transportation that travelers use to travel from their current location to their destination, including public transportation and taxis.

[1594] A "route" refers to the path or route a traveler takes to get from their current location to their destination.

[1595] "Cultural and customs information" refers to information about the local culture, social customs, and behavioral norms at the travel destination.

[1596] "Audio guide" refers to a function that provides information and guidance to the user through audio.

[1597] "Screen display" refers to the function of visually displaying information on the device's display.

[1598] "Means" refers to the method or device used by the system to perform a particular function or operation.

[1599] The system utilizes a generative AI model based on the traveler's location and needs to provide appropriate travel information. An embodiment of the system is described in detail below.

[1600] System Components

[1601] The following major hardware and software are used to implement the system:

[1602] 1. Terminal: A mobile information terminal or smartphone used by a traveler. It has a GPS function and acquires location information and communicates between the user and the server.

[1603] 2. Server: A computing device located in the cloud that collects real-time information from the internet via APIs and generates and processes that information using generative AI models.

[1604] 3. Generative AI model: An artificial intelligence model that learns from past travel data and local information. For example, it uses large-scale language models (such as the GPT series).

[1605] 4. Internet: A communication network for obtaining real-time information (weather information, exchange rate information, traffic information) through APIs.

[1606] How it works

[1607] Location information acquisition

[1608] When a traveler launches the app, the device automatically obtains their current location using its built-in GPS function, and the obtained location information is sent to the server.

[1609] Input your preferences and needs

[1610] Users input their travel destinations, categories of interest (tourist spots, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.) into their devices. This input information is sent to the server.

[1611] Real-time information gathering

[1612] The server retrieves real-time weather, exchange rate, and traffic information from the Internet via multiple APIs, ensuring that the latest data is always available.

[1613] Information generation and provision

[1614] The server uses a generative AI model based on the user's preferences and needs to generate information about tourist spots and gourmet food. The generative AI model learns from past travel data and guide information, allowing it to provide the user with the most appropriate information.

[1615] For example, the following prompt sentence is input into the generative AI model: "The user is traveling to Tokyo and is interested in tourist spots and gourmet food. Please collect weather information, the latest exchange rates, and traffic information for Tokyo, and suggest suitable tourist spots and restaurants. In addition, please calculate the optimal means of transportation and route from the airport to the accommodation, and also provide information on public manners and things to be careful of in Tokyo."

[1616] Transportation and route calculation

[1617] The server calculates the optimal transportation method (e.g., public transportation, taxi) and route based on the user's current location and destination, and sends the calculation results to the device.

[1618] Providing information on culture and customs

[1619] The server uses a generative AI model to generate information about the culture and customs of the destination and provides it to the user as a guide for their travels.

[1620] Audio guide and on-screen display

[1621] The terminal displays the information sent from the server on its screen and provides audio guidance as needed, allowing users to receive easy-to-understand guidance both visually and audibly.

[1622] Specific operation example

[1623] For example, consider a user traveling to Tokyo. When the traveler launches the app, the device retrieves their current location information. Next, the user enters "Tokyo" as their destination, selects "tourist destinations" and "food" as categories of interest, and also enters "vegetarian-friendly" as a need. Based on this, the server collects real-time weather, exchange rates, and traffic information, uses a generative AI model to generate appropriate tourist destination and food information, calculates transportation methods and routes, and provides information on culture and customs. Finally, the device provides this information to the user via screen display and audio guidance.

[1624] By implementing the present invention in this way, travelers can obtain necessary information in real time and enjoy an efficient and comfortable trip.

[1625] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1626] Step 1:

[1627] (Location information acquisition)

[1628] When a traveler launches the app, the device automatically acquires the current location information using the built-in GPS function. The acquired location information (input) is sent to the server (output). This allows the server to grasp the traveler's current location.

[1629] Specific operation: The user launches the app and taps "Check current location." The device activates the GPS and sends the coordinate data (latitude and longitude) of the current location (e.g., Tokyo Station) to the server.

[1630] Step 2:

[1631] (Enter your preferences and needs)

[1632] Users input their travel destinations, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.) into their devices (input). This information is then sent from the device to the server (output).

[1633] Specific operation: The user enters "Tokyo" as the destination. On the category selection screen, select "Tourist Destinations" and "Gourmet." If necessary, check "Vegetarian Friendly."

[1634] Step 3:

[1635] (Real-time information gathering)

[1636] The server obtains real-time weather, exchange rate, and traffic information from the Internet via multiple APIs (input), which provides the latest data (output).

[1637] Specific operation: The server calls the Open Weather Map API to get the latest weather information for Tokyo, uses the Exchange Rate API to get the latest exchange rates, and uses the Traffic Information API to get real-time traffic information for Tokyo.

[1638] Step 4:

[1639] (Information generation using generative AI models)

[1640] The server inputs prompts into the generative AI model based on the user's preferences and needs (input), and generates tourist destination and gourmet information (output). The generative AI model learns from past travel data and guide information, and provides the user with the most appropriate information.

[1641] Specific operation: The server generates a prompt sentence: "The user is traveling to Tokyo and is interested in tourist spots and gourmet food. Please collect Tokyo weather information, the latest exchange rates, and traffic information, and suggest suitable tourist spots and restaurants." This prompt sentence is input into a generative AI model (e.g., GPT-4) to generate tourist spot and gourmet information.

[1642] Step 5:

[1643] (Transportation and route calculation)

[1644] The server calculates the optimal means of transportation (e.g., public transportation, taxi) and route based on the user's current location and destination (input). The optimal route information is obtained as a result of the calculation (output).

[1645] Specific operation: The server uses the Google Maps API to calculate the optimal public transportation route from Tokyo Station to Sensoji Temple, and generates detailed directions such as "Get on at Tokyo Station and take the Ginza Line to Asakusa Station."

[1646] Step 6:

[1647] (Providing information on culture and customs)

[1648] The server uses a generative AI model to generate information about the culture and customs of the travel destination (input), and the obtained information is sent from the server to the device (output).

[1649] Specific operation: The server generates a prompt sentence, "Please tell me about public manners and things to be careful about in Tokyo." This is input into the generative AI model, which generates information about things to be careful about and manners in Tokyo. The generated information is added to the response data.

[1650] Step 7:

[1651] (Audio guide and on-screen display)

[1652] The terminal provides the information received from the server to the user by displaying it on the screen and by voice (output).

[1653] Specific operation: The device displays the received tourist spots, gourmet information, route guidance, and cultural information on the app's UI. When the user taps on route guidance, the voice assistant will say, "Take the Ginza Line from Tokyo Station to Asakusa Station."

[1654] (Application example 1)

[1655] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1656] Travelers need a lot of information when they travel, such as choosing tourist attractions and restaurants, understanding the culture and customs, and choosing the best means of transportation. Information about specific travel needs (e.g., wheelchair accessibility or vegetarian options) is also important, but providing this information in real time is difficult. Furthermore, if the information provided is insufficient or inappropriate, the traveler's experience may be compromised. Therefore, to ensure travelers can enjoy their trip smoothly, a system is needed that provides real-time information based on their preferences and needs, as well as guidance on transportation and routes.

[1657] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1658] In this invention, the server includes means for acquiring the traveler's location information, means for inputting the traveler's preferences and needs, means for collecting real-time weather information, exchange rate information, and traffic information, means for generating tourist spot and restaurant information based on the traveler's preferences and needs using a generative AI model, means for calculating the optimal means of transportation and route from the traveler's current location to the destination, means for providing the generated tourist spot and restaurant information and travel route by voice guidance and on-screen display, and means for providing information on the culture and customs of the travel destination. This allows travelers to obtain more specific and personalized travel information in real time, enabling a comfortable and efficient travel experience.

[1659] "Location information" is data that indicates the traveler's current geographical location. It is mainly obtained using the GPS (Global Positioning System) function.

[1660] "Preferences and needs" refers to the personal interests and requirements that travelers want to fulfill during their trip, such as "tourist attractions," "food," and "wheelchair access."

[1661] "Real-time information" refers to the latest data available at the present time, including weather information, exchange rate information, traffic information, and so on.

[1662] "Weather Information" means data about current and future weather conditions at a destination, including temperature, precipitation, wind speed, etc.

[1663] "Exchange Rate Information" is up-to-date data on the exchange rates between different currencies, which helps travelers when exchanging currencies.

[1664] "Traffic information" refers to current information about public transportation and roads, including traffic congestion information, accident information, and operation status.

[1665] A "generative AI model" is a program that uses artificial intelligence to analyze data and generate information for a specific task.

[1666] "Tourist destinations" are places or facilities that tourists visit, including famous places, ruins, and natural parks.

[1667] "Restaurant information" is data about places where travelers can eat, including restaurants, cafes, food stands, etc.

[1668] "Transportation" refers to the means of transportation a traveler uses to travel from their current location to their destination, including walking, public transportation, and driving.

[1669] A "route" refers to the path a traveler takes from their current location to their destination, taking into account the shortest distance and the most optimal route.

[1670] "Audio guidance" is a method of providing specific information or instructions to travelers by voice, thereby providing information without relying on vision.

[1671] "Screen display" refers to a method of displaying information on the display of a traveler's device, allowing the information to be visually confirmed.

[1672] "Culture and customs" refers to the traditional ways of behavior and manners of a particular region or country. They serve as a guide for travelers on how to behave appropriately in that area.

[1673] This invention is a system that utilizes generative AI models to provide appropriate tourist destination and restaurant information based on travelers' location information and needs. The system helps travelers quickly and accurately obtain local information and select the best mode of transportation.

[1674] System configuration

[1675] The system has the following main components:

[1676] 1. Location information acquisition means

[1677] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[1678] 2. How to input your preferences and needs

[1679] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (wheelchair access, etc.) into the terminal, and the system then provides personalized information based on the user's requests.

[1680] 3. Real-time information gathering methods

[1681] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[1682] 4. Information generation method using generative AI models

[1683] The server generates tourist destination and restaurant information based on the user's preferences and needs using a generative AI model that learns from past travel data, local tourist guides, restaurant reviews, and more.

[1684] 5. Transportation and Route Calculation

[1685] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal method of using public transportation or the optimal taxi route, and sends the results to the device.

[1686] 6. Voice guidance and screen display means for generated information

[1687] The terminal provides the generated tourist spot and restaurant information and travel routes through voice guidance and on-screen display, allowing travelers to obtain information both visually and audibly.

[1688] 7. Means of providing information on culture and customs

[1689] The server uses generative AI models to provide information about the culture and customs of the travel destination, which users can view on screen and through voice guidance.

[1690] Processing Description

[1691] The server and device work together to perform the following process. First, the device obtains the user's location information and sends it to the server. Next, the user's preferences and needs information is also sent to the server. Based on this information, the server collects real-time information from the API. The generative AI model uses this data to generate optimal tourist destination and restaurant information for the user, and provides this information via voice guidance and on-screen display.

[1692] Specific examples

[1693] For example, consider a user traveling to Tokyo. When the user launches the app, the device uses GPS to obtain their current location. The user inputs their preference for visiting Tokyo and their interest in tourist spots and cuisine into the device. The server then collects Tokyo weather information, the latest exchange rates, and traffic information. Based on this data, the server uses a generative AI model to select appropriate tourist spots (e.g., Sensoji Temple, observation decks) and restaurants (e.g., famous sushi restaurants). The server calculates the optimal transportation method and route from the airport to the accommodation and sends this information to the device. The device displays this information on the screen and provides audio guidance to the user. The server also generates information about the culture and customs of the destination, such as public etiquette and precautions in Tokyo (e.g., refraining from using cell phones on trains), and displays this information on the device. This allows the user to take prompt and appropriate action during their trip.

[1694] Example prompt sentence:

[1695] The user's current location is Tokyo. Please suggest the best tourist spots and restaurants based on the following information:

[1696] Category: ["Tourist attractions", "Gourmet"]

[1697] Special Needs: ["Wheelchair accessible"]

[1698] Weather information: [Weather information data]

[1699] Exchange Rate: [Exchange Rate Data]

[1700] Traffic Information: [Traffic Information Data]

[1701] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1702] Step 1:

[1703] The device acquires the traveler's location information

[1704] Input: When a traveler launches the app, the device's GPS function is activated.

[1705] Data processing: Determine current latitude and longitude using GPS.

[1706] Output: The obtained location information is sent to the server.

[1707] Step 2:

[1708] Users input their preferences and needs into the device

[1709] Input: The user uses the app's interface to input their destination, interest categories, and specific needs (e.g., wheelchair accessibility).

[1710] Data processing: The entered information is saved as digital data.

[1711] Output: Preferences and needs information is sent to the server.

[1712] Step 3:

[1713] The server collects real-time information

[1714] Input: Location information and user preferences and needs information are received by the server.

[1715] Data processing: Use API to obtain weather information, exchange rate information, and traffic information.

[1716] Output: All real-time information is stored and updated in the server.

[1717] Step 4:

[1718] The server generates information using the generative AI model

[1719] Input: User preferences, needs and real-time information are stored in a database on the server.

[1720] Data processing: A generative AI model analyzes this data and creates a prompt. Example prompt: "The user's current location is Tokyo. Please suggest the best tourist spots and restaurants based on the following information: Category: ['Tourist Spot', 'Gourmet'], Special Needs: ['Wheelchair Accessible'], Weather Information: [Weather Information Data], Exchange Rates: [Exchange Rate Data], Traffic Information: [Traffic Information Data]."

[1721] Output: The generative AI model generates information about tourist spots and restaurants.

[1722] Step 5:

[1723] The server calculates the optimal means of transportation and route

[1724] Input: The latitude and longitude information of the current location and destination, as well as traffic information, are entered into the server.

[1725] Data processing: Using map APIs and traffic APIs, we calculate the optimal means of transportation and routes based on distance and traffic conditions.

[1726] Output: Trip and route information is calculated and sent to the device.

[1727] Step 6:

[1728] The device provides information through voice guidance and on-screen display

[1729] Input: Information on tourist spots and restaurants, transportation methods and routes, and culture and customs information sent from the server is received by the device.

[1730] Data processing: Maps and text information are displayed on the terminal screen, and voice guidance is generated using a speech synthesis engine.

[1731] Output: Information is presented to the user visually and audibly.

[1732] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1733] This invention utilizes a generative AI model to provide appropriate travel information based on a traveler's location information and preferences, and also optimizes the content of the information provided using an emotion engine that recognizes the user's emotions, allowing travelers to enjoy their trips in comfort and peace of mind.

[1734] System configuration

[1735] The system includes the following main components:

[1736] 1. Location information acquisition means

[1737] 2. How to input your preferences and needs

[1738] 3. Real-time information gathering methods

[1739] 4. Information generation method using generative AI models

[1740] 5. Transportation and Route Calculation

[1741] 6. Means of providing information on culture and customs

[1742] 7. Emotion Engine

[1743] 8. Audio guide and on-screen display

[1744] Specific operation of each element

[1745] Location information acquisition means

[1746] The device uses GPS to obtain the traveler's location information, which is collected automatically when the traveler launches the app.

[1747] Input method for preferences and needs

[1748] Users input their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair accessibility, etc.) into the device. After inputting, they press the send button to confirm the settings.

[1749] Real-time information gathering means

[1750] The server collects real-time weather, currency exchange, and traffic information from the Internet via API. This information collection is done periodically, and the latest data is always kept.

[1751] Information generation method using generative AI models

[1752] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs. This AI model learns from past travel data, local tourist guides, restaurant reviews, and more.

[1753] Transportation and route calculation

[1754] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal way to use public transportation or the optimal taxi route, and sends the results to the device.

[1755] Culture and customs information provision method

[1756] The server uses a generative AI model to provide information about the culture and customs of the destination, such as general etiquette and points of caution for travelers, and displays them on the device.

[1757] Emotion Engine

[1758] The device uses facial expression analysis, voice tone analysis, and other emotion recognition technologies to recognize the user's emotions, which are then sent to a server and fed into a generative AI model.

[1759] Audio guide and on-screen display

[1760] The device provides the collected information and generated guides to the user by voice and on-screen display, for example, providing route guidance to the destination by voice and displaying a detailed map on-screen.

[1761] Emotion engine operation

[1762] User Emotion Recognition

[1763] The device uses a camera and microphone to analyze the user's facial expressions and voice, recognizing emotions in real time, which are then converted into parameters such as stress level, happiness, and interest.

[1764] Information Optimization

[1765] The server uses the emotional data obtained from the emotion engine to optimize the information provided to the user. For example, if the user is feeling stressed, it will suggest relaxation spots and quiet tourist spots. If the user is excited, it will suggest active activities and events.

[1766] Specific examples

[1767] Specifically, consider a user traveling to New York. When the user launches the app, the device acquires the user's current location using GPS. The user inputs into the device their preference to go to New York and their needs, such as interest in sightseeing spots and gourmet food.

[1768] Next, the server collects New York weather information, the latest exchange rates, and traffic information, and uses this data to create a generative AI model to select appropriate tourist spots (e.g., Central Park, Times Square) and restaurants (e.g., famous steakhouses).

[1769] The server then calculates the optimal transportation method and route (e.g., taxi or subway) from the airport to the hotel and sends that information to the device, which then displays the information on the screen and provides voice guidance to the user.

[1770] The server also generates information about the culture and customs of the destination, such as public manners and things to be aware of in New York (e.g., how to behave on the subway), and displays this information on the device.

[1771] Additionally, the device utilizes an emotion engine to recognize the user's emotions and suggest relaxation spots (e.g., quiet parks) and soothing music if the user's stress level is high, or suggest active activities (e.g., live shows or sporting events) if the user is excited, ensuring the user enjoys an optimal travel experience.

[1772] As described above, by implementing the system of the present invention, travelers can enjoy a more comfortable and efficient travel experience. In addition, real-time information provision and emotion recognition enable the system to flexibly respond to changes in travel plans and unexpected situations.

[1773] The processing flow will be explained below.

[1774] Step 1:

[1775] The user launches the app. When the app launches, a message appears requesting permission to use location information.

[1776] Step 2:

[1777] If the device receives permission from the user to use location information, it will use the GPS function to obtain the user's current location and pass the obtained latitude and longitude data to the app.

[1778] Step 3:

[1779] The user fills in the app's input form with their travel destination, categories of interest (tourist attractions, gourmet food, shopping, etc.), and specific needs (vegetarian options, wheelchair access, etc.), then presses the submit button to confirm the settings.

[1780] Step 4:

[1781] The device sends the user's input information to the server, along with the user's location information.

[1782] Step 5:

[1783] The server collects real-time weather, exchange rate, and traffic information through various APIs based on the received user information, and stores the collected information in a database.

[1784] Step 6:

[1785] The server uses a generative AI model to generate tourist and gourmet information based on the user's preferences and needs, and the generated information is stored in an organized database.

[1786] Step 7:

[1787] The server calculates the optimal means of transportation and route from the user's current location to the destination, including how to use public transportation and taxis, as well as route information.

[1788] Step 8:

[1789] The server collects information from relevant databases and websites and compiles it using a generative AI model to generate information about the culture and customs of the destination.

[1790] Step 9:

[1791] The device analyzes the user's facial expressions and voice through a camera and microphone, and generates emotional data using an emotion engine. This data is then sent to a server.

[1792] Step 10:

[1793] The server analyzes the emotional data and optimizes the information provided based on the user's stress level and happiness level. For example, if stress is high, it will recommend relaxation spots, and if excited, it will suggest active activities.

[1794] Step 11:

[1795] The server then sends the generated information on tourist spots, gourmet food, transportation options and routes, and culture and customs to the device. The information is customized according to the user's emotional data.

[1796] Step 12:

[1797] The device displays the received information on its screen, including photos and descriptions of tourist attractions, restaurant menus and ratings, and maps of transportation routes. If audio guidance is enabled, the information is also provided aloud.

[1798] Step 13:

[1799] Users can use the displayed information to plan their trip in detail, and if necessary, refer to the displayed route to head to their destination. This allows users to enjoy their trip efficiently and with peace of mind.

[1800] Specific examples

[1801] For example, if a user travels to New York:

[1802] In step 1, the user launches the app and grants permission to use location information.

[1803] In step 2, the device obtains its location in New York.

[1804] In step 3, the user enters that they are interested in tourist spots and gourmet food.

[1805] In step 4, the terminal sends the input information to the server.

[1806] In step 5, the server collects weather information, exchange rate information, and traffic information.

[1807] In step 6, the server uses the generative AI model to generate information about tourist attractions (Central Park, Times Square) and restaurants.

[1808] In step 7, the server calculates the optimal mode of transportation and route.

[1809] In step 8, the server generates information about New York's culture and customs.

[1810] In step 9, the device analyzes facial expressions and voice, generates emotional data, and sends it to the server.

[1811] In step 10, the server optimizes the information based on the emotion data.

[1812] In step 11, the server sends the generated information to the terminal.

[1813] In step 12, the terminal displays the information on the screen and provides voice guidance.

[1814] In step 13, the user finalizes their travel plans based on the information and enjoys their trip with peace of mind.

[1815] As described above, the present invention is a system that supports a comfortable travel experience by taking into account the emotional data of travelers and providing information optimized for each individual user.

[1816] Example 2

[1817] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1818] Modern travelers make travel plans based on diverse needs and preferences, but these plans often need to be changed, requiring real-time information provision. Furthermore, a lack of flexible support based on travelers' emotional states makes it difficult to provide a comfortable and secure travel experience. Therefore, a system that provides optimal travel information based on travelers' location information, preferences, real-time environmental information, and emotional state is needed.

[1819] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1820] In this invention, the server includes means for acquiring location information, means for inputting traveler preferences and needs, means for collecting real-time weather information, exchange rate information, and traffic information, means for generating tourist spot and restaurant information based on traveler preferences and needs using a generative model, means for calculating the optimal means of transportation and route from the traveler's current location to the destination, means for providing information on the culture and customs of the destination, means for emotion recognition, and means for optimizing information based on emotion data. This allows travelers to receive optimal information in real time and enables flexible adjustment of travel plans according to their emotional state.

[1821] "Means for obtaining location information" refers to a system that uses GPS functions and communication networks to identify a traveler's current location.

[1822] "Means for inputting traveler preferences and needs" refers to an interface that allows travelers to input their desired destinations, categories of interest, special requirements, etc.

[1823] "Means of collecting real-time weather information, exchange rate information, and traffic information" refers to a system that regularly obtains information such as the latest weather, currency fluctuations, and traffic conditions through external information providers and APIs.

[1824] "Means for generating tourist destination and restaurant information based on travelers' preferences and needs using generative models" refers to a system that uses artificial intelligence technology and machine learning algorithms to suggest optimal tourist destinations and restaurants based on travelers' input information.

[1825] "A means for calculating the optimal means of transportation and route from a traveler's current location to their destination" is a system that calculates and suggests the optimal means of transportation, such as public transportation or taxi, and route based on the traveler's current location and destination.

[1826] "A means of providing information on the culture and customs of a destination" is a system that provides travelers with a summary of the cultural manners, customs, and precautions of the destination.

[1827] The "means for emotion recognition" is a system that recognizes a traveler's emotional state in real time by analyzing the traveler's facial expressions and tone of voice.

[1828] The "means for optimizing information based on emotional data" is a system that analyzes travelers' emotional data and provides optimal travel information and suggestions based on the results.

[1829] This invention is a system that utilizes a generative AI model to provide appropriate travel information based on the traveler's location information and preferences. Furthermore, by optimizing the content of the information provided using an emotion engine that recognizes the user's emotions, travelers can enjoy their trip comfortably and with peace of mind.

[1830] System configuration

[1831] The system includes the following main components:

[1832] 1. Location information acquisition means

[1833] 2. How to input your preferences and needs

[1834] 3. Real-time information gathering methods

[1835] 4. Information generation method (generative AI model)

[1836] 5. Transportation and Route Calculation

[1837] 6. Means of providing information on culture and customs

[1838] 7. Emotion Engine

[1839] 8. Audio guide and on-screen display

[1840] Location information acquisition means

[1841] The device uses GPS to obtain the traveler's location. For example, if a user launches the app and is at JFK Airport in New York, the device will identify their location. This location information is updated in real time, ensuring the traveler's current location is accurately detected.

[1842] Input method for preferences and needs

[1843] Users input their travel destinations, categories of interest (tourist attractions, restaurants, shopping, etc.), and specific needs (vegetarian options, barrier-free access, etc.) into the device. The input information is saved and used to generate future information. For example, a user may input that they are interested in tourist attractions and food in New York.

[1844] Real-time information gathering means

[1845] The server uses APIs to collect real-time weather information, currency exchange rates, and traffic information from the Internet. This information collection is done periodically, so the latest data is always kept. For example, it can collect the latest weather information and subway operation status for New York.

[1846] Information generation means

[1847] The server uses a generative AI model to generate tourist destination and restaurant information based on the user's preferences and needs. The generative AI model learns from past travel data, local tourist guides, restaurant reviews, etc. For example, it generates information about Central Park and famous steakhouses.

[1848] Transportation and route calculation

[1849] The server calculates the optimal means of transportation and route based on the user's current location and destination. For example, it calculates the optimal taxi route from the airport to the hotel and sends the results to the device.

[1850] Culture and customs information provision method

[1851] The server uses a generative AI model to generate information about the culture and customs of the destination and provides it to the device, such as advice on how to behave on the New York subway and general precautions.

[1852] Emotion Engine

[1853] The device analyzes the user's facial expressions and voice to recognize their emotions. This recognized emotional data is sent to the server and reflected in the information generated. For example, if the user is feeling stressed, that data is sent to the server.

[1854] Audio guide and on-screen display

[1855] The terminal provides the user with information provided by the server through voice and on screen, for example, providing route guidance to the destination through voice and displaying a detailed map on screen.

[1856] Specific examples

[1857] Specifically, consider the case where a user is traveling to New York. When the user launches the app, the device acquires the current location information using GPS. The user inputs into the device their preference to go to New York and their needs, such as interest in sightseeing spots and gourmet food.

[1858] The server then collects New York weather information, the latest exchange rates, and traffic information, and uses this data to select appropriate tourist attractions (e.g., Central Park, Times Square) and restaurants (e.g., famous steakhouses) using a generative AI model.

[1859] Furthermore, the server calculates the optimal transportation method and route (e.g., taxi or subway) from the airport to the accommodation and sends that information to the device, which not only displays this information on the screen but also provides voice guidance to the user.

[1860] The server also generates information about the culture and customs of the destination, such as etiquette and things to be aware of in New York (e.g., how to behave on the subway), and displays this information on the device.

[1861] Additionally, the device uses an emotion engine to recognize the user's emotions and suggests relaxation spots (e.g., quiet parks) or soothing music if the user's stress level is high, or suggests active activities like live shows or sporting events if the user is excited.

[1862] Prompt Sentence Examples

[1863] "We have a traveler currently at JFK Airport in New York who is interested in sightseeing and food. The current weather is sunny and traffic is normal. Please suggest the best sightseeing spots and restaurants, as well as the best route from the airport to their accommodation. Also, please suggest relaxation spots as this traveler's stress level may be high."

[1864] Through the above process, travelers can receive the most appropriate information in real time and enjoy a comfortable and efficient trip.

[1865] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1866] Step 1: User launches the app and gets location information

[1867] Description: When a user launches the app, the device uses GPS to obtain the user's current location.

[1868] Input: User action to launch the app

[1869] Output: GPS data of the user's current location

[1870] Specific operation: The device will automatically display the message "Detecting current location" and activate the GPS sensor to acquire location information, which will be stored in the internal database and used in the next step.

[1871] Step 2: User enters travel preferences and needs

[1872] Description: Users enter their travel destination, interest categories, and specific needs on the app screen.

[1873] Input: Travel destination, interest category, specific needs (e.g., New York, tourist destination, gourmet, vegetarian)

[1874] Output: Data about user preferences and needs

[1875] Specific operation: The user enters "New York" as their destination in the form within the app, selects "tourist destinations" and "food" as their interest categories, and selects "vegetarian-friendly" as their specific need. The input is confirmed by pressing the "Submit" button and sent to the server.

[1876] Step 3: The server collects real-time information

[1877] Description: The server collects real-time weather information, currency exchange rates, and traffic information via API.

[1878] Input: Data about the user's current location and destination

[1879] Output: Real-time weather information, exchange rates, traffic information

[1880] How it works: The server uses an API that is updated every minute to collect information such as the weather in New York (sunny, temperature 25°C), subway operation status (normal), and the latest exchange rate (1 dollar = 110 yen).

[1881] Step 4: The server generates information using the generative AI model

[1882] Description: Uses a generative AI model to generate tourist destination and restaurant information based on user input.

[1883] Input: Data on user preferences and needs, real-time information

[1884] Output: A list of recommended tourist spots and restaurants

[1885] How it works: The server uses a generative AI model to generate recommended locations, such as Central Park and a famous steakhouse, based on past travel data and restaurant reviews. These results are then used in the next step.

[1886] Step 5: Server calculates mode and route

[1887] Description: Calculates the best mode of transportation and route based on the user's current location and destination.

[1888] Input: User's current location and destination data

[1889] Output: Optimal travel modes and route information

[1890] Specific operation: The server considers public transportation and taxi options and calculates and provides route information, such as "A taxi from JFK Airport to your hotel takes 45 minutes and costs approximately $50."

[1891] Step 6: The server provides information about culture and customs

[1892] Description: Provides information about the culture and customs of a destination using generative AI models.

[1893] Input: Destination data

[1894] Output: Information about culture and customs

[1895] Specific behavior: The server generates information about the culture and customs of the destination and provides specific behavioral etiquette, such as "Do not eat food while riding the New York subway."

[1896] Step 7: The device recognizes the user's emotions

[1897] Description: The device uses a camera and microphone to analyze the user's facial expressions and voice to recognize emotions.

[1898] Input: User's facial expression data, voice tone

[1899] Output: User's emotional data (stress level, happiness, interest, etc.)

[1900] Specific operation: The device captures the user's facial expressions and analyzes the audio from the microphone to determine whether the user is feeling stressed.

[1901] Step 8: The server optimizes the information based on the emotional data

[1902] Description: Uses data obtained from the emotion engine to optimize the information provided to the user.

[1903] Input: User emotion data

[1904] Output: Information optimized according to emotions (relaxation spots and activities)

[1905] Specific operation: The server receives data indicating that the user's stress level is high and suggests, for example, a "quiet park" or "comforting music."

[1906] Step 9: The device provides optimized information to the user

[1907] Description: Provides information sent from the server to the user via voice and screen display.

[1908] Input: Optimization information sent from the server

[1909] Output: Present information to the user (audio guide and screen display)

[1910] Specific operation: The device displays detailed maps and tourist information on the screen, and also provides an audio guide, saying, "Next, head to Central Park."

[1911] Through the above processing steps, the user receives optimal information in real time and can proceed with their trip while enjoying it.

[1912] (Application example 2)

[1913] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1914] Travelers have difficulty quickly obtaining information about tourist spots and gourmet food that match their preferences and needs while traveling. Furthermore, it is difficult to create flexible travel plans that accommodate stress and changes in physical condition during travel. Furthermore, there is a lack of suggestions for dining locations that match the traveler's mood. Until now, no system has existed that can solve these issues.

[1915] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring the traveler's location information, means for inputting the traveler's preferences and needs, means for collecting real-time weather information, exchange rate information, and transportation information, means for generating tourist spot and gourmet information based on the traveler's preferences and needs using a generative AI model, means for calculating the optimal means of transportation and route from the traveler's current location to the destination, means for providing information on the culture and customs of the travel destination, means for recognizing the user's emotions and optimizing the information provided, and means for suggesting food and drink in real time. This allows travelers to quickly obtain the optimal tourist spot and gourmet information that suits their emotions and needs at any given time, enabling them to enjoy a comfortable and stress-free trip.

[1916] A "traveler" is an individual traveling to a particular destination and visiting that place for tourism, business, or other purposes.

[1917] "Location information acquisition means" means a device or system that uses GPS or other location-determining technology to determine a traveler's current geographic location.

[1918] A "means for inputting preferences and needs" is an interface through which travelers can input their interests and requests, including, for example, a touchscreen or voice recognition system.

[1919] "Real-time weather information," "exchange rate information," and "means of collecting traffic information" refer to systems for obtaining the latest weather information, currency exchange rates, traffic conditions, etc. via the Internet or API.

[1920] A "generative AI model" is an artificial intelligence model that learns from large datasets and generates appropriate tourist destination and gourmet information based on user input and real-time information.

[1921] "Means for calculating the optimal means of transportation and route from current location to destination" refers to an algorithm or system t...

Claims

1. A means for obtaining location information of a traveler; a means of inputting traveler preferences and needs; A means of collecting real-time weather information, exchange rate information, and traffic information; A means of generating tourist destination and gourmet information based on traveler preferences and needs using a generative AI model; A means of calculating the optimal means of transportation and route from the traveler's current location to the destination; A means of providing information about the culture and customs of the destination; A system including:

2. 2. The system according to claim 1, further comprising means for providing information about culture and customs to the traveler through voice and screen.

3. 10. The system of claim 1, further comprising means for generating information regarding specific travel needs based on traveler input.

Images