system

Abstract

We provide the system. [Solution] A terminal for entering travel plans, A data processing means for storing travel plan information in a database and collecting related tourist destination information, A means for generating historical information related to tourist destinations, A communication method that creates a sightseeing plan using the generated information and transmits it to a terminal via a communication network, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When tourists make travel plans, it is difficult to obtain sufficient information about tourist attractions at the destination and their historical backgrounds, resulting in limited experiences at the visited places. In addition, since there is not enough means to efficiently plan the visiting time and order at tourist destinations, tourists are often caught up in congestion. Therefore, there is a need to deepen the tourist experience more effectively and optimize the travel plan.

Means for Solving the Problems

[0005] To solve this problem, the present invention provides a terminal means for inputting travel plan information, and a data processing means for storing that information and collecting related tourist destination information. Furthermore, a generation means automatically generates historical information of tourist destinations and uses this to create a travel plan. This plan, transmitted to the terminal via a communication network, serves as a foundation for users to obtain an efficient and fulfilling travel experience. In addition, by including a visual display means that includes suggestions for optimizing estimated visit times and routes, and a means that provides additional information in real time based on the current location, the tourist's experience can be made more profound.

[0006] A "travel plan" refers to the destinations a tourist plans to visit within a specific period of time, along with a detailed itinerary related to those destinations.

[0007] "Terminal means" refers to electronic devices used by users to input information or display received information.

[0008] "Data processing means" refers to a system or software that has the ability to store input information and collect and analyze necessary data.

[0009] "Generation method" refers to a system that automatically generates new information using specific algorithms or AI models.

[0010] "Communication means" refers to methods or techniques for transmitting information to other devices or systems.

[0011] A "tourism plan" refers to a proposed travel plan that combines the places tourists visit, the times they visit, and information related to those places. [Brief explanation of the drawing]

[0012] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2]This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0013] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0014] First, the terms used in the following description will be explained.

[0015] In the following embodiments, the labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0016] In the following embodiments, the labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0017] In the following embodiments, the labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0018] In the following embodiments, the labeled communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), and the like.

[0019] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0020] [First Embodiment]

[0021] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0022] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0023] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0024] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0025] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0026] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0027] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0028] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0029] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0030] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0031] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0032] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0033] The present invention is a tourism information provision system comprising terminal means for travelers to input information, server means for storing and processing information, and communication means for transmitting information. This allows travelers to obtain detailed information about tourist destinations they plan to visit and to plan their trips efficiently.

[0034] Operation of terminal means

[0035] The user uses a terminal to input their travel plan, which includes information such as the names of tourist destinations and dates to be visited. The terminal verifies the input data and formats it into a format that the server can process. The formatted information is then sent to the server via a communication method.

[0036] Server operation

[0037] Based on the received travel plan information, the server automatically collects relevant tourist spots and their historical information from external databases and APIs. Using the collected information, it generates additional information about the historical background and characteristics of the tourist destinations. The generated information is then organized into a travel plan tailored to the user's itinerary.

[0038] Operation of communication and display means

[0039] The organized sightseeing plan is sent from the server to the user's terminal via a communication method. The terminal visually displays the received information, allowing the user to review and adjust it.

[0040] Specific example

[0041] For example, if a user plans a visit to Kyoto using their device, the server generates historical information about Kinkaku-ji Temple and Arashiyama. It also analyzes the congestion levels at each tourist spot and provides a sightseeing plan suggesting the optimal visiting times. This allows users to gain in-depth knowledge about their destinations while also enjoying sightseeing efficiently and avoiding crowds.

[0042] Thus, the present invention provides tourists with a fulfilling travel experience by enabling the automatic generation of tourist information and the efficient presentation of travel plans.

[0043] The following describes the processing flow.

[0044] Step 1:

[0045] The user accesses the travel website using their device and enters the names of the tourist destinations they plan to visit and their travel dates. The device verifies the entered information and confirms that the data format is correct.

[0046] Step 2:

[0047] The terminal sends formatted travel schedule information to the server. The server receives the information and stores it in its database.

[0048] Step 3:

[0049] Based on the stored information, the server retrieves relevant tourist spot information and congestion status from external APIs and databases.

[0050] Step 4:

[0051] Based on the acquired tourist destination information, the server uses generation methods to create new information that includes details about historical background and location.

[0052] Step 5:

[0053] The server analyzes the generated information and optimizes sightseeing plans based on congestion data. It also provides suggestions regarding the order and timing of visits.

[0054] Step 6:

[0055] The server sends an optimized sightseeing plan to the user's terminal using a communication method. The terminal then visually displays the received plan on its user interface.

[0056] Step 7:

[0057] Users can review the displayed sightseeing plan and adjust their schedule as needed. Upon arriving at their destination, they can use their device to obtain further local information and enhance their travel experience.

[0058] (Example 1)

[0059] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0060] Traditional tourism information systems require users to manually search for information and plan their trips, which is time-consuming and laborious. Furthermore, it's difficult to create optimal travel plans that take into account the congestion levels at tourist destinations, sometimes resulting in unsatisfactory travel experiences for users.

[0061] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0062] In this invention, the server includes means for inputting travel plans and formatting the data into a processable format; data processing means for storing travel plan information and collecting relevant tourist information from external sources; and generation means for generating detailed historical and tourist information using a generation AI model based on the collected information. This enables users to efficiently obtain tourist information through an automated process and create optimal travel plans that avoid crowds.

[0063] A "travel plan" is a plan that includes information about the tourist destinations and itinerary that the user will visit.

[0064] A "terminal" refers to hardware or software that allows a user to input information and visually confirm that information.

[0065] "Data processing means" refers to a function that stores received data and performs the process of collecting relevant information from external sources.

[0066] A "generative AI model" refers to an algorithm or program that uses artificial intelligence to generate new information and provide detailed information.

[0067] "Generative means" refers to the process or function of creating new information based on collected data.

[0068] "Communication methods" refer to network systems and protocols used to transmit information from a server to a terminal, or vice versa.

[0069] "Means of visual display" refers to a function that displays received information on a device in a format that the user can understand.

[0070] "Crowding" refers to an indicator or state that shows the number and density of visitors in a tourist destination.

[0071] "Optimal visiting time" refers to the recommended timing for a visit, after adjusting the time of day and schedule, to ensure users can enjoy sightseeing smoothly.

[0072] This invention is an information provision system that enables travelers to have a more efficient and satisfying sightseeing experience. This system consists of a terminal, a server, and communication means.

[0073] Terminal operation

[0074] Users input their travel plans using their personal devices. Specifically, they enter information such as tourist attractions at their destination and their itinerary. This device converts the requested information into a format that can be processed by the server. The device then verifies this data and sends the formatted information to the server via communication.

[0075] Server operation

[0076] The server accesses external information sources based on received travel plan data to collect interesting tourist information. This information collection includes, for example, detailed information about tourist destinations, crowd levels, and historical background. It also uses a generative AI model to generate additional detailed content based on the collected information. This generative AI model features algorithms that analyze data obtained from historical databases and tourism APIs to make predictions.

[0077] Operation of communication means

[0078] Once the generated information is organized and compiled into a travel plan, it is transmitted to the terminal via a communication network.

[0079] Visual display

[0080] The terminal visually displays the received sightseeing plan to the user, allowing them to intuitively check the information and make adjustments as needed.

[0081] Specific example

[0082] For example, if a user plans a trip to Kyoto, the server generates detailed historical and tourist information about places like Kinkaku-ji Temple and Arashiyama. It also provides a sightseeing plan suggesting the optimal time to visit each location based on its congestion levels. This allows users to gain a deeper understanding of their destinations and achieve more efficient sightseeing.

[0083] Examples of prompts for generative AI models

[0084] "Please propose a sightseeing plan for Kyoto's tourist attractions based on detailed historical information and crowd levels."

[0085] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0086] Step 1:

[0087] The user uses a terminal to input basic information about their travel plan. This input includes the names of tourist attractions and the itinerary. The terminal formats this input data into a standardized format and prepares it for transmission to the server. Specifically, this involves unifying freely written tourist attraction names into a specific data format. After formatting, the input data is sent to the server via a communication method.

[0088] Step 2:

[0089] The server receives travel plan information sent from the terminal. It analyzes this received data to identify the necessary information categories (e.g., history, geography, events). Next, the server accesses external information sources (databases or APIs) to collect relevant tourism information. Examples include historical information about tourist destinations and event information for the planned travel dates. This collected data is then used as input for the generated AI model.

[0090] Step 3:

[0091] The server uses the collected information to send prompts to the generative AI model. By providing the generative AI model with prompts such as "Please provide detailed historical information about tourist spots in Kyoto," it generates detailed information about specific tourist spots. The generated information becomes the basic data for creating travel plans and also forms the basis for providing customized information to each user.

[0092] Step 4:

[0093] The server creates a sightseeing plan tailored to the user's requests based on the generated information. This information includes predicted crowd levels at tourist spots and optimal visiting times. The server organizes this information and converts it into a user-friendly format. The output is a sightseeing plan with recommended visiting order and time allocation.

[0094] Step 5:

[0095] The server transmits the final created sightseeing plan to the terminal via a communication method. The terminal receives this information and displays it visually to the user. The user can review the displayed information and adjust the visiting times and order as needed. This makes it easier for the user to plan their actual trip.

[0096] (Application Example 1)

[0097] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0098] Conventional tourism information systems have made it difficult for travelers to efficiently create travel plans and easily obtain detailed information about their intended destinations. Furthermore, the lack of real-time additional information provision at the destination limited the convenience for travelers. This invention aims to solve these problems and provide a system that allows travelers to enjoy sightseeing more effectively.

[0099] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0100] In this invention, the server includes an input device means for inputting travel plans, an information processing means for storing travel plan information in a storage device and collecting related tourist destination information, a generation device means for generating historical information related to tourist destinations, and an output means for presenting tourist information to tourists using a visual device. This makes it possible for travelers to quickly obtain detailed information and recommended sightseeing plans for their planned destinations, thereby improving their sightseeing experience at the location.

[0101] "Input device means" refers to a device or interface used by travelers to input their travel plans.

[0102] A "storage device" refers to a database or storage system used to save travel plan information.

[0103] "Information processing means" refers to the processes and methods for organizing and analyzing collected tourist destination information.

[0104] "Generation device means" refers to a system or component for generating historical information and additional information related to tourist destinations.

[0105] "Transmission means" refers to the network and communication technology used to transmit the generated information to the traveler's device.

[0106] A "visual device" is a device or display used to visually present tourist information to travelers.

[0107] "Output means" refers to methods and technologies for displaying tourist information to travelers via visual devices.

[0108] "Means of provision" refers to systems or processes for providing dynamic additional information based on the current location.

[0109] The system for carrying out this invention mainly consists of the following components: A device such as smart glasses is used as an input device for entering travel plans. The user can use this device to enter details of their travel plan and receive tourist information about their destination.

[0110] The server stores the entered travel plan information in a storage device and uses information processing means to collect related information. Specifically, it utilizes cloud services such as AWS® Lambda and uses the Google® Places API to obtain data on tourist destinations. Based on this data, it uses a generation AI model (e.g., GPT-4®) as a generation device to generate historical background and characteristics related to tourist destinations.

[0111] The generated tourist information is transmitted via a transmission means to smart glasses, which are output means equipped with a visual device. This visual device visually presents the tourist information to the user, helping them to deepen their understanding of their destination.

[0112] For example, suppose a user wants to find information about Odori Park when visiting Sapporo. When they type "Odori Park" into their smart glasses, the server processes the information and generates data on the park's history, highlights, and recommended visiting times. Finally, this information is presented through the user's visual devices, allowing travelers to easily access detailed tourist information.

[0113] An example of a prompt for the generating AI model would be: "Please describe the historical background and characteristics of the tourist spot entered by the user. Based on this information, please propose an attractive sightseeing plan for visitors. For example, please provide an overview of Odori Park, its history, and recommended visiting times."

[0114] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0115] Step 1:

[0116] The user enters their travel plan using smart glasses. Input is done via voice or eye-tracking and includes information such as destination and itinerary. The entered information is formatted as digital data within the device. The input is voice or eye-tracking data, and the output is formatted travel plan information.

[0117] Step 2:

[0118] The terminal transmits formatted travel plan information to the server using a communication method. The server stores the received data in a storage device. The input is formatted travel plan information, and the output is the data stored in the server's storage device.

[0119] Step 3:

[0120] The server uses information processing tools to collect relevant tourist destination information based on travel plan information obtained from the storage device. It primarily uses the Google Places API to retrieve relevant data and collect detailed information about tourist destinations. The input is travel plan information, and the output is tourist destination information.

[0121] Step 4:

[0122] The server uses a generation AI model (e.g., GPT-4) as a generation device to generate additional historical background and characteristics based on acquired tourist destination information. Prompt statements are provided to the model, and it outputs rich information about the tourist destination. The input is tourist destination information, and the output is the generated detailed information.

[0123] Step 5:

[0124] The server organizes the generated tourist information and transmits it to the terminal using a communication method. The user's smart glasses visually display the received information. The input is the generated detailed information, and the output is the visual data displayed on the smart glasses.

[0125] Step 6:

[0126] Users can view visualized tourist information and adjust their travel plans through smart glasses. Information can be added or regenerated based on user interface interactions. The input is visualized information, and the output is the user's final travel plan.

[0127] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0128] This invention is a tourism information provision system that combines an emotion engine to make the user's travel experience more personal and effective. The emotion engine recognizes the user's emotions in real time and reflects that information in the travel plan, thereby providing a tourism experience tailored to the user's needs.

[0129] Operation of terminal means

[0130] The user enters their travel plan using a device, and the emotion engine registers emotional data collected from the device. The device then sends the entered plan information and the emotional state collected by the emotion engine to the server.

[0131] Server operation

[0132] The server integrates received travel plan information and emotional data, and collects tourist destination information from the database. The generation method uses the tourist destination information, taking emotional data into account, to generate information that is likely to be emotionally interesting to the user, and creates a travel plan tailored to the user's state.

[0133] Operation of communication and display means

[0134] The created travel plan is sent to the user's device via communication. On the device, the plan is displayed visually, and additional information tailored to the user's current mood is also provided. This allows the user to receive more personalized information and enjoy a travel experience that matches their own feelings.

[0135] Specific example

[0136] For example, when a user visits Tokyo, they input their destination on their device, and if the emotion engine recognizes the user's level of excitement, the server uses this data to generate a plan suggesting energetic tourist spots and activities. Conversely, if the emotion engine recognizes that the user is seeking relaxation, the server will provide a plan guiding the user to a quiet park or a traditional tea room.

[0137] Thus, the present invention aims to provide travelers with an experience optimized to their emotions through advanced personalization features utilizing an emotion engine.

[0138] The following describes the processing flow.

[0139] Step 1:

[0140] The user inputs travel destination information using the device. The device collects emotional data through the user's camera and microphone, and an emotion engine analyzes the user's emotional state.

[0141] Step 2:

[0142] The device sends collected travel plans and emotional data to the server. The data sent includes information about planned tourist destinations and the user's emotional state.

[0143] Step 3:

[0144] The server analyzes the received data and retrieves relevant tourist information from external databases and APIs. This information includes details about tourist spots and event information.

[0145] Step 4:

[0146] Based on the results of the emotion engine, the server identifies tourist destinations and activities that match the user's current emotional state. For example, if the user is seeking relaxation, it will suggest quiet, nature-rich locations.

[0147] Step 5:

[0148] The server organizes the generated sightseeing plan, optimizing it to the user's emotions. This plan includes priority settings and visit order, taking into account the user's emotional state.

[0149] Step 6:

[0150] The server uses communication methods to send an optimized sightseeing plan to the terminal. The terminal displays the received plan through its user interface, allowing the user to review it.

[0151] Step 7:

[0152] Users review sightseeing plans on their devices and proceed with their trip based on the presented options. During their visit, the device continues to collect sentiment data, providing feedback to the server if any changes occur, enabling the generation of new plans.

[0153] (Example 2)

[0154] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0155] Traditional tourism information systems have struggled to provide personalized travel experiences tailored to users' emotions. Because they don't consider user feelings, travel plans are often uniform, providing information that doesn't match users' interests or circumstances. This leads to users failing to obtain the experiences they desire, resulting in decreased travel satisfaction.

[0156] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0157] In this invention, the server includes terminal means for inputting travel plans and collecting emotional states; data processing means for integrating travel plan information and emotional data, storing related information in data storage means, and collecting tourist spot information; and generation means including a generation AI model that generates a travel plan suitable for the user's emotional state based on the emotional data and tourist spot information. This makes it possible to quickly and accurately create and propose travel plans based on the user's emotions.

[0158] A "travel plan" is a set of plan information that includes places a user wants to visit and activities they want to do at a specific date and time.

[0159] "Emotional state" refers to data that indicates the user's psychological or emotional state, and can be classified into categories such as joy, excitement, and relaxation.

[0160] "Terminal device" refers to an electronic device used by the user to input travel plans and collect emotional data, such as a smartphone or tablet.

[0161] "Data storage means" refers to storage systems for long-term storage of collected information, and includes servers and cloud databases.

[0162] "Data processing means" refers to a device or software that analyzes input travel plan information and sentiment data, and performs processing to create a tourism plan by integrating related information.

[0163] A "generative AI model" is an artificial intelligence computational method or algorithm for generating personalized travel plans based on user input information and emotional states.

[0164] "Tourist destination information" refers to information about tourist destinations, including their location, characteristics, and available activities, and is data used to improve the user's travel experience.

[0165] The present invention is a tourism information provision system for personalizing the user's travel experience, and comprises terminal means, server means, and communication means.

[0166] First, the user enters their travel plan using a device. This device could be a smartphone or tablet. The device is equipped with an emotion engine, which, for example, uses a camera and sensors to analyze the user's facial expressions and collects emotional data in real time using voice analysis technology. This emotional data includes numerical information indicating the user's psychological state.

[0167] Next, the device transmits the collected travel plan information and sentiment data to a server via a communication method. This communication method can be the internet or a mobile network.

[0168] The server integrates received travel plan information and sentiment data and performs analysis using data processing tools. This process includes matching tourist destination information in the database and extracting relevant information. A generative AI model is used as the generation tool within the server, which generates a travel plan optimized for the user's sentiment based on the integrated data.

[0169] The generated sightseeing plan is sent back to the device via communication. The user's device displays this plan visually. Additional information based on the user's emotional state is also presented on the screen, allowing the user to enjoy their trip.

[0170] For example, if a user is visiting Tokyo and is in an excited state, the generative AI model can suggest a plan that includes lively tourist spots and activities. If the model determines that the user is seeking relaxation, it will suggest a plan that includes visits to quiet gardens or traditional tea rooms.

[0171] Examples of prompt messages include the following:

[0172] "When a user is perceived as being in an excited state while visiting □□ (travel destination), please suggest energetic tourist spots. Also, when perceived as being in a relaxed state, please suggest quiet places."

[0173] This system configuration enables a travel experience optimized to the user's emotions.

[0174] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0175] Step 1:

[0176] The user inputs their travel plan using the device. Specifically, they enter the regions they want to visit and the activities they wish to do into the application. The device also uses built-in sensors to analyze the user's facial expressions and voice, collecting emotional data. The input in this step consists of the user's travel plan information and emotional data, and the output is an integrated summary of this information.

[0177] Step 2:

[0178] The device sends the travel plan information and sentiment data collected in Step 1 to the server. At this time, the data is packaged and encrypted according to a security protocol. The input is the user's integrated information, and the output is the data transfer to the server.

[0179] Step 3:

[0180] The server receives travel plan information and sentiment data and integrates them using data processing tools. Specifically, it compares the received data with a database containing tourist destination information. The input is data received from the terminal, and the output is integrated data including tourist destination information.

[0181] Step 4:

[0182] The AI ​​model on the server generates a travel plan optimized for the user's emotional state based on the integrated data. The AI ​​model selects tourist destinations and activities that match the user's emotions based on prompts. In this step, the input is the server's integrated data, and the output is the generated travel plan.

[0183] Step 5:

[0184] The server transmits the generated sightseeing plan to the terminal via a communication method. The terminal visually displays this plan on the app's user interface and also presents additional information tailored to the user's mood. The input is the generated plan, and the output is the visual display on the terminal.

[0185] Step 6:

[0186] The user reviews the displayed travel plans and selects the one that best matches their emotional state and preferences. This selection allows the user to have a personalized travel experience. The input is the information displayed on the device, and the output is the user's selection.

[0187] (Application Example 2)

[0188] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0189] Providing personalized travel experiences tailored to travelers' emotions is challenging, and traditional information systems struggle to improve user satisfaction. Therefore, there is a need to provide travel plans that reflect users' emotions in real time and meet their diverse needs.

[0190] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0191] In this invention, the server includes a device means for inputting a travel plan, an information processing means for storing the travel plan information in a recording area and collecting related tourist destination information, an information generation means for generating historical information related to the tourist destination, an emotion engine for evaluating the user's emotions, and a control means for dynamically changing the sightseeing plan provided based on the emotion data. This makes it possible to provide personalized sightseeing plans for each user in real time.

[0192] "Device for inputting travel plans" refers to electronic devices or software used by users to input travel planning information.

[0193] "Information processing means for storing travel plan information in a recording area and collecting related tourist destination information" refers to methods and technologies for saving input travel plans to a storage device such as a database and automatically collecting information on related tourist destinations.

[0194] "Information generation means for generating historical information related to tourist destinations" refers to a system for automatically generating and organizing historical background and information related to tourist destinations.

[0195] A "user emotion engine" is a technology or software that analyzes and evaluates a user's emotional state from data acquired using a device.

[0196] "A control mechanism for dynamically changing sightseeing plans based on emotional data" refers to a system for adjusting and updating sightseeing plans in real time based on the user's emotional data.

[0197] The system for implementing the present invention provides personalized sightseeing plans that respond to the traveler's emotions, and mainly consists of the following components.

[0198] The terminal functions as a device for inputting travel plans, providing an interface for users to input the tourist destinations they wish to visit and the activities they desire. Furthermore, hardware utilizing a camera and microphone collects the user's facial expressions and voice tone, and runs an emotion engine to evaluate their emotional state. This employs facial recognition technology and AI for emotion analysis. Specific examples include the OpenCV library and the Emotion Analysis API.

[0199] The server stores travel plan information and emotional data transmitted from the terminal in a storage area and collects tourist destination information using information processing tools. This integrates available tourist destination information with the traveler's emotional state, and a generative AI model is used to generate a travel plan best suited to the user's emotions. The travel plan is dynamically modified according to the user's emotions. For example, if the user is rated as "excited," the plan will suggest energetic tourist destinations optimized for that emotion.

[0200] The created sightseeing plan is sent back to the device via the communication network and displayed visually on the device. This allows users to receive information that best suits their mood in real time.

[0201] As a concrete example, suppose a user selects a virtual trip and chooses "Tokyo" as their destination, and the server determines that the user's emotional state is one of "relaxation." In this case, the server generates a sightseeing plan suggesting quiet and peaceful spots, such as a "quiet park" or a "traditional tea house," and provides it to the user.

[0202] An example of a prompt for a generative AI model is, "How should the scenery change if the user is feeling down?" By using this prompt, the AI ​​model makes the necessary decisions to generate a sightseeing plan that provides the user with the best possible experience.

[0203] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0204] Step 1:

[0205] The terminal provides an interface for users to input their travel plans. At this stage, users enter the places they want to visit and the activities they wish to do, and save this information on the terminal as travel plan data. The input data includes the user's selections and travel itinerary.

[0206] Step 2:

[0207] The device uses its built-in camera and microphone to collect the user's facial expressions and voice in real time. This activates an emotion engine, which uses the acquired data to evaluate the user's emotional state. In this process, facial recognition technology and emotion analysis AI are used to generate emotion data from facial features and voice tone.

[0208] Step 3:

[0209] The travel plan information and sentiment data collected by the terminal are sent to the server. The server stores this data in its storage area and retrieves relevant tourist destination information from its database. Based on the travel plan information and sentiment data as input, it obtains a result that combines relevant tourist destinations and their attribute information.

[0210] Step 4:

[0211] The server utilizes a generative AI model to generate specific travel plans based on sentiment data and tourist destination information. A prompt such as "How should the scenery change if the user is feeling down?" may be used. The AI ​​model analyzes the input data and selects the most suitable tourist spots and activities.

[0212] Step 5:

[0213] The generated travel plan is transmitted to the device via a communication network. The device visually displays this data on its interface, providing the user with a personalized travel experience. The device controls how the generated plan is presented to the user and also provides additional suggestions and information tailored to their emotions.

[0214] Step 6:

[0215] Users can make decisions about their actual actions based on what is displayed on their device and enjoy sightseeing. This enables a flexible travel experience that responds to the user's real-time emotions.

[0216] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0217] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0218] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0219] [Second Embodiment]

[0220] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0221] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0222] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0223] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0224] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0225] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0226] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0227] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0228] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0229] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0230] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0231] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0232] The present invention is a tourism information provision system comprising terminal means for travelers to input information, server means for storing and processing information, and communication means for transmitting information. This allows travelers to obtain detailed information about tourist destinations they plan to visit and to plan their trips efficiently.

[0233] Operation of terminal means

[0234] The user uses a terminal to input their travel plan, which includes information such as the names of tourist destinations and dates to be visited. The terminal verifies the input data and formats it into a format that the server can process. The formatted information is then sent to the server via a communication method.

[0235] Server operation

[0236] Based on the received travel plan information, the server automatically collects relevant tourist spots and their historical information from external databases and APIs. Using the collected information, it generates additional information about the historical background and characteristics of the tourist destinations. The generated information is then organized into a travel plan tailored to the user's itinerary.

[0237] Operation of communication and display means

[0238] The organized sightseeing plan is sent from the server to the user's terminal via a communication method. The terminal visually displays the received information, allowing the user to review and adjust it.

[0239] Specific example

[0240] For example, if a user plans a visit to Kyoto using their device, the server generates historical information about Kinkaku-ji Temple and Arashiyama. It also analyzes the congestion levels at each tourist spot and provides a sightseeing plan suggesting the optimal visiting times. This allows users to gain in-depth knowledge about their destinations while also enjoying sightseeing efficiently and avoiding crowds.

[0241] Thus, the present invention provides tourists with a fulfilling travel experience by enabling the automatic generation of tourist information and the efficient presentation of travel plans.

[0242] The following describes the processing flow.

[0243] Step 1:

[0244] The user accesses the travel website using their device and enters the names of the tourist destinations they plan to visit and their travel dates. The device verifies the entered information and confirms that the data format is correct.

[0245] Step 2:

[0246] The terminal sends formatted travel schedule information to the server. The server receives the information and stores it in its database.

[0247] Step 3:

[0248] Based on the stored information, the server retrieves relevant tourist spot information and congestion status from external APIs and databases.

[0249] Step 4:

[0250] Based on the acquired tourist destination information, the server uses generation methods to create new information that includes details about historical background and location.

[0251] Step 5:

[0252] The server analyzes the generated information and optimizes sightseeing plans based on congestion data. It also provides suggestions regarding the order and timing of visits.

[0253] Step 6:

[0254] The server sends an optimized sightseeing plan to the user's terminal using a communication method. The terminal then visually displays the received plan on its user interface.

[0255] Step 7:

[0256] Users can review the displayed sightseeing plan and adjust their schedule as needed. Upon arriving at their destination, they can use their device to obtain further local information and enhance their travel experience.

[0257] (Example 1)

[0258] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0259] Traditional tourism information systems require users to manually search for information and plan their trips, which is time-consuming and laborious. Furthermore, it's difficult to create optimal travel plans that take into account the congestion levels at tourist destinations, sometimes resulting in unsatisfactory travel experiences for users.

[0260] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0261] In this invention, the server includes means for inputting travel plans and formatting the data into a processable format; data processing means for storing travel plan information and collecting relevant tourist information from external sources; and generation means for generating detailed historical and tourist information using a generation AI model based on the collected information. This enables users to efficiently obtain tourist information through an automated process and create optimal travel plans that avoid crowds.

[0262] A "travel plan" is a plan that includes information about the tourist destinations and itinerary that the user will visit.

[0263] A "terminal" refers to hardware or software that allows a user to input information and visually confirm that information.

[0264] "Data processing means" refers to a function that stores received data and performs the process of collecting relevant information from external sources.

[0265] A "generative AI model" refers to an algorithm or program that uses artificial intelligence to generate new information and provide detailed information.

[0266] "Generative means" refers to the process or function of creating new information based on collected data.

[0267] "Communication methods" refer to network systems and protocols used to transmit information from a server to a terminal, or vice versa.

[0268] "Means of visual display" refers to a function that displays received information on a device in a format that the user can understand.

[0269] "Crowding" refers to an indicator or state that shows the number and density of visitors in a tourist destination.

[0270] "Optimal visiting time" refers to the recommended timing for a visit, after adjusting the time of day and schedule, to ensure users can enjoy sightseeing smoothly.

[0271] This invention is an information provision system that enables travelers to have a more efficient and satisfying sightseeing experience. This system consists of a terminal, a server, and communication means.

[0272] Terminal operation

[0273] Users input their travel plans using their personal devices. Specifically, they enter information such as tourist attractions at their destination and their itinerary. This device converts the requested information into a format that can be processed by the server. The device then verifies this data and sends the formatted information to the server via communication.

[0274] Server operation

[0275] The server accesses external information sources based on the received travel plan data and collects interesting tourism information. Information collection includes, for example, detailed information about tourist destinations, congestion status, and historical backgrounds. Additionally, a generative AI model is used to generate additional detailed content based on the collected information. This generative AI model features algorithms that analyze data obtained from historical databases and tourism APIs to make predictions.

[0276] Operation of communication means

[0277] Once the generated information is organized and constructed as a tourism plan, it is transmitted to the terminal via a communication network.

[0278] Visual display

[0279] The terminal visually displays the received tourism plan to the user, enabling the user to intuitively confirm the information and make adjustments as needed.

[0280] Specific example

[0281] For example, when the user makes a travel plan to Kyoto, the server generates detailed historical information and tourism information about Kinkaku-ji Temple and Arashiyama. Additionally, based on the congestion status of each tourist destination, it provides a tourism plan that proposes the optimal time to visit. This enables the user to gain a deep understanding of the destinations and achieve efficient tourism.

[0282] Example of a prompt sentence for the generative AI model [[ID=ID=29]]

[0283] "Please propose a visit plan based on detailed historical information and congestion status of tourist destinations in Kyoto."

[0284] The flow of specific processing in Example 1 will be described using FIG. 11.

[0285] Step 1:

[0286] The user uses the terminal to input the basic information of the travel plan. The input includes tourist destination names and visit schedules at the travel destination. The terminal formats these input data into a standardized form and prepares to send them to the server. Specific operations include unifying the freely described tourist destination names into a specific data format. After being formatted, the input data is sent to the server through the communication means.

[0287] Step 2:

[0288] The server receives the travel plan information sent from the terminal. It analyzes this received data and identifies the categories of necessary information (e.g., history, geography, event information). Next, the server accesses external information sources (databases and APIs) to collect relevant tourist information. Specific examples include the historical information of tourist destinations and the event information of the schedule to be visited. The collected data is used as the input for the generated AI model.

[0289] Step 3:

[0290] The server sends a prompt to the generated AI model using the collected information. By giving a prompt sentence such as "Please provide detailed historical information about tourist destinations in Kyoto" to the generated AI model, detailed information about specific tourist destinations is generated. The generated information becomes the basic data for creating a tourist plan and further serves as the basis for providing customized information for each user.

[0291] Step 4:

[0292] The server creates a tourist plan according to the user's request based on the generated information. At this time, the generated information also includes congestion prediction of tourist destinations and the optimal visit time. The server organizes this information and converts it into a user-friendly form. The output is a tourist plan with recommended visit order and time allocation.

[0293] Step 5:

[0294] The server transmits the final created sightseeing plan to the terminal via a communication method. The terminal receives this information and displays it visually to the user. The user can review the displayed information and adjust the visiting times and order as needed. This makes it easier for the user to plan their actual trip.

[0295] (Application Example 1)

[0296] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0297] Conventional tourism information systems have made it difficult for travelers to efficiently create travel plans and easily obtain detailed information about their intended destinations. Furthermore, the lack of real-time additional information provision at the destination limited the convenience for travelers. This invention aims to solve these problems and provide a system that allows travelers to enjoy sightseeing more effectively.

[0298] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0299] In this invention, the server includes an input device means for inputting travel plans, an information processing means for storing travel plan information in a storage device and collecting related tourist destination information, a generation device means for generating historical information related to tourist destinations, and an output means for presenting tourist information to tourists using a visual device. This makes it possible for travelers to quickly obtain detailed information and recommended sightseeing plans for their planned destinations, thereby improving their sightseeing experience at the location.

[0300] "Input device means" refers to a device or interface used by travelers to input their travel plans.

[0301] A "storage device" refers to a database or storage system used to save travel plan information.

[0302] The "information processing means" is a process or method for organizing and analyzing the collected tourist destination information.

[0303] The "generation device means" is a system or component for generating historical information and additional information related to tourist destinations.

[0304] The "transmission means" is a network or communication technology for transmitting the generated information to the traveler's device.

[0305] The "visual device" is a device or display for visually presenting tourist information to travelers.

[0306] The "output means" is a method or technology for displaying tourist information to travelers via the visual device.

[0307] The "provision means" is a system or process for providing dynamic additional information based on the current location.

[0308] The system for implementing this invention mainly consists of the following components. As an input device means for inputting a travel plan, a device such as smart glasses is used. The user can use this device to input the details of the travel plan and receive tourist information about the travel destination.

[0309] The server stores the input travel plan information in the storage device and uses the information processing means to collect relevant information. Specifically, cloud services such as AWS Lambda are utilized, and the Google Places API is used to obtain data related to tourist destinations. Based on this data, a generation AI model (e.g., GPT-4) as the generation device means is used to generate the historical background and features related to tourist destinations.

[0310] The generated tourist information is transmitted through the transmission means to the smart glasses, which are the output means equipped with a visual device. This visual device visually presents tourist information to the user and helps deepen the understanding of the visited place.

[0311] For example, suppose a user wants to find information about Odori Park when visiting Sapporo. When they type "Odori Park" into their smart glasses, the server processes the information and generates data on the park's history, highlights, and recommended visiting times. Finally, this information is presented through the user's visual devices, allowing travelers to easily access detailed tourist information.

[0312] An example of a prompt for the generating AI model would be: "Please describe the historical background and characteristics of the tourist spot entered by the user. Based on this information, please propose an attractive sightseeing plan for visitors. For example, please provide an overview of Odori Park, its history, and recommended visiting times."

[0313] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0314] Step 1:

[0315] The user enters their travel plan using smart glasses. Input is done via voice or eye-tracking and includes information such as destination and itinerary. The entered information is formatted as digital data within the device. The input is voice or eye-tracking data, and the output is formatted travel plan information.

[0316] Step 2:

[0317] The terminal transmits formatted travel plan information to the server using a communication method. The server stores the received data in a storage device. The input is formatted travel plan information, and the output is the data stored in the server's storage device.

[0318] Step 3:

[0319] The server uses information processing tools to collect relevant tourist destination information based on travel plan information obtained from the storage device. It primarily uses the Google Places API to retrieve relevant data and collect detailed information about tourist destinations. The input is travel plan information, and the output is tourist destination information.

[0320] Step 4:

[0321] The server uses a generation AI model (e.g., GPT-4) as a generation device to generate additional historical background and characteristics based on acquired tourist destination information. Prompt statements are provided to the model, and it outputs rich information about the tourist destination. The input is tourist destination information, and the output is the generated detailed information.

[0322] Step 5:

[0323] The server organizes the generated tourist information and transmits it to the terminal using a communication method. The user's smart glasses visually display the received information. The input is the generated detailed information, and the output is the visual data displayed on the smart glasses.

[0324] Step 6:

[0325] Users can view visualized tourist information and adjust their travel plans through smart glasses. Information can be added or regenerated based on user interface interactions. The input is visualized information, and the output is the user's final travel plan.

[0326] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0327] This invention is a tourism information provision system that combines an emotion engine to make the user's travel experience more personal and effective. The emotion engine recognizes the user's emotions in real time and reflects that information in the travel plan, thereby providing a tourism experience tailored to the user's needs.

[0328] Operation of terminal means

[0329] The user enters their travel plan using a device, and the emotion engine registers emotional data collected from the device. The device then sends the entered plan information and the emotional state collected by the emotion engine to the server.

[0330] Server operation

[0331] The server integrates received travel plan information and emotional data, and collects tourist destination information from the database. The generation method uses the tourist destination information, taking emotional data into account, to generate information that is likely to be emotionally interesting to the user, and creates a travel plan tailored to the user's state.

[0332] Operation of communication and display means

[0333] The created travel plan is sent to the user's device via communication. On the device, the plan is displayed visually, and additional information tailored to the user's current mood is also provided. This allows the user to receive more personalized information and enjoy a travel experience that matches their own feelings.

[0334] Specific example

[0335] For example, when a user visits Tokyo, they input their destination on their device, and if the emotion engine recognizes the user's level of excitement, the server uses this data to generate a plan suggesting energetic tourist spots and activities. Conversely, if the emotion engine recognizes that the user is seeking relaxation, the server will provide a plan guiding the user to a quiet park or a traditional tea room.

[0336] Thus, the present invention aims to provide travelers with an experience optimized to their emotions through advanced personalization features utilizing an emotion engine.

[0337] The following describes the processing flow.

[0338] Step 1:

[0339] The user inputs travel destination information using the device. The device collects emotional data through the user's camera and microphone, and an emotion engine analyzes the user's emotional state.

[0340] Step 2:

[0341] The device sends collected travel plans and emotional data to the server. The data sent includes information about planned tourist destinations and the user's emotional state.

[0342] Step 3:

[0343] The server analyzes the received data and retrieves relevant tourist information from external databases and APIs. This information includes details about tourist spots and event information.

[0344] Step 4:

[0345] Based on the results of the emotion engine, the server identifies tourist destinations and activities that match the user's current emotional state. For example, if the user is seeking relaxation, it will suggest quiet, nature-rich locations.

[0346] Step 5:

[0347] The server organizes the generated sightseeing plan, optimizing it to the user's emotions. This plan includes priority settings and visit order, taking into account the user's emotional state.

[0348] Step 6:

[0349] The server uses communication methods to send an optimized sightseeing plan to the terminal. The terminal displays the received plan through its user interface, allowing the user to review it.

[0350] Step 7:

[0351] Users review sightseeing plans on their devices and proceed with their trip based on the presented options. During their visit, the device continues to collect sentiment data, providing feedback to the server if any changes occur, enabling the generation of new plans.

[0352] (Example 2)

[0353] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0354] Traditional tourism information systems have struggled to provide personalized travel experiences tailored to users' emotions. Because they don't consider user feelings, travel plans are often uniform, providing information that doesn't match users' interests or circumstances. This leads to users failing to obtain the experiences they desire, resulting in decreased travel satisfaction.

[0355] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0356] In this invention, the server includes terminal means for inputting travel plans and collecting emotional states; data processing means for integrating travel plan information and emotional data, storing related information in data storage means, and collecting tourist spot information; and generation means including a generation AI model that generates a travel plan suitable for the user's emotional state based on the emotional data and tourist spot information. This makes it possible to quickly and accurately create and propose travel plans based on the user's emotions.

[0357] A "travel plan" is a set of plan information that includes places a user wants to visit and activities they want to do at a specific date and time.

[0358] "Emotional state" refers to data that indicates the user's psychological or emotional state, and can be classified into categories such as joy, excitement, and relaxation.

[0359] "Terminal device" refers to an electronic device used by the user to input travel plans and collect emotional data, such as a smartphone or tablet.

[0360] "Data storage means" refers to storage systems for long-term storage of collected information, and includes servers and cloud databases.

[0361] "Data processing means" refers to a device or software that analyzes input travel plan information and sentiment data, and performs processing to create a tourism plan by integrating related information.

[0362] A "generative AI model" is an artificial intelligence computational method or algorithm for generating personalized travel plans based on user input information and emotional states.

[0363] "Tourist destination information" refers to information about tourist destinations, including their location, characteristics, and available activities, and is data used to improve the user's travel experience.

[0364] The present invention is a tourism information provision system for personalizing the user's travel experience, and comprises terminal means, server means, and communication means.

[0365] First, the user enters their travel plan using a device. This device could be a smartphone or tablet. The device is equipped with an emotion engine, which, for example, uses a camera and sensors to analyze the user's facial expressions and collects emotional data in real time using voice analysis technology. This emotional data includes numerical information indicating the user's psychological state.

[0366] Next, the device transmits the collected travel plan information and sentiment data to a server via a communication method. This communication method can be the internet or a mobile network.

[0367] The server integrates received travel plan information and sentiment data and performs analysis using data processing tools. This process includes matching tourist destination information in the database and extracting relevant information. A generative AI model is used as the generation tool within the server, which generates a travel plan optimized for the user's sentiment based on the integrated data.

[0368] The generated sightseeing plan is sent back to the device via communication. The user's device displays this plan visually. Additional information based on the user's emotional state is also presented on the screen, allowing the user to enjoy their trip.

[0369] For example, if a user is visiting Tokyo and is in an excited state, the generative AI model can suggest a plan that includes lively tourist spots and activities. If the model determines that the user is seeking relaxation, it will suggest a plan that includes visits to quiet gardens or traditional tea rooms.

[0370] Examples of prompt messages include the following:

[0371] "When a user is perceived as being in an excited state while visiting □□ (travel destination), please suggest energetic tourist spots. Also, when perceived as being in a relaxed state, please suggest quiet places."

[0372] This system configuration enables a travel experience optimized to the user's emotions.

[0373] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0374] Step 1:

[0375] The user inputs their travel plan using the device. Specifically, they enter the regions they want to visit and the activities they wish to do into the application. The device also uses built-in sensors to analyze the user's facial expressions and voice, collecting emotional data. The input in this step consists of the user's travel plan information and emotional data, and the output is an integrated summary of this information.

[0376] Step 2:

[0377] The device sends the travel plan information and sentiment data collected in Step 1 to the server. At this time, the data is packaged and encrypted according to a security protocol. The input is the user's integrated information, and the output is the data transfer to the server.

[0378] Step 3:

[0379] The server receives travel plan information and sentiment data and integrates them using data processing tools. Specifically, it compares the received data with a database containing tourist destination information. The input is data received from the terminal, and the output is integrated data including tourist destination information.

[0380] Step 4:

[0381] The AI ​​model on the server generates a travel plan optimized for the user's emotional state based on the integrated data. The AI ​​model selects tourist destinations and activities that match the user's emotions based on prompts. In this step, the input is the server's integrated data, and the output is the generated travel plan.

[0382] Step 5:

[0383] The server transmits the generated sightseeing plan to the terminal via a communication method. The terminal visually displays this plan on the app's user interface and also presents additional information tailored to the user's mood. The input is the generated plan, and the output is the visual display on the terminal.

[0384] Step 6:

[0385] The user reviews the displayed travel plans and selects the one that best matches their emotional state and preferences. This selection allows the user to have a personalized travel experience. The input is the information displayed on the device, and the output is the user's selection.

[0386] (Application Example 2)

[0387] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0388] Providing personalized travel experiences tailored to travelers' emotions is challenging, and traditional information systems struggle to improve user satisfaction. Therefore, there is a need to provide travel plans that reflect users' emotions in real time and meet their diverse needs.

[0389] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0390] In this invention, the server includes a device means for inputting a travel plan, an information processing means for storing the travel plan information in a recording area and collecting related tourist destination information, an information generation means for generating historical information related to the tourist destination, an emotion engine for evaluating the user's emotions, and a control means for dynamically changing the sightseeing plan provided based on the emotion data. This makes it possible to provide personalized sightseeing plans for each user in real time.

[0391] "Device for inputting travel plans" refers to electronic devices or software used by users to input travel planning information.

[0392] "Information processing means for storing travel plan information in a recording area and collecting related tourist destination information" refers to methods and technologies for saving input travel plans to a storage device such as a database and automatically collecting information on related tourist destinations.

[0393] "Information generation means for generating historical information related to tourist destinations" refers to a system for automatically generating and organizing historical background and information related to tourist destinations.

[0394] A "user emotion engine" is a technology or software that analyzes and evaluates a user's emotional state from data acquired using a device.

[0395] "A control mechanism for dynamically changing sightseeing plans based on emotional data" refers to a system for adjusting and updating sightseeing plans in real time based on the user's emotional data.

[0396] The system for implementing the present invention provides personalized sightseeing plans that respond to the traveler's emotions, and mainly consists of the following components.

[0397] The terminal functions as a device for inputting travel plans, providing an interface for users to input the tourist destinations they wish to visit and the activities they desire. Furthermore, hardware utilizing a camera and microphone collects the user's facial expressions and voice tone, and runs an emotion engine to evaluate their emotional state. This employs facial recognition technology and AI for emotion analysis. Specific examples include the OpenCV library and the Emotion Analysis API.

[0398] The server stores travel plan information and emotional data transmitted from the terminal in a storage area and collects tourist destination information using information processing tools. This integrates available tourist destination information with the traveler's emotional state, and a generative AI model is used to generate a travel plan best suited to the user's emotions. The travel plan is dynamically modified according to the user's emotions. For example, if the user is rated as "excited," the plan will suggest energetic tourist destinations optimized for that emotion.

[0399] The created sightseeing plan is sent back to the device via the communication network and displayed visually on the device. This allows users to receive information that best suits their mood in real time.

[0400] As a concrete example, suppose a user selects a virtual trip and chooses "Tokyo" as their destination, and the server determines that the user's emotional state is one of "relaxation." In this case, the server generates a sightseeing plan suggesting quiet and peaceful spots, such as a "quiet park" or a "traditional tea house," and provides it to the user.

[0401] An example of a prompt for a generative AI model is, "How should the scenery change if the user is feeling down?" By using this prompt, the AI ​​model makes the necessary decisions to generate a sightseeing plan that provides the user with the best possible experience.

[0402] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0403] Step 1:

[0404] The terminal provides an interface for users to input their travel plans. At this stage, users enter the places they want to visit and the activities they wish to do, and save this information on the terminal as travel plan data. The input data includes the user's selections and travel itinerary.

[0405] Step 2:

[0406] The device uses its built-in camera and microphone to collect the user's facial expressions and voice in real time. This activates an emotion engine, which uses the acquired data to evaluate the user's emotional state. In this process, facial recognition technology and emotion analysis AI are used to generate emotion data from facial features and voice tone.

[0407] Step 3:

[0408] The travel plan information and sentiment data collected by the terminal are sent to the server. The server stores this data in its storage area and retrieves relevant tourist destination information from its database. Based on the travel plan information and sentiment data as input, it obtains a result that combines relevant tourist destinations and their attribute information.

[0409] Step 4:

[0410] The server utilizes a generative AI model to generate specific travel plans based on sentiment data and tourist destination information. A prompt such as "How should the scenery change if the user is feeling down?" may be used. The AI ​​model analyzes the input data and selects the most suitable tourist spots and activities.

[0411] Step 5:

[0412] The generated travel plan is transmitted to the device via a communication network. The device visually displays this data on its interface, providing the user with a personalized travel experience. The device controls how the generated plan is presented to the user and also provides additional suggestions and information tailored to their emotions.

[0413] Step 6:

[0414] Users can make decisions about their actual actions based on what is displayed on their device and enjoy sightseeing. This enables a flexible travel experience that responds to the user's real-time emotions.

[0415] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0416] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0417] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0418] [Third Embodiment]

[0419] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0420] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0421] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0422] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0423] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0424] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0425] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0426] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0427] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0428] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0429] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0430] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0431] The present invention is a tourism information provision system comprising terminal means for travelers to input information, server means for storing and processing information, and communication means for transmitting information. This allows travelers to obtain detailed information about tourist destinations they plan to visit and to plan their trips efficiently.

[0432] Operation of terminal means

[0433] The user uses a terminal to input their travel plan, which includes information such as the names of tourist destinations and dates to be visited. The terminal verifies the input data and formats it into a format that the server can process. The formatted information is then sent to the server via a communication method.

[0434] Server operation

[0435] Based on the received travel plan information, the server automatically collects relevant tourist spots and their historical information from external databases and APIs. Using the collected information, it generates additional information about the historical background and characteristics of the tourist destinations. The generated information is then organized into a travel plan tailored to the user's itinerary.

[0436] Operation of communication and display means

[0437] The organized sightseeing plan is sent from the server to the user's terminal via a communication method. The terminal visually displays the received information, allowing the user to review and adjust it.

[0438] Specific example

[0439] For example, if a user plans a visit to Kyoto using their device, the server generates historical information about Kinkaku-ji Temple and Arashiyama. It also analyzes the congestion levels at each tourist spot and provides a sightseeing plan suggesting the optimal visiting times. This allows users to gain in-depth knowledge about their destinations while also enjoying sightseeing efficiently and avoiding crowds.

[0440] Thus, the present invention provides tourists with a fulfilling travel experience by enabling the automatic generation of tourist information and the efficient presentation of travel plans.

[0441] The following describes the processing flow.

[0442] Step 1:

[0443] The user accesses the travel website using their device and enters the names of the tourist destinations they plan to visit and their travel dates. The device verifies the entered information and confirms that the data format is correct.

[0444] Step 2:

[0445] The terminal sends formatted travel schedule information to the server. The server receives the information and stores it in its database.

[0446] Step 3:

[0447] Based on the stored information, the server retrieves relevant tourist spot information and congestion status from external APIs and databases.

[0448] Step 4:

[0449] Based on the acquired tourist destination information, the server uses generation methods to create new information that includes details about historical background and location.

[0450] Step 5:

[0451] The server analyzes the generated information and optimizes sightseeing plans based on congestion data. It also provides suggestions regarding the order and timing of visits.

[0452] Step 6:

[0453] The server sends an optimized sightseeing plan to the user's terminal using a communication method. The terminal then visually displays the received plan on its user interface.

[0454] Step 7:

[0455] Users can review the displayed sightseeing plan and adjust their schedule as needed. Upon arriving at their destination, they can use their device to obtain further local information and enhance their travel experience.

[0456] (Example 1)

[0457] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0458] Traditional tourism information systems require users to manually search for information and plan their trips, which is time-consuming and laborious. Furthermore, it's difficult to create optimal travel plans that take into account the congestion levels at tourist destinations, sometimes resulting in unsatisfactory travel experiences for users.

[0459] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0460] In this invention, the server includes means for inputting travel plans and formatting the data into a processable format; data processing means for storing travel plan information and collecting relevant tourist information from external sources; and generation means for generating detailed historical and tourist information using a generation AI model based on the collected information. This enables users to efficiently obtain tourist information through an automated process and create optimal travel plans that avoid crowds.

[0461] A "travel plan" is a plan that includes information about the tourist destinations and itinerary that the user will visit.

[0462] A "terminal" refers to hardware or software that allows a user to input information and visually confirm that information.

[0463] "Data processing means" refers to a function that stores received data and performs the process of collecting relevant information from external sources.

[0464] A "generative AI model" refers to an algorithm or program that uses artificial intelligence to generate new information and provide detailed information.

[0465] "Generative means" refers to the process or function of creating new information based on collected data.

[0466] "Communication methods" refer to network systems and protocols used to transmit information from a server to a terminal, or vice versa.

[0467] "Means of visual display" refers to a function that displays received information on a device in a format that the user can understand.

[0468] "Crowding" refers to an indicator or state that shows the number and density of visitors in a tourist destination.

[0469] "Optimal visiting time" refers to the recommended timing for a visit, after adjusting the time of day and schedule, to ensure users can enjoy sightseeing smoothly.

[0470] This invention is an information provision system that enables travelers to have a more efficient and satisfying sightseeing experience. This system consists of a terminal, a server, and communication means.

[0471] Terminal operation

[0472] Users input their travel plans using their personal devices. Specifically, they enter information such as tourist attractions at their destination and their itinerary. This device converts the requested information into a format that can be processed by the server. The device then verifies this data and sends the formatted information to the server via communication.

[0473] Server operation

[0474] The server accesses external information sources based on received travel plan data to collect interesting tourist information. This information collection includes, for example, detailed information about tourist destinations, crowd levels, and historical background. It also uses a generative AI model to generate additional detailed content based on the collected information. This generative AI model features algorithms that analyze data obtained from historical databases and tourism APIs to make predictions.

[0475] Operation of communication means

[0476] Once the generated information is organized and compiled into a travel plan, it is transmitted to the terminal via a communication network.

[0477] Visual display

[0478] The terminal visually displays the received sightseeing plan to the user, allowing them to intuitively check the information and make adjustments as needed.

[0479] Specific example

[0480] For example, if a user plans a trip to Kyoto, the server generates detailed historical and tourist information about places like Kinkaku-ji Temple and Arashiyama. It also provides a sightseeing plan suggesting the optimal time to visit each location based on its congestion levels. This allows users to gain a deeper understanding of their destinations and achieve more efficient sightseeing.

[0481] Examples of prompts for generative AI models

[0482] "Please propose a sightseeing plan for Kyoto's tourist attractions based on detailed historical information and crowd levels."

[0483] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0484] Step 1:

[0485] The user uses a terminal to input basic information about their travel plan. This input includes the names of tourist attractions and the itinerary. The terminal formats this input data into a standardized format and prepares it for transmission to the server. Specifically, this involves unifying freely written tourist attraction names into a specific data format. After formatting, the input data is sent to the server via a communication method.

[0486] Step 2:

[0487] The server receives travel plan information sent from the terminal. It analyzes this received data to identify the necessary information categories (e.g., history, geography, events). Next, the server accesses external information sources (databases or APIs) to collect relevant tourism information. Examples include historical information about tourist destinations and event information for the planned travel dates. This collected data is then used as input for the generated AI model.

[0488] Step 3:

[0489] The server uses the collected information to send prompts to the generative AI model. By providing the generative AI model with prompts such as "Please provide detailed historical information about tourist spots in Kyoto," it generates detailed information about specific tourist spots. The generated information becomes the basic data for creating travel plans and also forms the basis for providing customized information to each user.

[0490] Step 4:

[0491] The server creates a sightseeing plan tailored to the user's requests based on the generated information. This information includes predicted crowd levels at tourist spots and optimal visiting times. The server organizes this information and converts it into a user-friendly format. The output is a sightseeing plan with recommended visiting order and time allocation.

[0492] Step 5:

[0493] The server transmits the final created sightseeing plan to the terminal via a communication method. The terminal receives this information and displays it visually to the user. The user can review the displayed information and adjust the visiting times and order as needed. This makes it easier for the user to plan their actual trip.

[0494] (Application Example 1)

[0495] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0496] Conventional tourism information systems have made it difficult for travelers to efficiently create travel plans and easily obtain detailed information about their intended destinations. Furthermore, the lack of real-time additional information provision at the destination limited the convenience for travelers. This invention aims to solve these problems and provide a system that allows travelers to enjoy sightseeing more effectively.

[0497] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0498] In this invention, the server includes an input device means for inputting travel plans, an information processing means for storing travel plan information in a storage device and collecting related tourist destination information, a generation device means for generating historical information related to tourist destinations, and an output means for presenting tourist information to tourists using a visual device. This makes it possible for travelers to quickly obtain detailed information and recommended sightseeing plans for their planned destinations, thereby improving their sightseeing experience at the location.

[0499] "Input device means" refers to a device or interface used by travelers to input their travel plans.

[0500] A "storage device" refers to a database or storage system used to save travel plan information.

[0501] "Information processing means" refers to the processes and methods for organizing and analyzing collected tourist destination information.

[0502] "Generation device means" refers to a system or component for generating historical information and additional information related to tourist destinations.

[0503] "Transmission means" refers to the network and communication technology used to transmit the generated information to the traveler's device.

[0504] A "visual device" is a device or display used to visually present tourist information to travelers.

[0505] "Output means" refers to methods and technologies for displaying tourist information to travelers via visual devices.

[0506] "Means of provision" refers to systems or processes for providing dynamic additional information based on the current location.

[0507] The system for carrying out this invention mainly consists of the following components: A device such as smart glasses is used as an input device for entering travel plans. The user can use this device to enter details of their travel plan and receive tourist information about their destination.

[0508] The server stores the entered travel plan information in a storage device and uses information processing means to collect related information. Specifically, it utilizes cloud services such as AWS Lambda and uses the Google Places API to obtain data on tourist destinations. Based on this data, it uses a generation AI model (e.g., GPT-4) as a generation device to generate historical background and characteristics related to the tourist destinations.

[0509] The generated tourist information is transmitted via a transmission means to smart glasses, which are output means equipped with a visual device. This visual device visually presents the tourist information to the user, helping them to deepen their understanding of their destination.

[0510] For example, suppose a user wants to find information about Odori Park when visiting Sapporo. When they type "Odori Park" into their smart glasses, the server processes the information and generates data on the park's history, highlights, and recommended visiting times. Finally, this information is presented through the user's visual devices, allowing travelers to easily access detailed tourist information.

[0511] An example of a prompt for the generating AI model would be: "Please describe the historical background and characteristics of the tourist spot entered by the user. Based on this information, please propose an attractive sightseeing plan for visitors. For example, please provide an overview of Odori Park, its history, and recommended visiting times."

[0512] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0513] Step 1:

[0514] The user enters their travel plan using smart glasses. Input is done via voice or eye-tracking and includes information such as destination and itinerary. The entered information is formatted as digital data within the device. The input is voice or eye-tracking data, and the output is formatted travel plan information.

[0515] Step 2:

[0516] The terminal transmits formatted travel plan information to the server using a communication method. The server stores the received data in a storage device. The input is formatted travel plan information, and the output is the data stored in the server's storage device.

[0517] Step 3:

[0518] The server uses information processing tools to collect relevant tourist destination information based on travel plan information obtained from the storage device. It primarily uses the Google Places API to retrieve relevant data and collect detailed information about tourist destinations. The input is travel plan information, and the output is tourist destination information.

[0519] Step 4:

[0520] The server uses a generation AI model (e.g., GPT-4) as a generation device to generate additional historical background and characteristics based on acquired tourist destination information. Prompt statements are provided to the model, and it outputs rich information about the tourist destination. The input is tourist destination information, and the output is the generated detailed information.

[0521] Step 5:

[0522] The server organizes the generated tourist information and transmits it to the terminal using a communication method. The user's smart glasses visually display the received information. The input is the generated detailed information, and the output is the visual data displayed on the smart glasses.

[0523] Step 6:

[0524] Users can view visualized tourist information and adjust their travel plans through smart glasses. Information can be added or regenerated based on user interface interactions. The input is visualized information, and the output is the user's final travel plan.

[0525] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0526] This invention is a tourism information provision system that combines an emotion engine to make the user's travel experience more personal and effective. The emotion engine recognizes the user's emotions in real time and reflects that information in the travel plan, thereby providing a tourism experience tailored to the user's needs.

[0527] Operation of terminal means

[0528] The user enters their travel plan using a device, and the emotion engine registers emotional data collected from the device. The device then sends the entered plan information and the emotional state collected by the emotion engine to the server.

[0529] Server operation

[0530] The server integrates received travel plan information and emotional data, and collects tourist destination information from the database. The generation method uses the tourist destination information, taking emotional data into account, to generate information that is likely to be emotionally interesting to the user, and creates a travel plan tailored to the user's state.

[0531] Operation of communication and display means

[0532] The created travel plan is sent to the user's device via communication. On the device, the plan is displayed visually, and additional information tailored to the user's current mood is also provided. This allows the user to receive more personalized information and enjoy a travel experience that matches their own feelings.

[0533] Specific example

[0534] For example, when a user visits Tokyo, they input their destination on their device, and if the emotion engine recognizes the user's level of excitement, the server uses this data to generate a plan suggesting energetic tourist spots and activities. Conversely, if the emotion engine recognizes that the user is seeking relaxation, the server will provide a plan guiding the user to a quiet park or a traditional tea room.

[0535] Thus, the present invention aims to provide travelers with an experience optimized to their emotions through advanced personalization features utilizing an emotion engine.

[0536] The following describes the processing flow.

[0537] Step 1:

[0538] The user inputs travel destination information using the device. The device collects emotional data through the user's camera and microphone, and an emotion engine analyzes the user's emotional state.

[0539] Step 2:

[0540] The device sends collected travel plans and emotional data to the server. The data sent includes information about planned tourist destinations and the user's emotional state.

[0541] Step 3:

[0542] The server analyzes the received data and retrieves relevant tourist information from external databases and APIs. This information includes details about tourist spots and event information.

[0543] Step 4:

[0544] Based on the results of the emotion engine, the server identifies tourist destinations and activities that match the user's current emotional state. For example, if the user is seeking relaxation, it will suggest quiet, nature-rich locations.

[0545] Step 5:

[0546] The server organizes the generated sightseeing plan, optimizing it to the user's emotions. This plan includes priority settings and visit order, taking into account the user's emotional state.

[0547] Step 6:

[0548] The server uses communication methods to send an optimized sightseeing plan to the terminal. The terminal displays the received plan through its user interface, allowing the user to review it.

[0549] Step 7:

[0550] Users review sightseeing plans on their devices and proceed with their trip based on the presented options. During their visit, the device continues to collect sentiment data, providing feedback to the server if any changes occur, enabling the generation of new plans.

[0551] (Example 2)

[0552] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0553] Traditional tourism information systems have struggled to provide personalized travel experiences tailored to users' emotions. Because they don't consider user feelings, travel plans are often uniform, providing information that doesn't match users' interests or circumstances. This leads to users failing to obtain the experiences they desire, resulting in decreased travel satisfaction.

[0554] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0555] In this invention, the server includes terminal means for inputting travel plans and collecting emotional states; data processing means for integrating travel plan information and emotional data, storing related information in data storage means, and collecting tourist spot information; and generation means including a generation AI model that generates a travel plan suitable for the user's emotional state based on the emotional data and tourist spot information. This makes it possible to quickly and accurately create and propose travel plans based on the user's emotions.

[0556] A "travel plan" is a set of plan information that includes places a user wants to visit and activities they want to do at a specific date and time.

[0557] "Emotional state" refers to data that indicates the user's psychological or emotional state, and can be classified into categories such as joy, excitement, and relaxation.

[0558] "Terminal device" refers to an electronic device used by the user to input travel plans and collect emotional data, such as a smartphone or tablet.

[0559] "Data storage means" refers to storage systems for long-term storage of collected information, and includes servers and cloud databases.

[0560] "Data processing means" refers to a device or software that analyzes input travel plan information and sentiment data, and performs processing to create a tourism plan by integrating related information.

[0561] A "generative AI model" is an artificial intelligence computational method or algorithm for generating personalized travel plans based on user input information and emotional states.

[0562] "Tourist destination information" refers to information about tourist destinations, including their location, characteristics, and available activities, and is data used to improve the user's travel experience.

[0563] The present invention is a tourism information provision system for personalizing the user's travel experience, and comprises terminal means, server means, and communication means.

[0564] First, the user enters their travel plan using a device. This device could be a smartphone or tablet. The device is equipped with an emotion engine, which, for example, uses a camera and sensors to analyze the user's facial expressions and collects emotional data in real time using voice analysis technology. This emotional data includes numerical information indicating the user's psychological state.

[0565] Next, the device transmits the collected travel plan information and sentiment data to a server via a communication method. This communication method can be the internet or a mobile network.

[0566] The server integrates received travel plan information and sentiment data and performs analysis using data processing tools. This process includes matching tourist destination information in the database and extracting relevant information. A generative AI model is used as the generation tool within the server, which generates a travel plan optimized for the user's sentiment based on the integrated data.

[0567] The generated sightseeing plan is sent back to the device via communication. The user's device displays this plan visually. Additional information based on the user's emotional state is also presented on the screen, allowing the user to enjoy their trip.

[0568] For example, if a user is visiting Tokyo and is in an excited state, the generative AI model can suggest a plan that includes lively tourist spots and activities. If the model determines that the user is seeking relaxation, it will suggest a plan that includes visits to quiet gardens or traditional tea rooms.

[0569] Examples of prompt messages include the following:

[0570] "When a user is perceived as being in an excited state while visiting □□ (travel destination), please suggest energetic tourist spots. Also, when perceived as being in a relaxed state, please suggest quiet places."

[0571] This system configuration enables a travel experience optimized to the user's emotions.

[0572] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0573] Step 1:

[0574] The user inputs their travel plan using the device. Specifically, they enter the regions they want to visit and the activities they wish to do into the application. The device also uses built-in sensors to analyze the user's facial expressions and voice, collecting emotional data. The input in this step consists of the user's travel plan information and emotional data, and the output is an integrated summary of this information.

[0575] Step 2:

[0576] The device sends the travel plan information and sentiment data collected in Step 1 to the server. At this time, the data is packaged and encrypted according to a security protocol. The input is the user's integrated information, and the output is the data transfer to the server.

[0577] Step 3:

[0578] The server receives travel plan information and sentiment data and integrates them using data processing tools. Specifically, it compares the received data with a database containing tourist destination information. The input is data received from the terminal, and the output is integrated data including tourist destination information.

[0579] Step 4:

[0580] The AI ​​model on the server generates a travel plan optimized for the user's emotional state based on the integrated data. The AI ​​model selects tourist destinations and activities that match the user's emotions based on prompts. In this step, the input is the server's integrated data, and the output is the generated travel plan.

[0581] Step 5:

[0582] The server transmits the generated sightseeing plan to the terminal via a communication method. The terminal visually displays this plan on the app's user interface and also presents additional information tailored to the user's mood. The input is the generated plan, and the output is the visual display on the terminal.

[0583] Step 6:

[0584] The user reviews the displayed travel plans and selects the one that best matches their emotional state and preferences. This selection allows the user to have a personalized travel experience. The input is the information displayed on the device, and the output is the user's selection.

[0585] (Application Example 2)

[0586] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0587] Providing personalized travel experiences tailored to travelers' emotions is challenging, and traditional information systems struggle to improve user satisfaction. Therefore, there is a need to provide travel plans that reflect users' emotions in real time and meet their diverse needs.

[0588] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0589] In this invention, the server includes a device means for inputting a travel plan, an information processing means for storing the travel plan information in a recording area and collecting related tourist destination information, an information generation means for generating historical information related to the tourist destination, an emotion engine for evaluating the user's emotions, and a control means for dynamically changing the sightseeing plan provided based on the emotion data. This makes it possible to provide personalized sightseeing plans for each user in real time.

[0590] "Device for inputting travel plans" refers to electronic devices or software used by users to input travel planning information.

[0591] "Information processing means for storing travel plan information in a recording area and collecting related tourist destination information" refers to methods and technologies for saving input travel plans to a storage device such as a database and automatically collecting information on related tourist destinations.

[0592] "Information generation means for generating historical information related to tourist destinations" refers to a system for automatically generating and organizing historical background and information related to tourist destinations.

[0593] A "user emotion engine" is a technology or software that analyzes and evaluates a user's emotional state from data acquired using a device.

[0594] "A control mechanism for dynamically changing sightseeing plans based on emotional data" refers to a system for adjusting and updating sightseeing plans in real time based on the user's emotional data.

[0595] The system for implementing the present invention provides personalized sightseeing plans that respond to the traveler's emotions, and mainly consists of the following components.

[0596] The terminal functions as a device for inputting travel plans, providing an interface for users to input the tourist destinations they wish to visit and the activities they desire. Furthermore, hardware utilizing a camera and microphone collects the user's facial expressions and voice tone, and runs an emotion engine to evaluate their emotional state. This employs facial recognition technology and AI for emotion analysis. Specific examples include the OpenCV library and the Emotion Analysis API.

[0597] The server stores travel plan information and emotional data transmitted from the terminal in a storage area and collects tourist destination information using information processing tools. This integrates available tourist destination information with the traveler's emotional state, and a generative AI model is used to generate a travel plan best suited to the user's emotions. The travel plan is dynamically modified according to the user's emotions. For example, if the user is rated as "excited," the plan will suggest energetic tourist destinations optimized for that emotion.

[0598] The created sightseeing plan is sent back to the device via the communication network and displayed visually on the device. This allows users to receive information that best suits their mood in real time.

[0599] As a concrete example, suppose a user selects a virtual trip and chooses "Tokyo" as their destination, and the server determines that the user's emotional state is one of "relaxation." In this case, the server generates a sightseeing plan suggesting quiet and peaceful spots, such as a "quiet park" or a "traditional tea house," and provides it to the user.

[0600] An example of a prompt for a generative AI model is, "How should the scenery change if the user is feeling down?" By using this prompt, the AI ​​model makes the necessary decisions to generate a sightseeing plan that provides the user with the best possible experience.

[0601] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0602] Step 1:

[0603] The terminal provides an interface for users to input their travel plans. At this stage, users enter the places they want to visit and the activities they wish to do, and save this information on the terminal as travel plan data. The input data includes the user's selections and travel itinerary.

[0604] Step 2:

[0605] The device uses its built-in camera and microphone to collect the user's facial expressions and voice in real time. This activates an emotion engine, which uses the acquired data to evaluate the user's emotional state. In this process, facial recognition technology and emotion analysis AI are used to generate emotion data from facial features and voice tone.

[0606] Step 3:

[0607] The travel plan information and sentiment data collected by the terminal are sent to the server. The server stores this data in its storage area and retrieves relevant tourist destination information from its database. Based on the travel plan information and sentiment data as input, it obtains a result that combines relevant tourist destinations and their attribute information.

[0608] Step 4:

[0609] The server utilizes a generative AI model to generate specific travel plans based on sentiment data and tourist destination information. A prompt such as "How should the scenery change if the user is feeling down?" may be used. The AI ​​model analyzes the input data and selects the most suitable tourist spots and activities.

[0610] Step 5:

[0611] The generated travel plan is transmitted to the device via a communication network. The device visually displays this data on its interface, providing the user with a personalized travel experience. The device controls how the generated plan is presented to the user and also provides additional suggestions and information tailored to their emotions.

[0612] Step 6:

[0613] Users can make decisions about their actual actions based on what is displayed on their device and enjoy sightseeing. This enables a flexible travel experience that responds to the user's real-time emotions.

[0614] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0615] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0616] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0617] [Fourth Embodiment]

[0618] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0619] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0620] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0621] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0622] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0623] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0624] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0625] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0626] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0627] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0628] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0629] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0630] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0631] The present invention is a tourism information provision system comprising terminal means for travelers to input information, server means for storing and processing information, and communication means for transmitting information. This allows travelers to obtain detailed information about tourist destinations they plan to visit and to plan their trips efficiently.

[0632] Operation of terminal means

[0633] The user uses a terminal to input their travel plan, which includes information such as the names of tourist destinations and dates to be visited. The terminal verifies the input data and formats it into a format that the server can process. The formatted information is then sent to the server via a communication method.

[0634] Server operation

[0635] Based on the received travel plan information, the server automatically collects relevant tourist spots and their historical information from external databases and APIs. Using the collected information, it generates additional information about the historical background and characteristics of the tourist destinations. The generated information is then organized into a travel plan tailored to the user's itinerary.

[0636] Operation of communication and display means

[0637] The organized sightseeing plan is sent from the server to the user's terminal via a communication method. The terminal visually displays the received information, allowing the user to review and adjust it.

[0638] Specific example

[0639] For example, if a user plans a visit to Kyoto using their device, the server generates historical information about Kinkaku-ji Temple and Arashiyama. It also analyzes the congestion levels at each tourist spot and provides a sightseeing plan suggesting the optimal visiting times. This allows users to gain in-depth knowledge about their destinations while also enjoying sightseeing efficiently and avoiding crowds.

[0640] Thus, the present invention provides tourists with a fulfilling travel experience by enabling the automatic generation of tourist information and the efficient presentation of travel plans.

[0641] The following describes the processing flow.

[0642] Step 1:

[0643] The user accesses the travel website using their device and enters the names of the tourist destinations they plan to visit and their travel dates. The device verifies the entered information and confirms that the data format is correct.

[0644] Step 2:

[0645] The terminal sends formatted travel schedule information to the server. The server receives the information and stores it in its database.

[0646] Step 3:

[0647] Based on the stored information, the server retrieves relevant tourist spot information and congestion status from external APIs and databases.

[0648] Step 4:

[0649] Based on the acquired tourist destination information, the server uses generation methods to create new information that includes details about historical background and location.

[0650] Step 5:

[0651] The server analyzes the generated information and optimizes sightseeing plans based on congestion data. It also provides suggestions regarding the order and timing of visits.

[0652] Step 6:

[0653] The server sends an optimized sightseeing plan to the user's terminal using a communication method. The terminal then visually displays the received plan on its user interface.

[0654] Step 7:

[0655] Users can review the displayed sightseeing plan and adjust their schedule as needed. Upon arriving at their destination, they can use their device to obtain further local information and enhance their travel experience.

[0656] (Example 1)

[0657] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0658] Traditional tourism information systems require users to manually search for information and plan their trips, which is time-consuming and laborious. Furthermore, it's difficult to create optimal travel plans that take into account the congestion levels at tourist destinations, sometimes resulting in unsatisfactory travel experiences for users.

[0659] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0660] In this invention, the server includes means for inputting travel plans and formatting the data into a processable format; data processing means for storing travel plan information and collecting relevant tourist information from external sources; and generation means for generating detailed historical and tourist information using a generation AI model based on the collected information. This enables users to efficiently obtain tourist information through an automated process and create optimal travel plans that avoid crowds.

[0661] A "travel plan" is a plan that includes information about the tourist destinations and itinerary that the user will visit.

[0662] A "terminal" refers to hardware or software that allows a user to input information and visually confirm that information.

[0663] "Data processing means" refers to a function that stores received data and performs the process of collecting relevant information from external sources.

[0664] A "generative AI model" refers to an algorithm or program that uses artificial intelligence to generate new information and provide detailed information.

[0665] "Generative means" refers to the process or function of creating new information based on collected data.

[0666] "Communication methods" refer to network systems and protocols used to transmit information from a server to a terminal, or vice versa.

[0667] "Means of visual display" refers to a function that displays received information on a device in a format that the user can understand.

[0668] "Crowding" refers to an indicator or state that shows the number and density of visitors in a tourist destination.

[0669] "Optimal visiting time" refers to the recommended timing for a visit, after adjusting the time of day and schedule, to ensure users can enjoy sightseeing smoothly.

[0670] This invention is an information provision system that enables travelers to have a more efficient and satisfying sightseeing experience. This system consists of a terminal, a server, and communication means.

[0671] Terminal operation

[0672] Users input their travel plans using their personal devices. Specifically, they enter information such as tourist attractions at their destination and their itinerary. This device converts the requested information into a format that can be processed by the server. The device then verifies this data and sends the formatted information to the server via communication.

[0673] Server operation

[0674] The server accesses external information sources based on received travel plan data to collect interesting tourist information. This information collection includes, for example, detailed information about tourist destinations, crowd levels, and historical background. It also uses a generative AI model to generate additional detailed content based on the collected information. This generative AI model features algorithms that analyze data obtained from historical databases and tourism APIs to make predictions.

[0675] Operation of communication means

[0676] Once the generated information is organized and compiled into a travel plan, it is transmitted to the terminal via a communication network.

[0677] Visual display

[0678] The terminal visually displays the received sightseeing plan to the user, allowing them to intuitively check the information and make adjustments as needed.

[0679] Specific example

[0680] For example, if a user plans a trip to Kyoto, the server generates detailed historical and tourist information about places like Kinkaku-ji Temple and Arashiyama. It also provides a sightseeing plan suggesting the optimal time to visit each location based on its congestion levels. This allows users to gain a deeper understanding of their destinations and achieve more efficient sightseeing.

[0681] Examples of prompts for generative AI models

[0682] "Please propose a sightseeing plan for Kyoto's tourist attractions based on detailed historical information and crowd levels."

[0683] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0684] Step 1:

[0685] The user uses a terminal to input basic information about their travel plan. This input includes the names of tourist attractions and the itinerary. The terminal formats this input data into a standardized format and prepares it for transmission to the server. Specifically, this involves unifying freely written tourist attraction names into a specific data format. After formatting, the input data is sent to the server via a communication method.

[0686] Step 2:

[0687] The server receives travel plan information sent from the terminal. It analyzes this received data to identify the necessary information categories (e.g., history, geography, events). Next, the server accesses external information sources (databases or APIs) to collect relevant tourism information. Examples include historical information about tourist destinations and event information for the planned travel dates. This collected data is then used as input for the generated AI model.

[0688] Step 3:

[0689] The server uses the collected information to send prompts to the generative AI model. By providing the generative AI model with prompts such as "Please provide detailed historical information about tourist spots in Kyoto," it generates detailed information about specific tourist spots. The generated information becomes the basic data for creating travel plans and also forms the basis for providing customized information to each user.

[0690] Step 4:

[0691] The server creates a sightseeing plan tailored to the user's requests based on the generated information. This information includes predicted crowd levels at tourist spots and optimal visiting times. The server organizes this information and converts it into a user-friendly format. The output is a sightseeing plan with recommended visiting order and time allocation.

[0692] Step 5:

[0693] The server transmits the final created sightseeing plan to the terminal via a communication method. The terminal receives this information and displays it visually to the user. The user can review the displayed information and adjust the visiting times and order as needed. This makes it easier for the user to plan their actual trip.

[0694] (Application Example 1)

[0695] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0696] Conventional tourism information systems have made it difficult for travelers to efficiently create travel plans and easily obtain detailed information about their intended destinations. Furthermore, the lack of real-time additional information provision at the destination limited the convenience for travelers. This invention aims to solve these problems and provide a system that allows travelers to enjoy sightseeing more effectively.

[0697] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0698] In this invention, the server includes an input device means for inputting travel plans, an information processing means for storing travel plan information in a storage device and collecting related tourist destination information, a generation device means for generating historical information related to tourist destinations, and an output means for presenting tourist information to tourists using a visual device. This makes it possible for travelers to quickly obtain detailed information and recommended sightseeing plans for their planned destinations, thereby improving their sightseeing experience at the location.

[0699] "Input device means" refers to a device or interface used by travelers to input their travel plans.

[0700] A "storage device" refers to a database or storage system used to save travel plan information.

[0701] "Information processing means" refers to the processes and methods for organizing and analyzing collected tourist destination information.

[0702] "Generation device means" refers to a system or component for generating historical information and additional information related to tourist destinations.

[0703] "Transmission means" refers to the network and communication technology used to transmit the generated information to the traveler's device.

[0704] A "visual device" is a device or display used to visually present tourist information to travelers.

[0705] "Output means" refers to methods and technologies for displaying tourist information to travelers via visual devices.

[0706] "Means of provision" refers to systems or processes for providing dynamic additional information based on the current location.

[0707] The system for carrying out this invention mainly consists of the following components: A device such as smart glasses is used as an input device for entering travel plans. The user can use this device to enter details of their travel plan and receive tourist information about their destination.

[0708] The server stores the entered travel plan information in a storage device and uses information processing means to collect related information. Specifically, it utilizes cloud services such as AWS Lambda and uses the Google Places API to obtain data on tourist destinations. Based on this data, it uses a generation AI model (e.g., GPT-4) as a generation device to generate historical background and characteristics related to the tourist destinations.

[0709] The generated tourist information is transmitted via a transmission means to smart glasses, which are output means equipped with a visual device. This visual device visually presents the tourist information to the user, helping them to deepen their understanding of their destination.

[0710] For example, suppose a user wants to find information about Odori Park when visiting Sapporo. When they type "Odori Park" into their smart glasses, the server processes the information and generates data on the park's history, highlights, and recommended visiting times. Finally, this information is presented through the user's visual devices, allowing travelers to easily access detailed tourist information.

[0711] An example of a prompt for the generating AI model would be: "Please describe the historical background and characteristics of the tourist spot entered by the user. Based on this information, please propose an attractive sightseeing plan for visitors. For example, please provide an overview of Odori Park, its history, and recommended visiting times."

[0712] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0713] Step 1:

[0714] The user enters their travel plan using smart glasses. Input is done via voice or eye-tracking and includes information such as destination and itinerary. The entered information is formatted as digital data within the device. The input is voice or eye-tracking data, and the output is formatted travel plan information.

[0715] Step 2:

[0716] The terminal transmits formatted travel plan information to the server using a communication method. The server stores the received data in a storage device. The input is formatted travel plan information, and the output is the data stored in the server's storage device.

[0717] Step 3:

[0718] The server uses information processing tools to collect relevant tourist destination information based on travel plan information obtained from the storage device. It primarily uses the Google Places API to retrieve relevant data and collect detailed information about tourist destinations. The input is travel plan information, and the output is tourist destination information.

[0719] Step 4:

[0720] The server uses a generation AI model (e.g., GPT-4) as a generation device to generate additional historical background and characteristics based on acquired tourist destination information. Prompt statements are provided to the model, and it outputs rich information about the tourist destination. The input is tourist destination information, and the output is the generated detailed information.

[0721] Step 5:

[0722] The server organizes the generated tourist information and transmits it to the terminal using a communication method. The user's smart glasses visually display the received information. The input is the generated detailed information, and the output is the visual data displayed on the smart glasses.

[0723] Step 6:

[0724] Users can view visualized tourist information and adjust their travel plans through smart glasses. Information can be added or regenerated based on user interface interactions. The input is visualized information, and the output is the user's final travel plan.

[0725] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0726] This invention is a tourism information provision system that combines an emotion engine to make the user's travel experience more personal and effective. The emotion engine recognizes the user's emotions in real time and reflects that information in the travel plan, thereby providing a tourism experience tailored to the user's needs.

[0727] Operation of terminal means

[0728] The user enters their travel plan using a device, and the emotion engine registers emotional data collected from the device. The device then sends the entered plan information and the emotional state collected by the emotion engine to the server.

[0729] Server operation

[0730] The server integrates received travel plan information and emotional data, and collects tourist destination information from the database. The generation method uses the tourist destination information, taking emotional data into account, to generate information that is likely to be emotionally interesting to the user, and creates a travel plan tailored to the user's state.

[0731] Operation of communication and display means

[0732] The created travel plan is sent to the user's device via communication. On the device, the plan is displayed visually, and additional information tailored to the user's current mood is also provided. This allows the user to receive more personalized information and enjoy a travel experience that matches their own feelings.

[0733] Specific example

[0734] For example, when a user visits Tokyo, they input their destination on their device, and if the emotion engine recognizes the user's level of excitement, the server uses this data to generate a plan suggesting energetic tourist spots and activities. Conversely, if the emotion engine recognizes that the user is seeking relaxation, the server will provide a plan guiding the user to a quiet park or a traditional tea room.

[0735] Thus, the present invention aims to provide travelers with an experience optimized to their emotions through advanced personalization features utilizing an emotion engine.

[0736] The following describes the processing flow.

[0737] Step 1:

[0738] The user inputs travel destination information using the device. The device collects emotional data through the user's camera and microphone, and an emotion engine analyzes the user's emotional state.

[0739] Step 2:

[0740] The device sends collected travel plans and emotional data to the server. The data sent includes information about planned tourist destinations and the user's emotional state.

[0741] Step 3:

[0742] The server analyzes the received data and retrieves relevant tourist information from external databases and APIs. This information includes details about tourist spots and event information.

[0743] Step 4:

[0744] Based on the results of the emotion engine, the server identifies tourist destinations and activities that match the user's current emotional state. For example, if the user is seeking relaxation, it will suggest quiet, nature-rich locations.

[0745] Step 5:

[0746] The server organizes the generated sightseeing plan, optimizing it to the user's emotions. This plan includes priority settings and visit order, taking into account the user's emotional state.

[0747] Step 6:

[0748] The server uses communication methods to send an optimized sightseeing plan to the terminal. The terminal displays the received plan through the user interface, allowing the user to confirm it.

[0749] Step 7:

[0750] Users review sightseeing plans on their devices and proceed with their trip based on the presented options. During their visit, the device continues to collect sentiment data, providing feedback to the server if any changes occur, enabling the generation of new plans.

[0751] (Example 2)

[0752] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0753] Traditional tourism information systems have struggled to provide personalized travel experiences tailored to users' emotions. Because they don't consider user feelings, travel plans are often uniform, providing information that doesn't match users' interests or circumstances. This leads to users failing to obtain the experiences they desire, resulting in decreased travel satisfaction.

[0754] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0755] In this invention, the server includes terminal means for inputting travel plans and collecting emotional states; data processing means for integrating travel plan information and emotional data, storing related information in data storage means, and collecting tourist spot information; and generation means including a generation AI model that generates a travel plan suitable for the user's emotional state based on the emotional data and tourist spot information. This makes it possible to quickly and accurately create and propose travel plans based on the user's emotions.

[0756] A "travel plan" is a set of plan information that includes places a user wants to visit and activities they want to do at a specific date and time.

[0757] "Emotional state" refers to data that indicates the user's psychological or emotional state, and can be classified into categories such as joy, excitement, and relaxation.

[0758] "Terminal device" refers to an electronic device used by the user to input travel plans and collect emotional data, such as a smartphone or tablet.

[0759] "Data storage means" refers to storage systems for long-term storage of collected information, and includes servers and cloud databases.

[0760] "Data processing means" refers to a device or software that analyzes input travel plan information and sentiment data, and performs processing to create a tourism plan by integrating related information.

[0761] A "generative AI model" is an artificial intelligence computational method or algorithm for generating personalized travel plans based on user input information and emotional states.

[0762] "Tourist destination information" refers to information about tourist destinations, including their location, characteristics, and available activities, and is data used to improve the user's travel experience.

[0763] The present invention is a tourism information provision system for personalizing the user's travel experience, and comprises terminal means, server means, and communication means.

[0764] First, the user enters their travel plan using a device. This device could be a smartphone or tablet. The device is equipped with an emotion engine, which, for example, uses a camera and sensors to analyze the user's facial expressions and collects emotional data in real time using voice analysis technology. This emotional data includes numerical information indicating the user's psychological state.

[0765] Next, the device transmits the collected travel plan information and sentiment data to a server via a communication method. This communication method can be the internet or a mobile network.

[0766] The server integrates received travel plan information and sentiment data and performs analysis using data processing tools. This process includes matching tourist destination information in the database and extracting relevant information. A generative AI model is used as the generation tool within the server, which generates a travel plan optimized for the user's sentiment based on the integrated data.

[0767] The generated sightseeing plan is sent back to the device via communication. The user's device displays this plan visually. Additional information based on the user's emotional state is also presented on the screen, allowing the user to enjoy their trip.

[0768] For example, if a user is visiting Tokyo and is in an excited state, the generative AI model can suggest a plan that includes lively tourist spots and activities. If the model determines that the user is seeking relaxation, it will suggest a plan that includes visits to quiet gardens or traditional tea rooms.

[0769] Examples of prompt messages include the following:

[0770] "When a user is perceived as being in an excited state while visiting □□ (travel destination), please suggest energetic tourist spots. Also, when perceived as being in a relaxed state, please suggest quiet places."

[0771] This system configuration enables a travel experience optimized to the user's emotions.

[0772] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0773] Step 1:

[0774] The user inputs their travel plan using the device. Specifically, they enter the regions they want to visit and the activities they wish to do into the application. The device also uses built-in sensors to analyze the user's facial expressions and voice, collecting emotional data. The input in this step consists of the user's travel plan information and emotional data, and the output is an integrated summary of this information.

[0775] Step 2:

[0776] The device sends the travel plan information and sentiment data collected in Step 1 to the server. At this time, the data is packaged and encrypted according to a security protocol. The input is the user's integrated information, and the output is the data transfer to the server.

[0777] Step 3:

[0778] The server receives travel plan information and sentiment data and integrates them using data processing tools. Specifically, it compares the received data with a database containing tourist destination information. The input is data received from the terminal, and the output is integrated data including tourist destination information.

[0779] Step 4:

[0780] The AI ​​model on the server generates a travel plan optimized for the user's emotional state based on the integrated data. The AI ​​model selects tourist destinations and activities that match the user's emotions based on prompts. In this step, the input is the server's integrated data, and the output is the generated travel plan.

[0781] Step 5:

[0782] The server transmits the generated sightseeing plan to the terminal via a communication method. The terminal visually displays this plan on the app's user interface and also presents additional information tailored to the user's mood. The input is the generated plan, and the output is the visual display on the terminal.

[0783] Step 6:

[0784] The user reviews the displayed travel plans and selects the one that best matches their emotional state and preferences. This selection allows the user to have a personalized travel experience. The input is the information displayed on the device, and the output is the user's selection.

[0785] (Application Example 2)

[0786] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0787] Providing personalized travel experiences tailored to travelers' emotions is challenging, and traditional information systems struggle to improve user satisfaction. Therefore, there is a need to provide travel plans that reflect users' emotions in real time and meet their diverse needs.

[0788] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0789] In this invention, the server includes a device means for inputting a travel plan, an information processing means for storing the travel plan information in a recording area and collecting related tourist destination information, an information generation means for generating historical information related to the tourist destination, an emotion engine for evaluating the user's emotions, and a control means for dynamically changing the sightseeing plan provided based on the emotion data. This makes it possible to provide personalized sightseeing plans for each user in real time.

[0790] "Device for inputting travel plans" refers to electronic devices or software used by users to input travel planning information.

[0791] "Information processing means for storing travel plan information in a recording area and collecting related tourist destination information" refers to methods and technologies for saving input travel plans to a storage device such as a database and automatically collecting information on related tourist destinations.

[0792] "Information generation means for generating historical information related to tourist destinations" refers to a system for automatically generating and organizing historical background and information related to tourist destinations.

[0793] A "user emotion engine" is a technology or software that analyzes and evaluates a user's emotional state from data acquired using a device.

[0794] "A control mechanism for dynamically changing sightseeing plans based on emotional data" refers to a system for adjusting and updating sightseeing plans in real time based on the user's emotional data.

[0795] The system for implementing the present invention provides personalized sightseeing plans that respond to the traveler's emotions, and mainly consists of the following components.

[0796] The terminal functions as a device for inputting travel plans, providing an interface for users to input the tourist destinations they wish to visit and the activities they desire. Furthermore, hardware utilizing a camera and microphone collects the user's facial expressions and voice tone, and runs an emotion engine to evaluate their emotional state. This employs facial recognition technology and AI for emotion analysis. Specific examples include the OpenCV library and the Emotion Analysis API.

[0797] The server stores travel plan information and emotional data transmitted from the terminal in a storage area and collects tourist destination information using information processing tools. This integrates available tourist destination information with the traveler's emotional state, and a generative AI model is used to generate a travel plan best suited to the user's emotions. The travel plan is dynamically modified according to the user's emotions. For example, if the user is rated as "excited," the plan will suggest energetic tourist destinations optimized for that emotion.

[0798] The created sightseeing plan is sent back to the device via the communication network and displayed visually on the device. This allows users to receive information that best suits their mood in real time.

[0799] As a concrete example, suppose a user selects a virtual trip and chooses "Tokyo" as their destination, and the server determines that the user's emotional state is one of "relaxation." In this case, the server generates a sightseeing plan suggesting quiet and peaceful spots, such as a "quiet park" or a "traditional tea house," and provides it to the user.

[0800] An example of a prompt for a generative AI model is, "How should the scenery change if the user is feeling down?" By using this prompt, the AI ​​model makes the necessary decisions to generate a sightseeing plan that provides the user with the best possible experience.

[0801] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0802] Step 1:

[0803] The terminal provides an interface for users to input their travel plans. At this stage, users enter the places they want to visit and the activities they wish to do, and save this information on the terminal as travel plan data. The input data includes the user's selections and travel itinerary.

[0804] Step 2:

[0805] The device uses its built-in camera and microphone to collect the user's facial expressions and voice in real time. This activates an emotion engine, which uses the acquired data to evaluate the user's emotional state. In this process, facial recognition technology and emotion analysis AI are used to generate emotion data from facial features and voice tone.

[0806] Step 3:

[0807] The travel plan information and sentiment data collected by the terminal are sent to the server. The server stores this data in its storage area and retrieves relevant tourist destination information from its database. Based on the travel plan information and sentiment data as input, it obtains a result that combines relevant tourist destinations and their attribute information.

[0808] Step 4:

[0809] The server utilizes a generative AI model to generate specific travel plans based on sentiment data and tourist destination information. A prompt such as "How should the scenery change if the user is feeling down?" may be used. The AI ​​model analyzes the input data and selects the most suitable tourist spots and activities.

[0810] Step 5:

[0811] The generated travel plan is transmitted to the device via a communication network. The device visually displays this data on its interface, providing the user with a personalized travel experience. The device controls how the generated plan is presented to the user and also provides additional suggestions and information tailored to their emotions.

[0812] Step 6:

[0813] Users can make decisions about their actual actions based on what is displayed on their device and enjoy sightseeing. This enables a flexible travel experience that responds to the user's real-time emotions.

[0814] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0815] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0816] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0817] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0818] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0819] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0820] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0821] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0822] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0823] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0824] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0825] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0826] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0827] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0828] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0829] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0830] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0831] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0832] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0833] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0834] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0835] The following is further disclosed regarding the embodiments described above.

[0836] (Claim 1)

[0837] A terminal for entering travel plans,

[0838] A data processing means for storing travel plan information in a database and collecting related tourist destination information,

[0839] A means for generating historical information related to tourist destinations,

[0840] A communication method that creates a sightseeing plan using the generated information and transmits it to a terminal via a communication network,

[0841] A system that includes this.

[0842] (Claim 2)

[0843] The system according to claim 1, further comprising a display means for receiving and visually displaying a travel plan.

[0844] (Claim 3)

[0845] The system according to claim 1, further comprising means for providing additional information in real time based on the current location.

[0846] "Example 1"

[0847] (Claim 1)

[0848] A means of inputting travel plans and formatting the data into a processable format,

[0849] A data processing means for storing travel plan information and collecting relevant tourism information from external sources,

[0850] A generation method that generates detailed historical and tourist information using a generation AI model based on collected information,

[0851] A communication method for creating a tourist plan that includes the generated information and transmitting it to a terminal via a communication network,

[0852] A system that includes this.

[0853] (Claim 2)

[0854] The system according to claim 1, further comprising means for receiving a travel plan, visually displaying it, and making it adjustable by the user.

[0855] (Claim 3)

[0856] The system according to claim 1, further comprising means for displaying the congestion status of tourist destinations and the optimal visiting time in real time based on the user's current location information.

[0857] "Application Example 1"

[0858] (Claim 1)

[0859] An input device means for entering travel plans,

[0860] Information processing means for storing travel plan information in a storage device and collecting related tourist destination information,

[0861] A generating device means for generating historical information related to tourist destinations,

[0862] A transmission means that creates a tourist plan using the generated information and transmits it to an input device via a communication channel,

[0863] An output means for presenting tourist information to tourists using a visual device,

[0864] A system that includes this.

[0865] (Claim 2)

[0866] The system according to claim 1, further comprising a visualization means for receiving and visually displaying a tourist plan.

[0867] (Claim 3)

[0868] The system according to claim 1, further comprising means for dynamically providing additional information based on the current location.

[0869] "Example 2 of combining an emotion engine"

[0870] (Claim 1)

[0871] A terminal device for inputting travel plans and collecting emotional states,

[0872] A data processing means that integrates travel planning information and sentiment data, stores related information in a data storage means, and collects tourist location information,

[0873] A generation method including a generation AI model that generates a sightseeing plan suitable for the user's emotional state based on emotional data and tourist destination information,

[0874] A communication means for transmitting the generated tourist plan to a terminal via a communication network,

[0875] A system that includes this.

[0876] (Claim 2)

[0877] The system according to claim 1, further comprising means for receiving a travel plan and visually displaying additional information based on the user's emotional state.

[0878] (Claim 3)

[0879] The system according to claim 1, further comprising means for providing real-time tourist destination information based on the current location.

[0880] "Application example 2 when combining with an emotional engine"

[0881] (Claim 1)

[0882] A device for entering travel plans,

[0883] Information processing means that stores travel plan information in a recording area and collects related tourist destination information,

[0884] Information generation means for generating historical information related to tourist destinations,

[0885] A communication method that creates a sightseeing plan using the generated information and transmits it to a device via a communication network,

[0886] An emotion engine that evaluates user emotions,

[0887] A control means for dynamically changing the sightseeing plan provided based on emotional data,

[0888] A system that includes this.

[0889] (Claim 2)

[0890] The system according to claim 1, further comprising a display means for receiving and visually displaying a travel plan.

[0891] (Claim 3)

[0892] The system according to claim 1, further comprising means for providing additional information in real time based on the current location and adjusting the information based on an evaluation of the emotion engine. [Explanation of symbols]

[0893] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A terminal for entering travel plans, A data processing means for storing travel plan information in a database and collecting related tourist destination information, A means for generating historical information related to tourist destinations, A communication method that creates a sightseeing plan using the generated information and transmits it to a terminal via a communication network, A system that includes this.

2. The system according to claim 1, further comprising a display means for receiving and visually displaying a travel plan.

3. The system according to claim 1, further comprising means for providing additional information in real time based on the current location.

Images