system

Abstract

We provide the system. [Solution] An input means for the user to input unique information and selected information, Information processing means for collecting related information based on the aforementioned unique information and selected information, A guidance means for generating optimal travel routes and tourist destination information based on the aforementioned related information, A reservation processing means for making a reservation using the generated information, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern times, while the interest in specific people or events is increasing, it is difficult to efficiently investigate and plan related tourist destinations and means of transportation. For this reason, conventional event participants have had problems spending a lot of time collecting information and having difficulty formulating an optimal schedule. Also, the reservation procedures are separately time - consuming, and there is a problem that a consistent plan cannot be executed.

Means for Solving the Problems

[0005] The system of the present invention includes a guidance means that collects relevant information based on unique and selected information entered by the user, and optimizes and presents tourist destinations and travel routes based on that information. Furthermore, it includes a reservation processing means for automating the reservation procedure for the proposed plan, and by comprehensively supporting a series of plans, it realizes efficient schedule creation and smooth travel. With this system, event participants can significantly reduce the effort required for information gathering and reservations, and enjoy related activities more comfortably.

[0006] An "input method" is an interface that allows a user to input specific information into a system.

[0007] An "information processing means" is a device that analyzes information input by a user and has the function of collecting and generating related data.

[0008] A "guidance system" is a system that generates and proposes optimal tourist destinations and travel routes based on collected information.

[0009] A "reservation processing method" is a function that automatically makes reservations for accommodation and transportation based on the plan selected by the user.

[0010] The "system" encompasses all of the aforementioned means and is an integrated technological foundation for providing consistent travel support. [Brief explanation of the drawing]

[0011] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0012] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0013] First, let's explain the terminology used in the following explanation.

[0014] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0015] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0016] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs, various parameters, and the like. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0017] In the following embodiments, the numbered communication I / F (Interface) is an interface including a communication processor, an antenna, and the like. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), and the like.

[0018] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0019] [First Embodiment]

[0020] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0021] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0022] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0023] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0024] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0025] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0026] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0027] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0028] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0029] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0030] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0031] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0032] In an embodiment of this invention, there is a terminal used by the user and a server that performs information processing and provides guidance. The user uses the terminal to launch an application and inputs unique information (e.g., a specific artist or event name) and selected information (e.g., "concert," "sightseeing"). The terminal sends this input to the server.

[0033] Based on the information received, the server retrieves relevant event information from external APIs and internal databases and performs analysis. Based on the analyzed data, it selects potential tourist spots in and around the event venue. In this process, it creates an optimal schedule to guide users on recommended travel routes and tourist destinations tailored to their interests.

[0034] The server sends the generated sightseeing schedule to the user's device via a guidance system, presenting it to the user. The user can then review the proposed plan and make changes as needed. If accommodation or transportation reservations are required based on the plan, the user can confirm and select them through the device and proceed with the necessary procedures.

[0035] All suggestions and procedures are automated through the booking process, with the server coordinating with the booking system to properly complete the booking and returning the booking information to the terminal. This entire process allows users to efficiently plan their trips.

[0036] For example, if a user plans to attend a concert by a specific artist and wishes to do some sightseeing before and after the concert, the system will suggest the best sightseeing destinations and transportation options, and simultaneously provide accommodation choices. The user can view all this information at once through their device and easily make all the necessary reservations for their trip.

[0037] The following describes the processing flow.

[0038] Step 1:

[0039] The user launches the application using their device and first enters unique information such as the event name and artist name. They also enter information about their areas of interest, such as "concerts" or "tourism."

[0040] Step 2:

[0041] The device sends the information entered by the user to the server. The transmitted data also includes supplementary information that takes into account the user's location and preferences.

[0042] Step 3:

[0043] The server uses databases and external APIs to search for and retrieve relevant event information based on the received unique and selected information. This is where information such as the date, time, and location of the event is collected.

[0044] Step 4:

[0045] The server analyzes the acquired event information and selects tourist spots around the event venue. It then scores these spots, taking into account user interests and past data, to narrow down the recommended locations.

[0046] Step 5:

[0047] The server collects information about travel routes and suggests the most suitable mode of transportation (such as public transport or rental car). This includes route selection that takes time, cost, and comfort into consideration.

[0048] Step 6:

[0049] The server integrates event information, tourist attractions, and transportation options to generate an optimal schedule for the user's activities. This schedule includes a detailed timeline.

[0050] Step 7:

[0051] Schedule information is sent to the device, and the user reviews the suggested plans. They can customize the options as needed and select their preferred plan.

[0052] Step 8:

[0053] The user selects the accommodations and transportation services that require reservations and sends that information to the server via their device. The server then initiates the reservation process based on the user's selection.

[0054] Step 9:

[0055] The server works with the reservation system to complete reservations for accommodations and transportation, and sends confirmation information back to the terminal. Users receive the reservation confirmation information and can make changes as needed.

[0056] Step 10:

[0057] Users can review their final schedule and reservation information and save it on their device. This completes their event planning schedule, allowing them to proceed with preparations.

[0058] (Example 1)

[0059] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0060] When planning a trip, users face the challenge of having to manually gather a large amount of information and select the optimal routes and sightseeing destinations, which is time-consuming and laborious. Furthermore, there is a lack of systems that efficiently handle customized itineraries tailored to individual users' hobbies and interests, as well as on-the-spot booking procedures.

[0061] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0062] In this invention, the server includes input means for the user to input unique information and selected information; information processing means for collecting relevant information from external information sources or internal data stores based on the unique information and selected information; guidance means for guiding the user to a specific venue and its surrounding tourist spots along an optimized travel route based on the information; and reservation processing means for automatically making reservations for transportation and accommodation. This enables the user to efficiently plan their trip and make various reservations smoothly through a customized travel schedule.

[0063] A "user" refers to an ordinary consumer who uses this system to input unique and selected information and to plan their trip.

[0064] "Specific information" refers to detailed information related to a particular event or activity.

[0065] "Selection information" refers to information that allows users to choose activity categories or services they are interested in.

[0066] "Input means" refers to a system that provides a device or interface for users to input information.

[0067] "Information processing means" refers to a system that collects relevant information from external sources or internal data stores based on information entered by the user.

[0068] "Guidance methods" refer to systems that present travel routes and tourist spots to users based on collected information.

[0069] A "reservation processing method" refers to a system that automatically makes reservations for transportation and accommodation using generated information.

[0070] "External information sources" refer to external data providers that the system accesses to obtain relevant information.

[0071] An "internal data store" refers to an internal database or information storage area that a system uses to retrieve relevant information.

[0072] "Venue" refers to the geographical location where a specific event or activity takes place.

[0073] A "tourist spot" refers to a tourist attraction selected for the purpose of guiding users to visit.

[0074] To implement this invention, an information terminal used by the user and a server for processing information are required. The user launches an application through the information terminal and inputs specific information about the event they wish to participate in (e.g., a specific artist's name or event name) and selection information (e.g., "concert," "sightseeing"). The information terminal transmits this input information to the server.

[0075] The server retrieves and analyzes necessary relevant information from external sources (e.g., APIs providing event information) and internal data stores (e.g., MySQL® databases) based on the received information. This analysis can utilize Python analysis libraries and RESTful APIs for data collection. The analysis identifies the event location and surrounding tourist attractions.

[0076] The server generates an optimal sightseeing schedule tailored to the user's interests, including optimizing travel routes using the Google® Maps API and other tools. This generated information is sent back to the information terminal and presented to the user. The user can review the proposed plan and modify it as needed through the information terminal.

[0077] Furthermore, if users need to book accommodations or transportation according to their travel schedule, they can check and adjust reservations through their terminal. The server automates the reservation process and completes reservations properly by linking with the Booking API and schedule data. As a result, the reservation information is returned to the information terminal, allowing users to check their travel plan all at once.

[0078] For example, if a user wants to attend a concert by a particular musician and plans sightseeing before and after the concert, the system will suggest tourist destinations and optimal transportation options that match the user's interests, and also provide accommodation options. An example of a prompt might be, "I'm planning to attend a concert by a specific artist and would like to do some sightseeing before and after. Please suggest recommended tourist destinations and accommodation options."

[0079] As described above, this invention is a system that enables users to efficiently plan their trips and smoothly complete necessary reservations.

[0080] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0081] Step 1:

[0082] The user launches the application using an information terminal and enters specific information and selection details for the event they wish to attend. The input data includes the name of a particular artist and the event category (e.g., "Concert," "Tourism"). This allows the system to obtain initial information to determine what to base its planning on.

[0083] Step 2:

[0084] The terminal sends user input information to the server. The transmitted data is typically in JSON format and is securely transferred over the network using the HTTPS protocol. This allows the server to receive the basic data necessary to process the user's request.

[0085] Step 3:

[0086] The server uses the received information to call external APIs and retrieve relevant event information. Specifically, it uses the event platform API to collect the latest information about the specified artist and event. In this process, it parses the data from the external APIs and converts it from JSON format to an internal data structure. This prepares the data for processing in a neutral format.

[0087] Step 4:

[0088] The server queries internal data stores (e.g., databases), using MySQL, for example, to retrieve historical event data and data based on user preferences, and collects highly relevant additional information. This information is related to the event location and nearby tourist attractions. This provides detailed data to make the best possible suggestions to the user.

[0089] Step 5:

[0090] The server uses a Python analysis library to analyze collected data and generate a travel schedule tailored to the user's interests. The analysis utilizes the Google Maps API to calculate the optimal travel route and finalize the proposed travel plan. This results in a rational and personalized travel plan.

[0091] Step 6:

[0092] The server sends the generated sightseeing schedule and travel plan to the terminal. The data is encoded in JSON format, allowing for real-time display on the terminal. This allows the user to review the suggested travel plan and easily visit the locations mentioned.

[0093] Step 7:

[0094] Users review the information displayed on their device and, if necessary, select and proceed with reservations for accommodations or transportation. A user interface (UI) is provided on the device that allows users to proceed further once the reservation information is confirmed.

[0095] Step 8:

[0096] The server uses a reservation processing mechanism to automatically complete accommodation and transportation reservations in conjunction with an external reservation system (e.g., a reservation site's API). After the reservation is complete, confirmation information is returned to the terminal, allowing the user to finalize the overall plan and receive notifications regarding any necessary details.

[0097] Through this process, users can efficiently plan their trips and make related reservations smoothly using this system.

[0098] (Application Example 1)

[0099] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0100] In the modern smart city tourism industry, there is a demand for personalized travel experiences based on the preferences and interests of individual tourists. This requires the efficient management of a series of travel plans, including detailed travel schedules, accommodations, and transportation bookings. However, performing these processes individually leads to wasted time and effort, and can detract from the user experience.

[0101] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0102] In this invention, the server includes input means for the user to input unique information, selected information, and planned visit dates; information processing means for collecting relevant information based on the unique information, selected information, and planned visit dates, and for analyzing it while considering the user's interests and past activities; and guidance means for generating tourist destination information, including optimal travel routes and stay durations, based on the relevant information. This makes it possible to automatically generate travel plans tailored to individual tourists and complete the entire process, including booking, in a consistent manner.

[0103] A "user" is an individual who operates a terminal into which specific unique information and selected information are entered.

[0104] "Unique information" refers to information that can uniquely identify a particular user, such as the name of an artist or event that the user is interested in.

[0105] "Selection information" refers to optional information such as activities or destinations that the user desires.

[0106] An "input method" is an interface that allows a user to input unique or selected information into a terminal.

[0107] "Information processing means" refers to a device or mechanism that has the function of collecting and analyzing necessary data based on user input.

[0108] A "guidance tool" is a means of generating optimal travel routes and tourist destination information using relevant data.

[0109] A "reservation processing method" is a means for automatically completing reservations for accommodations and transportation based on the generated information.

[0110] An "external database" is a collection of data used to retrieve relevant information from various external sources.

[0111] A "Geographic Information System" is a system that uses location information to calculate the optimal travel route.

[0112] "User interests and past activities" refer to criteria information used to personalize travel plans based on user trends and history.

[0113] As an embodiment of this invention, a terminal such as a smartphone or smart glasses is prepared, and an application is installed on it. The user operates this terminal to input specific unique information and selection information. The terminal transmits this input information to a server. The server performs analysis using information processing means based on the unique information, selection information, and planned visit date received from the user. In this process, external databases and geographic information systems (e.g., Google Maps and OpenStreetMap) are utilized to collect and analyze relevant event information. Furthermore, the user's interests and past activities are analyzed to generate optimal travel routes and tourist destination candidates for each individual user.

[0114] The guidance system displays the generated tourist information and travel plan on the user's device. The user can review the suggested plan and customize it as needed. The booking system automatically completes reservations for accommodations and transportation as required and returns the reservation information to the device. This allows the user to consistently execute an efficient travel plan.

[0115] For example, if a user plans to attend a specific concert and visit the surrounding area using their smartphone, the server will collect information related to the event and tourist destinations and suggest an optimal travel schedule. Booking accommodations and transportation can also be done smoothly.

[0116] An example of a prompt for a generative AI model is: "The user has selected desired events and tourist destinations of interest. Please suggest a one-day sightseeing schedule combining attending a concert in Tokyo with sightseeing in Asakusa." The server then creates the optimal plan based on this prompt and presents it to the user.

[0117] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0118] Step 1:

[0119] Users input unique information, selection information, and planned visit dates via devices such as smartphones or smart glasses. The entered data is transmitted to the server via the input interface on the device. At this stage, the entered data undergoes an integrity check and is converted to an appropriate format.

[0120] Step 2:

[0121] Based on the user information received by the server, relevant information is collected using information processing tools, referencing external databases and geographic information systems (GIS). The data retrieved from these databases includes various types of data related to events and tourist destinations. Furthermore, personalized interest analysis is performed based on past user activity history.

[0122] Step 3:

[0123] The server uses the analyzed relevant information to generate the optimal travel route and order of visiting tourist spots using a guidance system. In this process, user interests and priorities derived from past activities are considered, and the shortest route is identified by referencing GPS data. The generated schedule is then sent to the device.

[0124] Step 4:

[0125] The user reviews the suggested travel plan on their device. At this stage, the user can customize the plan. The customized content is then fed back to the server for further analysis as needed.

[0126] Step 5:

[0127] The server automatically makes reservations for accommodations and transportation using booking processing methods based on the final plan. It integrates with booking systems (e.g., Expedia API) to ensure all necessary reservations are completed. As a result, the reservation information is returned to the terminal.

[0128] Step 6:

[0129] The user confirms the details again through the device, and the overall plan is finalized. At the start of the trip, the device navigates the user's movements in real time and provides appropriate redirects if changes occur. A generative AI model optimizes prompts in a timely manner and provides the necessary information.

[0130] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0131] In an embodiment of this invention, the user uses a terminal and an interface to input a specific event name or artist name. They also select information related to their interests and preferences. The terminal sends the collected data to a server, which then collects relevant information based on the input. This includes retrieving data from an external database.

[0132] The server then uses an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's facial expressions and voice data to determine the user's emotional state at that moment. This emotional information is then used in the subsequent suggestion process to propose optimized tourist destinations and modes of transportation tailored to the user's state.

[0133] The guidance system provides interactive information based on the user's emotions. For example, if the user is feeling stressed, it will suggest relaxing sightseeing activities; conversely, if they are excited, it will suggest active events. This response is optimized in real time by an emotion engine.

[0134] The resulting schedule is designed to reflect the user's preferences while ensuring the most emotionally appropriate experience. Users can review this plan through their device and make changes if necessary. Reservations for accommodations and transportation based on the schedule are also automatically handled through the server.

[0135] For example, if a user is planning to attend an artist's concert, this system uses an emotion engine to analyze the user's motivation for that day and then suggests sightseeing destinations and plans that match their mood. If the user wants to relax that day, it suggests visiting quiet places; if they want energy, it suggests plans that include dynamic activities. This allows users to experience a fulfilling fan activity that includes emotional satisfaction.

[0136] The following describes the processing flow.

[0137] Step 1:

[0138] The user launches the application using their device and enters the name of an event or artist they are interested in into the search bar. They also specify a category of interest (such as "Concert" or "Tourism") as selection information.

[0139] Step 2:

[0140] The device sends unique and selected information entered by the user to the server. This data also includes the user's location information, preparing the suggestions for greater personalization.

[0141] Step 3:

[0142] Based on the information received, the server retrieves relevant event information from external APIs and internal databases. This includes information such as the event date, location, and associated cast.

[0143] Step 4:

[0144] The server activates the emotion engine and analyzes the user's current emotional state from facial images and voice data received from the terminal. This includes a process that uses machine learning models to identify emotions such as joy, sadness, and excitement.

[0145] Step 5:

[0146] The server integrates event information and the results of the emotion engine's analysis to suggest optimal sightseeing spots and travel routes based on the user's emotional state. These suggestions are prioritized based on emotion. For example, quiet places are recommended if relaxation is needed, while active events are recommended if stimulation is desired.

[0147] Step 6:

[0148] The server generates an optimal schedule for fan activities that reflects the results of the emotion engine. The generated schedule includes travel methods and sightseeing spots for each time of day, and is designed to provide the most comfortable experience for the user.

[0149] Step 7:

[0150] The generated schedule is sent to the device and displayed to the user. The user can review this plan and make fine adjustments according to their preferences.

[0151] Step 8:

[0152] Based on the user's final selections and adjustments, the terminal sends the final plan to the server, which then handles necessary accommodation bookings and transportation arrangements.

[0153] Step 9:

[0154] The server works in conjunction with the reservation system to complete reservations for services necessary for the user's fan activity plan. This includes booking hotel rooms and purchasing transportation tickets.

[0155] Step 10:

[0156] Information confirming the booking is sent to the terminal and notified to the user. The user can then use this information to proceed with their travel plans. (This is an expression for systemic multi-locale dynamic mutual multilayer flow processing systems based on multilingual communication across multi-digit local input-output proficiency.)

[0157] (Example 2)

[0158] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0159] Traditional systems had the problem of failing to improve user satisfaction because they suggested tourist destinations and transportation methods without considering the user's emotional state. Furthermore, they lacked efficiency because they required manual information gathering and booking procedures.

[0160] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0161] In this invention, the server includes terminal means, information processing means, emotion recognition means, guidance means that proposes experience information using a generative AI model, and reservation means. This enables the proposal of an optimal experience based on the user's emotional state and automated reservation processing.

[0162] A "terminal device" is an electronic device used by users to input information and collects event names and selection information through a user interface.

[0163] An "information processing device" is a device that generates information to be provided to the user by acquiring relevant data from an external information source based on data received from a terminal device.

[0164] An "emotion recognition device" is a device that analyzes the user's facial expression data and voice data in real time to determine the user's emotional state.

[0165] A "guidance device" is a system that uses a generative AI model to suggest optimal experience information based on the user's emotional state and interests.

[0166] A "reservation method" is a device that automatically arranges reservations for accommodations and transportation based on generated experience information.

[0167] A "generative AI model" is an artificial intelligence model that analyzes relevant information based on user input and emotional state, and optimizes the suggested content.

[0168] To implement this invention, the user uses a terminal to input information including the event name and artist name. The terminal is equipped with a user interface and has a function to receive selection information based on the user's interests and preferences. The terminal is responsible for transmitting the input data to the server.

[0169] The server uses information processing tools to retrieve relevant data from external sources based on data sent by the user. The generative AI model used in this step analyzes the retrieved information and generates optimal experience information tailored to the user's interests. This analysis process utilizes machine learning algorithms to capture data patterns and provide optimal suggestions.

[0170] Furthermore, the server uses emotion recognition to analyze the user's facial expressions and voice data in real time and determine their emotional state. This emotional information is used to make the generated experience information more aligned with the user's expectations. Image processing and speech recognition technologies are used for emotion recognition.

[0171] Through the guidance system, the server generates suggestions based on the user's emotional state and collected event information. Subsequently, reservations for tourist destinations and transportation are automatically made through the reservation system. This reservation process utilizes APIs that integrate with online reservation platforms. For example, if a user is planning to attend an artist's concert, the emotion engine analyzes the user's motivation for that day and provides corresponding tourist destinations and plans.

[0172] An example of a prompt for a generative AI model is, "If the user is looking to relax, what tourist attractions or activities would you suggest?" Using this prompt, it's possible to provide the optimal experience tailored to the user's needs.

[0173] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0174] Step 1:

[0175] The user uses the terminal to input a specific event name or artist name. The entered data is stored on the terminal through the user interface. At this stage, the output from the terminal is the string data entered by the user.

[0176] Step 2:

[0177] The terminal sends the collected input data to the server. This transmission process uses a communication protocol to transfer the data. The server receives the event name and artist name from the terminal as input.

[0178] Step 3:

[0179] The server uses information processing tools to retrieve relevant data from external sources based on the received data. This involves issuing database queries and performing data processing to gather event and artist information. The retrieved information is then stored on the server as relevant data.

[0180] Step 4:

[0181] The server uses emotion recognition to analyze the user's facial expressions and voice data. Data processing involves using face recognition and voice recognition algorithms to determine the user's emotional state. The output is metadata indicating the user's emotional state.

[0182] Step 5:

[0183] The server uses a generative AI model to generate optimal suggestions based on the user's emotional state and related data. Here, the AI ​​employs pattern recognition and machine learning to respond with prompt sentences. The suggested content is output as a plan for the user.

[0184] Step 6:

[0185] The server provides the user with generated suggestions through a guidance system. This presentation uses a visually engaging interface designed to capture the user's interest. The user receives this information and decides on their next action.

[0186] Step 7:

[0187] Based on the user's decision, the server automatically makes reservations for accommodations and transportation using booking methods. Here, an API is utilized to integrate with the booking system and proceed with the actual booking process. As output, booking confirmation information is presented to the user.

[0188] (Application Example 2)

[0189] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0190] In modern society, it is difficult for travelers to choose appropriate tourist destinations and experiences that suit their interests and emotional state at the time. In particular, the lack of real-time suggestions that take into account travelers' emotional states makes it challenging to provide highly satisfying tourist experiences. Furthermore, the suggestion and booking of transportation and accommodations optimized for travelers' needs are not being done efficiently.

[0191] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0192] In this invention, the server includes input means for the user to input unique information, selection information, and emotional information; information processing means for collecting relevant information based on the unique information, selection information, and emotional information; and guidance means for suggesting the optimal experience based on the relevant information and using an emotional analysis engine. This makes it possible to suggest the optimal tourist destinations and means of transportation according to the traveler's emotional state, thereby improving the traveler's satisfaction with the experience.

[0193] "Unique information" refers to individual information related to a specific person, place, or event that a user enters.

[0194] "Selected information" refers to information that users choose based on their own interests and preferences, and is data that concretizes their tourism options.

[0195] "Emotional information" refers to information that indicates the user's current psychological state, and is usually extracted from voice data or facial expression data.

[0196] "Information processing means" refers to a system component that has the function of accumulating and analyzing relevant information based on unique information, selection information, and emotional information obtained from the user.

[0197] "Guidance methods" refer to the system's function of suggesting appropriate tourist destinations and experiences to users based on collected data.

[0198] A "reservation processing method" is a system function that automatically arranges accommodation and transportation based on the generated information.

[0199] An "emotion analysis engine" is a technical means for identifying emotions from a user's voice and facial expressions and processing information accordingly.

[0200] An "external database" is a data aggregation platform used to obtain information required by a system from external sources.

[0201] The embodiment of the invention is realized through a user terminal, a server, and integration with an external database via the internet. The user terminal is a device such as a smartphone or tablet, and provides an interface for the user to input unique information, selection information, and emotional information. To acquire emotional information, a camera and microphone are used to perform image recognition and voice analysis.

[0202] The server collects information entered by the user and analyzes the data through information processing tools. This allows it to suggest optimal tourist destinations and experiences based on the user's emotional state. For example, sentiment analysis can be performed using Google Cloud Vision API or Amazon Rekognition. Information is also retrieved from external tourism databases, and real-time data analysis is performed.

[0203] Furthermore, by utilizing generative AI models, it is possible to generate prompt messages that correspond to the user's emotions and propose specific experiences based on those prompts. For example, if the user's emotional state is analyzed as "wanting to relax," the system will propose a plan that includes quiet tourist destinations and relaxing experiences.

[0204] Specifically, if a user inputs "I would like to be shown relaxing tourist destinations," the system will provide optimal suggestions based on prompts such as, "Please suggest quiet and relaxing tourist destinations and activities based on the user's current emotional state. The user is currently in Kyoto and is looking for a calming place." This makes it possible to provide a fulfilling tourist experience tailored to each individual user.

[0205] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0206] Step 1:

[0207] Users input unique information, selection information, and emotional information through the device. The device uses a camera and microphone to collect the user's facial expressions and voice, and sends this information to a server. The input data includes the user's name, location, activities of interest, and real-time emotional data.

[0208] Step 2:

[0209] The server begins processing information using the received data. Based on unique and selected information, it retrieves relevant tourist information from an external database. It also analyzes emotional information using an emotion analysis engine (e.g., Google Cloud Vision API) to identify the user's current emotional state. The input is unique information and emotional data from the user, and the output is the emotional state as an analysis result and candidate tourist information.

[0210] Step 3:

[0211] The server uses an AI model to generate prompts for the optimal tourist experience based on the analyzed emotional state. For example, it might generate a prompt such as, "Please suggest relaxing tourist destinations based on the user's current emotional state." Here, the emotional state (input) is converted into a prompt (output).

[0212] Step 4:

[0213] Based on the generated prompt, the server retrieves detailed information on the most suitable tourist destinations and experiences from an external database and provides it to the user through the guidance system. The final selected tourist destination or suggested experience is output. Specifically, this includes map information of the suggested location, the required time, and the booking status of the activity.

[0214] Step 5:

[0215] The user reviews the suggested experience and, if necessary, uses the guidance system to make reservations for accommodation and transportation. The server uses the reservation processing system to access the external reservation system and retrieve the reservation information. In response to the user's selections (input), it provides final reservation confirmation information (output).

[0216] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0217] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0218] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0219] [Second Embodiment]

[0220] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0221] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0222] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0223] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0224] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0225] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0226] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0227] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0228] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0229] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0230] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0231] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0232] In an embodiment of this invention, there is a terminal used by the user and a server that performs information processing and provides guidance. The user uses the terminal to launch an application and inputs unique information (e.g., a specific artist or event name) and selected information (e.g., "concert," "sightseeing"). The terminal sends this input to the server.

[0233] Based on the information received, the server retrieves relevant event information from external APIs and internal databases and performs analysis. Based on the analyzed data, it selects potential tourist spots in and around the event venue. In this process, it creates an optimal schedule to guide users on recommended travel routes and tourist destinations tailored to their interests.

[0234] The server sends the generated sightseeing schedule to the user's device via a guidance system, presenting it to the user. The user can then review the proposed plan and make changes as needed. If accommodation or transportation reservations are required based on the plan, the user can confirm and select them through the device and proceed with the necessary procedures.

[0235] All suggestions and procedures are automated through the booking process, with the server coordinating with the booking system to properly complete the booking and returning the booking information to the terminal. This entire process allows users to efficiently plan their trips.

[0236] For example, if a user plans to attend a concert by a specific artist and wishes to do some sightseeing before and after the concert, the system will suggest the best sightseeing destinations and transportation options, and simultaneously provide accommodation choices. The user can view all this information at once through their device and easily make all the necessary reservations for their trip.

[0237] The following describes the processing flow.

[0238] Step 1:

[0239] The user launches the application using their device and first enters unique information such as the event name and artist name. They also enter information about their areas of interest, such as "concerts" or "tourism."

[0240] Step 2:

[0241] The device sends the information entered by the user to the server. The transmitted data also includes supplementary information that takes into account the user's location and preferences.

[0242] Step 3:

[0243] The server uses databases and external APIs to search for and retrieve relevant event information based on the received unique and selected information. This is where information such as the date, time, and location of the event is collected.

[0244] Step 4:

[0245] The server analyzes the acquired event information and selects tourist spots around the event venue. It then scores these spots, taking into account user interests and past data, to narrow down the recommended locations.

[0246] Step 5:

[0247] The server collects information about travel routes and suggests the most suitable mode of transportation (such as public transport or rental car). This includes route selection that takes time, cost, and comfort into consideration.

[0248] Step 6:

[0249] The server integrates event information, tourist attractions, and transportation options to generate an optimal schedule for the user's activities. This schedule includes a detailed timeline.

[0250] Step 7:

[0251] Schedule information is sent to the device, and the user reviews the suggested plans. They can customize the options as needed and select their preferred plan.

[0252] Step 8:

[0253] The user selects the accommodations and transportation services that require reservations and sends that information to the server via their device. The server then initiates the reservation process based on the user's selection.

[0254] Step 9:

[0255] The server works with the reservation system to complete reservations for accommodations and transportation, and sends confirmation information back to the terminal. Users receive the reservation confirmation information and can make changes as needed.

[0256] Step 10:

[0257] Users can review their final schedule and reservation information and save it on their device. This completes their event planning schedule, allowing them to proceed with preparations.

[0258] (Example 1)

[0259] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0260] When planning a trip, users face the challenge of having to manually gather a large amount of information and select the optimal routes and sightseeing destinations, which is time-consuming and laborious. Furthermore, there is a lack of systems that efficiently handle customized itineraries tailored to individual users' hobbies and interests, as well as on-the-spot booking procedures.

[0261] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0262] In this invention, the server includes input means for the user to input unique information and selected information; information processing means for collecting relevant information from external information sources or internal data stores based on the unique information and selected information; guidance means for guiding the user to a specific venue and its surrounding tourist spots along an optimized travel route based on the information; and reservation processing means for automatically making reservations for transportation and accommodation. This enables the user to efficiently plan their trip and make various reservations smoothly through a customized travel schedule.

[0263] A "user" refers to an ordinary consumer who uses this system to input unique and selected information and to plan their trip.

[0264] "Specific information" refers to detailed information related to a particular event or activity.

[0265] "Selection information" refers to information that allows users to choose activity categories or services they are interested in.

[0266] "Input means" refers to a system that provides a device or interface for users to input information.

[0267] "Information processing means" refers to a system that collects relevant information from external sources or internal data stores based on information entered by the user.

[0268] "Guidance methods" refer to systems that present travel routes and tourist spots to users based on collected information.

[0269] A "reservation processing method" refers to a system that automatically makes reservations for transportation and accommodation using generated information.

[0270] "External information sources" refer to external data providers that the system accesses to obtain relevant information.

[0271] An "internal data store" refers to an internal database or information storage area that a system uses to retrieve relevant information.

[0272] "Venue" refers to the geographical location where a specific event or activity takes place.

[0273] A "tourist spot" refers to a tourist attraction selected for the purpose of guiding users to visit.

[0274] To implement this invention, an information terminal used by the user and a server for processing information are required. The user launches an application through the information terminal and inputs specific information about the event they wish to participate in (e.g., a specific artist's name or event name) and selection information (e.g., "concert," "sightseeing"). The information terminal transmits this input information to the server.

[0275] The server retrieves and analyzes the necessary relevant information from external sources (e.g., an API providing event information) and internal data stores (e.g., a MySQL database) based on the received information. This analysis can utilize Python analysis libraries and RESTful APIs for data collection. The analysis identifies the event location and surrounding tourist attractions.

[0276] The server generates an optimal sightseeing schedule tailored to the user's interests, including optimizing travel routes using the Google Maps API and other tools. This generated information is sent back to the information terminal and presented to the user. The user can review the suggested plan and modify it as needed through the information terminal.

[0277] Furthermore, when the user needs to make reservations for accommodation facilities and transportation according to the travel schedule, the user can check and adjust the reservations through the terminal. The server automates the reservation process and appropriately completes the reservation by linking the Booking API and the schedule data. As a result, the reservation information is returned to the information terminal again, and the user can check the travel plan collectively.

[0278] As a specific example, when the user hopes to participate in a concert of a specific musician and plans to travel before and after that, the system proposes tourist destinations and optimal travel methods in line with the user's interests and also provides options for accommodation. Examples of prompt texts can include content such as "I plan to participate in a concert of a specific artist and want to travel before and after that. I hope to be proposed options for tourist destinations and accommodation facilities."

[0279] As described above, this invention is a system that enables the user to efficiently make a travel plan and smoothly complete the necessary reservations.

[0280] The flow of the specific process in Example 1 will be described using FIG. 11.

[0281] Step 1:

[0282] The user uses the information terminal to launch the application and enters the unique information and selection information of the event they want to participate in. The input data is a specific artist name or event category (e.g., "concert", "travel"). Thereby, the system obtains the initial information for determining based on which information to make a plan.

[0283] Step 2:

[0284] The terminal sends the user's input information to the server. The data format to be sent is usually in JSON format and is securely transferred via the network using the HTTPS protocol. Thereby, the server receives the basic data for processing the user's request.

[0285] Step 3:

[0286] The server calls an external API based on the received information to obtain relevant event information. Specifically, it uses the event platform API to collect the latest information about the specified artists and events. At this time, the data from the external API is analyzed and converted from JSON format to an internal data structure. This prepares the data to be processed in a neutral format.

[0287] Step 4:

[0288] The server queries the internal data store (e.g., database), for example, using MySQL, to search for data based on past event data and user preferences, and collects additional highly relevant information. This information is related to the event venue and surrounding tourist attractions. This prepares detailed data for making optimal proposals to the user.

[0289] Step 5:

[0290] The server analyzes the collected data using a Python analysis library and generates a tourist schedule according to the user's interests. In the analysis, the Google Maps API is utilized to calculate the optimal travel route and finalize the proposed travel plan. This forms a reasonable and personalized travel plan.

[0291] Step 6:

[0292] The server sends the generated tourist schedule and travel plan to the terminal. The data is encoded in JSON format and can be displayed in real time on the terminal. This allows the user to consider the proposed travel plan and easily access its content.

[0293] Step 7:

[0294] Users review the information displayed on their device and, if necessary, select and proceed with reservations for accommodations or transportation. A user interface (UI) is provided on the device that allows users to proceed further once the reservation information is confirmed.

[0295] Step 8:

[0296] The server uses a reservation processing mechanism to automatically complete accommodation and transportation reservations in conjunction with an external reservation system (e.g., a reservation site's API). After the reservation is complete, confirmation information is returned to the terminal, allowing the user to finalize the overall plan and receive notifications regarding any necessary details.

[0297] Through this process, users can efficiently plan their trips and make related reservations smoothly using this system.

[0298] (Application Example 1)

[0299] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0300] In the modern smart city tourism industry, there is a demand for personalized travel experiences based on the preferences and interests of individual tourists. This requires the efficient management of a series of travel plans, including detailed travel schedules, accommodations, and transportation bookings. However, performing these processes individually leads to wasted time and effort, and can detract from the user experience.

[0301] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0302] In this invention, the server includes an input means for the user to input unique information, selection information, and the planned visit date, an information processing means for collecting relevant information based on the unique information, selection information, and planned visit date and analyzing it in consideration of the user's interests and past activities, and a guiding means for generating tourist destination information including an optimal travel route and stay time based on the relevant information. Thereby, it becomes possible to automatically generate a travel plan suitable for individual tourists and consistently complete it up to the reservation.

[0303] The "user" is an individual who operates a terminal for inputting specific unique information and selection information.

[0304] The "unique information" is information that can be uniquely identified, such as the name of an artist or event that a specific user is interested in.

[0305] The "selection information" is optional information such as activities or visiting places that the user desires.

[0306] The "input means" is an interface for the user to input unique information and selection information into the terminal.

[0307] The "information processing means" is a device or mechanism having a function for collecting and analyzing necessary data based on the user's input.

[0308] The "guiding means" is a means responsible for the process of generating an optimal travel route and tourist destination information using relevant information.

[0309] The "reservation processing means" is a means for automatically completing reservations for accommodation facilities and transportation based on the generated information.

[0310] The "external database" is a collection of data used to obtain relevant information from various external information sources.

[0311] The "geographic information system" is a system for calculating an optimal travel route by utilizing location information.

[0312] "User interests and past activities" refer to criteria information used to personalize travel plans based on user trends and history.

[0313] As an embodiment of this invention, a terminal such as a smartphone or smart glasses is prepared, and an application is installed on it. The user operates this terminal to input specific unique information and selection information. The terminal transmits this input information to a server. The server performs analysis using information processing means based on the unique information, selection information, and planned visit date received from the user. In this process, external databases and geographic information systems (e.g., Google Maps and OpenStreetMap) are utilized to collect and analyze relevant event information. Furthermore, the user's interests and past activities are analyzed to generate optimal travel routes and tourist destination candidates for each individual user.

[0314] The guidance system displays the generated tourist information and travel plan on the user's device. The user can review the suggested plan and customize it as needed. The booking system automatically completes reservations for accommodations and transportation as required and returns the reservation information to the device. This allows the user to consistently execute an efficient travel plan.

[0315] For example, if a user plans to attend a specific concert and visit the surrounding area using their smartphone, the server will collect information related to the event and tourist destinations and suggest an optimal travel schedule. Booking accommodations and transportation can also be done smoothly.

[0316] An example of a prompt for a generative AI model is: "The user has selected desired events and tourist destinations of interest. Please suggest a one-day sightseeing schedule combining attending a concert in Tokyo with sightseeing in Asakusa." The server then creates the optimal plan based on this prompt and presents it to the user.

[0317] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0318] Step 1:

[0319] Users input unique information, selection information, and planned visit dates via devices such as smartphones or smart glasses. The entered data is transmitted to the server via the input interface on the device. At this stage, the entered data undergoes an integrity check and is converted to an appropriate format.

[0320] Step 2:

[0321] Based on the user information received by the server, relevant information is collected using information processing tools, referencing external databases and geographic information systems (GIS). The data retrieved from these databases includes various types of data related to events and tourist destinations. Furthermore, personalized interest analysis is performed based on past user activity history.

[0322] Step 3:

[0323] The server uses the analyzed relevant information to generate the optimal travel route and order of visiting tourist spots using a guidance system. In this process, user interests and priorities derived from past activities are considered, and the shortest route is identified by referencing GPS data. The generated schedule is then sent to the device.

[0324] Step 4:

[0325] The user reviews the suggested travel plan on their device. At this stage, the user can customize the plan. The customized content is then fed back to the server for further analysis as needed.

[0326] Step 5:

[0327] The server automatically makes reservations for accommodations and transportation using booking processing methods based on the final plan. It integrates with booking systems (e.g., Expedia API) to ensure all necessary reservations are completed. As a result, the reservation information is returned to the terminal.

[0328] Step 6:

[0329] The user confirms the details again through the device, and the overall plan is finalized. At the start of the trip, the device navigates the user's movements in real time and provides appropriate redirects if changes occur. A generative AI model optimizes prompts in a timely manner and provides the necessary information.

[0330] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0331] In an embodiment of this invention, the user uses a terminal and an interface to input a specific event name or artist name. They also select information related to their interests and preferences. The terminal sends the collected data to a server, which then collects relevant information based on the input. This includes retrieving data from an external database.

[0332] The server then uses an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's facial expressions and voice data to determine the user's emotional state at that moment. This emotional information is then used in the subsequent suggestion process to propose optimized tourist destinations and modes of transportation tailored to the user's state.

[0333] The guidance system provides interactive information based on the user's emotions. For example, if the user is feeling stressed, it will suggest relaxing sightseeing activities; conversely, if they are excited, it will suggest active events. This response is optimized in real time by an emotion engine.

[0334] The resulting schedule is designed to reflect the user's preferences while ensuring the most emotionally appropriate experience. Users can review this plan through their device and make changes if necessary. Reservations for accommodations and transportation based on the schedule are also automatically handled through the server.

[0335] For example, if a user is planning to attend an artist's concert, this system uses an emotion engine to analyze the user's motivation for that day and then suggests sightseeing destinations and plans that match their mood. If the user wants to relax that day, it suggests visiting quiet places; if they want energy, it suggests plans that include dynamic activities. This allows users to experience a fulfilling fan activity that includes emotional satisfaction.

[0336] The following describes the processing flow.

[0337] Step 1:

[0338] The user launches the application using their device and enters the name of an event or artist they are interested in into the search bar. They also specify a category of interest (such as "Concert" or "Tourism") as selection information.

[0339] Step 2:

[0340] The device sends unique and selected information entered by the user to the server. This data also includes the user's location information, preparing the suggestions for greater personalization.

[0341] Step 3:

[0342] Based on the information received, the server retrieves relevant event information from external APIs and internal databases. This includes information such as the event date, location, and associated cast.

[0343] Step 4:

[0344] The server activates the emotion engine and analyzes the user's current emotional state from facial images and voice data received from the terminal. This includes a process that uses machine learning models to identify emotions such as joy, sadness, and excitement.

[0345] Step 5:

[0346] The server integrates event information and the results of the emotion engine's analysis to suggest optimal sightseeing spots and travel routes based on the user's emotional state. These suggestions are prioritized based on emotion. For example, quiet places are recommended if relaxation is needed, while active events are recommended if stimulation is desired.

[0347] Step 6:

[0348] The server generates an optimal schedule for fan activities that reflects the results of the emotion engine. The generated schedule includes travel methods and sightseeing spots for each time of day, and is designed to provide the most comfortable experience for the user.

[0349] Step 7:

[0350] The generated schedule is sent to the device and displayed to the user. The user can review this plan and make fine adjustments according to their preferences.

[0351] Step 8:

[0352] Based on the user's final selections and adjustments, the terminal sends the final plan to the server, which then handles necessary accommodation bookings and transportation arrangements.

[0353] Step 9:

[0354] The server works in conjunction with the reservation system to complete reservations for services necessary for the user's fan activity plan. This includes booking hotel rooms and purchasing transportation tickets.

[0355] Step 10:

[0356] Information confirming the booking is sent to the terminal and notified to the user. The user can then use this information to proceed with their travel plans. (This is an expression for systemic multi-locale dynamic mutual multilayer flow processing systems based on multilingual communication across multi-digit local input-output proficiency.)

[0357] (Example 2)

[0358] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0359] Traditional systems had the problem of failing to improve user satisfaction because they suggested tourist destinations and transportation methods without considering the user's emotional state. Furthermore, they lacked efficiency because they required manual information gathering and booking procedures.

[0360] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0361] In this invention, the server includes terminal means, information processing means, emotion recognition means, guidance means that proposes experience information using a generative AI model, and reservation means. This enables the proposal of an optimal experience based on the user's emotional state and automated reservation processing.

[0362] A "terminal device" is an electronic device used by users to input information and collects event names and selection information through a user interface.

[0363] An "information processing device" is a device that generates information to be provided to the user by acquiring relevant data from an external information source based on data received from a terminal device.

[0364] An "emotion recognition device" is a device that analyzes the user's facial expression data and voice data in real time to determine the user's emotional state.

[0365] A "guidance device" is a system that uses a generative AI model to suggest optimal experience information based on the user's emotional state and interests.

[0366] A "reservation method" is a device that automatically arranges reservations for accommodations and transportation based on generated experience information.

[0367] A "generative AI model" is an artificial intelligence model that analyzes relevant information based on user input and emotional state, and optimizes the suggested content.

[0368] To implement this invention, the user uses a terminal to input information including the event name and artist name. The terminal is equipped with a user interface and has a function to receive selection information based on the user's interests and preferences. The terminal is responsible for transmitting the input data to the server.

[0369] The server uses information processing tools to retrieve relevant data from external sources based on data sent by the user. The generative AI model used in this step analyzes the retrieved information and generates optimal experience information tailored to the user's interests. This analysis process utilizes machine learning algorithms to capture data patterns and provide optimal suggestions.

[0370] Furthermore, the server uses emotion recognition to analyze the user's facial expressions and voice data in real time and determine their emotional state. This emotional information is used to make the generated experience information more aligned with the user's expectations. Image processing and speech recognition technologies are used for emotion recognition.

[0371] Through the guidance system, the server generates suggestions based on the user's emotional state and collected event information. Subsequently, reservations for tourist destinations and transportation are automatically made through the reservation system. This reservation process utilizes APIs that integrate with online reservation platforms. For example, if a user is planning to attend an artist's concert, the emotion engine analyzes the user's motivation for that day and provides corresponding tourist destinations and plans.

[0372] An example of a prompt for a generative AI model is, "If the user is looking to relax, what tourist attractions or activities would you suggest?" Using this prompt, it's possible to provide the optimal experience tailored to the user's needs.

[0373] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0374] Step 1:

[0375] The user uses the terminal to input a specific event name or artist name. The entered data is stored on the terminal through the user interface. At this stage, the output from the terminal is the string data entered by the user.

[0376] Step 2:

[0377] The terminal sends the collected input data to the server. This transmission process uses a communication protocol to transfer the data. The server receives the event name and artist name from the terminal as input.

[0378] Step 3:

[0379] The server uses information processing tools to retrieve relevant data from external sources based on the received data. This involves issuing database queries and performing data processing to gather event and artist information. The retrieved information is then stored on the server as relevant data.

[0380] Step 4:

[0381] The server uses emotion recognition to analyze the user's facial expressions and voice data. Data processing involves using face recognition and voice recognition algorithms to determine the user's emotional state. The output is metadata indicating the user's emotional state.

[0382] Step 5:

[0383] The server uses a generative AI model to generate optimal suggestions based on the user's emotional state and related data. Here, the AI ​​employs pattern recognition and machine learning to respond with prompt sentences. The suggested content is output as a plan for the user.

[0384] Step 6:

[0385] The server provides the user with generated suggestions through a guidance system. This presentation uses a visually engaging interface designed to capture the user's interest. The user receives this information and decides on their next action.

[0386] Step 7:

[0387] Based on the user's decision, the server automatically makes reservations for accommodations and transportation using booking methods. Here, an API is utilized to integrate with the booking system and proceed with the actual booking process. As output, booking confirmation information is presented to the user.

[0388] (Application Example 2)

[0389] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0390] In modern society, it is difficult for travelers to choose appropriate tourist destinations and experiences that suit their interests and emotional state at the time. In particular, the lack of real-time suggestions that take into account travelers' emotional states makes it challenging to provide highly satisfying tourist experiences. Furthermore, the suggestion and booking of transportation and accommodations optimized for travelers' needs are not being done efficiently.

[0391] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0392] In this invention, the server includes input means for the user to input unique information, selection information, and emotional information; information processing means for collecting relevant information based on the unique information, selection information, and emotional information; and guidance means for suggesting the optimal experience based on the relevant information and using an emotional analysis engine. This makes it possible to suggest the optimal tourist destinations and means of transportation according to the traveler's emotional state, thereby improving the traveler's satisfaction with the experience.

[0393] "Unique information" refers to individual information related to a specific person, place, or event that a user enters.

[0394] "Selected information" refers to information that users choose based on their own interests and preferences, and is data that concretizes their tourism options.

[0395] "Emotional information" refers to information that indicates the user's current psychological state, and is usually extracted from voice data or facial expression data.

[0396] "Information processing means" refers to a system component that has the function of accumulating and analyzing relevant information based on unique information, selection information, and emotional information obtained from the user.

[0397] "Guidance methods" refer to the system's function of suggesting appropriate tourist destinations and experiences to users based on collected data.

[0398] A "reservation processing method" is a system function that automatically arranges accommodation and transportation based on the generated information.

[0399] An "emotion analysis engine" is a technical means for identifying emotions from a user's voice and facial expressions and processing information accordingly.

[0400] An "external database" is a data aggregation platform used to obtain information required by a system from external sources.

[0401] The embodiment of the invention is realized through a user terminal, a server, and integration with an external database via the internet. The user terminal is a device such as a smartphone or tablet, and provides an interface for the user to input unique information, selection information, and emotional information. To acquire emotional information, a camera and microphone are used to perform image recognition and voice analysis.

[0402] The server collects information entered by the user and analyzes the data through information processing tools. This allows it to suggest optimal tourist destinations and experiences based on the user's emotional state. For example, sentiment analysis can be performed using Google Cloud Vision API or Amazon Rekognition. Information is also retrieved from external tourism databases, and real-time data analysis is performed.

[0403] Furthermore, by utilizing generative AI models, it is possible to generate prompt messages that correspond to the user's emotions and propose specific experiences based on those prompts. For example, if the user's emotional state is analyzed as "wanting to relax," the system will propose a plan that includes quiet tourist destinations and relaxing experiences.

[0404] Specifically, if a user inputs "I would like to be shown relaxing tourist destinations," the system will provide optimal suggestions based on prompts such as, "Please suggest quiet and relaxing tourist destinations and activities based on the user's current emotional state. The user is currently in Kyoto and is looking for a calming place." This makes it possible to provide a fulfilling tourist experience tailored to each individual user.

[0405] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0406] Step 1:

[0407] Users input unique information, selection information, and emotional information through the device. The device uses a camera and microphone to collect the user's facial expressions and voice, and sends this information to a server. The input data includes the user's name, location, activities of interest, and real-time emotional data.

[0408] Step 2:

[0409] The server begins processing information using the received data. Based on unique and selected information, it retrieves relevant tourist information from an external database. It also analyzes emotional information using an emotion analysis engine (e.g., Google Cloud Vision API) to identify the user's current emotional state. The input is unique information and emotional data from the user, and the output is the emotional state as an analysis result and candidate tourist information.

[0410] Step 3:

[0411] The server uses an AI model to generate prompts for the optimal tourist experience based on the analyzed emotional state. For example, it might generate a prompt such as, "Please suggest relaxing tourist destinations based on the user's current emotional state." Here, the emotional state (input) is converted into a prompt (output).

[0412] Step 4:

[0413] Based on the generated prompt, the server retrieves detailed information on the most suitable tourist destinations and experiences from an external database and provides it to the user through the guidance system. The final selected tourist destination or suggested experience is output. Specifically, this includes map information of the suggested location, the required time, and the booking status of the activity.

[0414] Step 5:

[0415] The user reviews the suggested experience and, if necessary, uses the guidance system to make reservations for accommodation and transportation. The server uses the reservation processing system to access the external reservation system and retrieve the reservation information. In response to the user's selections (input), it provides final reservation confirmation information (output).

[0416] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0417] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0418] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0419] [Third Embodiment]

[0420] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0421] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0422] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0423] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0424] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0425] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0426] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0427] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0428] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0429] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0430] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0431] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0432] In an embodiment of this invention, there is a terminal used by the user and a server that performs information processing and provides guidance. The user uses the terminal to launch an application and inputs unique information (e.g., a specific artist or event name) and selected information (e.g., "concert," "sightseeing"). The terminal sends this input to the server.

[0433] Based on the information received, the server retrieves relevant event information from external APIs and internal databases and performs analysis. Based on the analyzed data, it selects potential tourist spots in and around the event venue. In this process, it creates an optimal schedule to guide users on recommended travel routes and tourist destinations tailored to their interests.

[0434] The server sends the generated sightseeing schedule to the user's device via a guidance system, presenting it to the user. The user can then review the proposed plan and make changes as needed. If accommodation or transportation reservations are required based on the plan, the user can confirm and select them through the device and proceed with the necessary procedures.

[0435] All suggestions and procedures are automated through the booking process, with the server coordinating with the booking system to properly complete the booking and returning the booking information to the terminal. This entire process allows users to efficiently plan their trips.

[0436] For example, if a user plans to attend a concert by a specific artist and wishes to do some sightseeing before and after the concert, the system will suggest the best sightseeing destinations and transportation options, and simultaneously provide accommodation choices. The user can view all this information at once through their device and easily make all the necessary reservations for their trip.

[0437] The following describes the processing flow.

[0438] Step 1:

[0439] The user launches the application using their device and first enters unique information such as the event name and artist name. They also enter information about their areas of interest, such as "concerts" or "tourism."

[0440] Step 2:

[0441] The device sends the information entered by the user to the server. The transmitted data also includes supplementary information that takes into account the user's location and preferences.

[0442] Step 3:

[0443] The server uses databases and external APIs to search for and retrieve relevant event information based on the received unique and selected information. This is where information such as the date, time, and location of the event is collected.

[0444] Step 4:

[0445] The server analyzes the acquired event information and selects tourist spots around the event venue. It then scores these spots, taking into account user interests and past data, to narrow down the recommended locations.

[0446] Step 5:

[0447] The server collects information about travel routes and suggests the most suitable mode of transportation (such as public transport or rental car). This includes route selection that takes time, cost, and comfort into consideration.

[0448] Step 6:

[0449] The server integrates event information, tourist attractions, and transportation options to generate an optimal schedule for the user's activities. This schedule includes a detailed timeline.

[0450] Step 7:

[0451] Schedule information is sent to the device, and the user reviews the suggested plans. They can customize the options as needed and select their preferred plan.

[0452] Step 8:

[0453] The user selects the accommodations and transportation services that require reservations and sends that information to the server via their device. The server then initiates the reservation process based on the user's selection.

[0454] Step 9:

[0455] The server works with the reservation system to complete reservations for accommodations and transportation, and sends confirmation information back to the terminal. Users receive the reservation confirmation information and can make changes as needed.

[0456] Step 10:

[0457] Users can review their final schedule and reservation information and save it on their device. This completes their event planning schedule, allowing them to proceed with preparations.

[0458] (Example 1)

[0459] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0460] When planning a trip, users face the challenge of having to manually gather a large amount of information and select the optimal routes and sightseeing destinations, which is time-consuming and laborious. Furthermore, there is a lack of systems that efficiently handle customized itineraries tailored to individual users' hobbies and interests, as well as on-the-spot booking procedures.

[0461] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0462] In this invention, the server includes input means for the user to input unique information and selected information; information processing means for collecting relevant information from external information sources or internal data stores based on the unique information and selected information; guidance means for guiding the user to a specific venue and its surrounding tourist spots along an optimized travel route based on the information; and reservation processing means for automatically making reservations for transportation and accommodation. This enables the user to efficiently plan their trip and make various reservations smoothly through a customized travel schedule.

[0463] A "user" refers to an ordinary consumer who uses this system to input unique and selected information and to plan their trip.

[0464] "Specific information" refers to detailed information related to a particular event or activity.

[0465] "Selection information" refers to information that allows users to choose activity categories or services they are interested in.

[0466] "Input means" refers to a system that provides a device or interface for users to input information.

[0467] "Information processing means" refers to a system that collects relevant information from external sources or internal data stores based on information entered by the user.

[0468] "Guidance methods" refer to systems that present travel routes and tourist spots to users based on collected information.

[0469] A "reservation processing method" refers to a system that automatically makes reservations for transportation and accommodation using generated information.

[0470] "External information sources" refer to external data providers that the system accesses to obtain relevant information.

[0471] An "internal data store" refers to an internal database or information storage area that a system uses to retrieve relevant information.

[0472] "Venue" refers to the geographical location where a specific event or activity takes place.

[0473] A "tourist spot" refers to a tourist attraction selected for the purpose of guiding users to visit.

[0474] To implement this invention, an information terminal used by the user and a server for processing information are required. The user launches an application through the information terminal and inputs specific information about the event they wish to participate in (e.g., a specific artist's name or event name) and selection information (e.g., "concert," "sightseeing"). The information terminal transmits this input information to the server.

[0475] The server retrieves and analyzes the necessary relevant information from external sources (e.g., an API providing event information) and internal data stores (e.g., a MySQL database) based on the received information. This analysis can utilize Python analysis libraries and RESTful APIs for data collection. The analysis identifies the event location and surrounding tourist attractions.

[0476] The server generates an optimal sightseeing schedule tailored to the user's interests, including optimizing travel routes using the Google Maps API and other tools. This generated information is sent back to the information terminal and presented to the user. The user can review the suggested plan and modify it as needed through the information terminal.

[0477] Furthermore, if users need to book accommodations or transportation according to their travel schedule, they can check and adjust reservations through their terminal. The server automates the reservation process and completes reservations properly by linking with the Booking API and schedule data. As a result, the reservation information is returned to the information terminal, allowing users to check their travel plan all at once.

[0478] For example, if a user wants to attend a concert by a particular musician and plans sightseeing before and after the concert, the system will suggest tourist destinations and optimal transportation options that match the user's interests, and also provide accommodation options. An example of a prompt might be, "I'm planning to attend a concert by a specific artist and would like to do some sightseeing before and after. Please suggest recommended tourist destinations and accommodation options."

[0479] As described above, this invention is a system that enables users to efficiently plan their trips and smoothly complete necessary reservations.

[0480] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0481] Step 1:

[0482] The user launches the application using an information terminal and enters specific information and selection details for the event they wish to attend. The input data includes the name of a particular artist and the event category (e.g., "Concert," "Tourism"). This allows the system to obtain initial information to determine what to base its planning on.

[0483] Step 2:

[0484] The terminal sends user input information to the server. The transmitted data is typically in JSON format and is securely transferred over the network using the HTTPS protocol. This allows the server to receive the basic data necessary to process the user's request.

[0485] Step 3:

[0486] The server uses the received information to call external APIs and retrieve relevant event information. Specifically, it uses the event platform API to collect the latest information about the specified artist and event. In this process, it parses the data from the external APIs and converts it from JSON format to an internal data structure. This prepares the data for processing in a neutral format.

[0487] Step 4:

[0488] The server queries internal data stores (e.g., databases), using MySQL, for example, to retrieve historical event data and data based on user preferences, and collects highly relevant additional information. This information is related to the event location and nearby tourist attractions. This provides detailed data to make the best possible suggestions to the user.

[0489] Step 5:

[0490] The server uses a Python analysis library to analyze collected data and generate a travel schedule tailored to the user's interests. The analysis utilizes the Google Maps API to calculate the optimal travel route and finalize the proposed travel plan. This results in a rational and personalized travel plan.

[0491] Step 6:

[0492] The server sends the generated sightseeing schedule and travel plan to the terminal. The data is encoded in JSON format, allowing for real-time display on the terminal. This allows the user to review the suggested travel plan and easily visit the locations mentioned.

[0493] Step 7:

[0494] Users review the information displayed on their device and, if necessary, select and proceed with reservations for accommodations or transportation. A user interface (UI) is provided on the device that allows users to proceed further once the reservation information is confirmed.

[0495] Step 8:

[0496] The server uses a reservation processing mechanism to automatically complete accommodation and transportation reservations in conjunction with an external reservation system (e.g., a reservation site's API). After the reservation is complete, confirmation information is returned to the terminal, allowing the user to finalize the overall plan and receive notifications regarding any necessary details.

[0497] Through this process, users can efficiently plan their trips and make related reservations smoothly using this system.

[0498] (Application Example 1)

[0499] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0500] In the modern smart city tourism industry, there is a demand for personalized travel experiences based on the preferences and interests of individual tourists. This requires the efficient management of a series of travel plans, including detailed travel schedules, accommodations, and transportation bookings. However, performing these processes individually leads to wasted time and effort, and can detract from the user experience.

[0501] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0502] In this invention, the server includes input means for the user to input unique information, selected information, and planned visit dates; information processing means for collecting relevant information based on the unique information, selected information, and planned visit dates, and for analyzing it while considering the user's interests and past activities; and guidance means for generating tourist destination information, including optimal travel routes and stay durations, based on the relevant information. This makes it possible to automatically generate travel plans tailored to individual tourists and complete the entire process, including booking, in a consistent manner.

[0503] A "user" is an individual who operates a terminal into which specific unique information and selected information are entered.

[0504] "Unique information" refers to information that can uniquely identify a particular user, such as the name of an artist or event that the user is interested in.

[0505] "Selection information" refers to optional information such as activities or destinations that the user desires.

[0506] An "input method" is an interface that allows a user to input unique or selected information into a terminal.

[0507] "Information processing means" refers to a device or mechanism that has the function of collecting and analyzing necessary data based on user input.

[0508] A "guidance tool" is a means of generating optimal travel routes and tourist destination information using relevant data.

[0509] A "reservation processing method" is a means for automatically completing reservations for accommodations and transportation based on the generated information.

[0510] An "external database" is a collection of data used to retrieve relevant information from various external sources.

[0511] A "Geographic Information System" is a system that uses location information to calculate the optimal travel route.

[0512] "User interests and past activities" refer to criteria information used to personalize travel plans based on user trends and history.

[0513] As an embodiment of this invention, a terminal such as a smartphone or smart glasses is prepared, and an application is installed on it. The user operates this terminal to input specific unique information and selection information. The terminal transmits this input information to a server. The server performs analysis using information processing means based on the unique information, selection information, and planned visit date received from the user. In this process, external databases and geographic information systems (e.g., Google Maps and OpenStreetMap) are utilized to collect and analyze relevant event information. Furthermore, the user's interests and past activities are analyzed to generate optimal travel routes and tourist destination candidates for each individual user.

[0514] The guidance system displays the generated tourist information and travel plan on the user's device. The user can review the suggested plan and customize it as needed. The booking system automatically completes reservations for accommodations and transportation as required and returns the reservation information to the device. This allows the user to consistently execute an efficient travel plan.

[0515] For example, if a user plans to attend a specific concert and visit the surrounding area using their smartphone, the server will collect information related to the event and tourist destinations and suggest an optimal travel schedule. Booking accommodations and transportation can also be done smoothly.

[0516] An example of a prompt for a generative AI model is: "The user has selected desired events and tourist destinations of interest. Please suggest a one-day sightseeing schedule combining attending a concert in Tokyo with sightseeing in Asakusa." The server then creates the optimal plan based on this prompt and presents it to the user.

[0517] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0518] Step 1:

[0519] Users input unique information, selection information, and planned visit dates via devices such as smartphones or smart glasses. The entered data is transmitted to the server via the input interface on the device. At this stage, the entered data undergoes an integrity check and is converted to an appropriate format.

[0520] Step 2:

[0521] Based on the user information received by the server, relevant information is collected using information processing tools, referencing external databases and geographic information systems (GIS). The data retrieved from these databases includes various types of data related to events and tourist destinations. Furthermore, personalized interest analysis is performed based on past user activity history.

[0522] Step 3:

[0523] The server uses the analyzed relevant information to generate the optimal travel route and order of visiting tourist spots using a guidance system. In this process, user interests and priorities derived from past activities are considered, and the shortest route is identified by referencing GPS data. The generated schedule is then sent to the device.

[0524] Step 4:

[0525] The user reviews the suggested travel plan on their device. At this stage, the user can customize the plan. The customized content is then fed back to the server for further analysis as needed.

[0526] Step 5:

[0527] The server automatically makes reservations for accommodations and transportation using booking processing methods based on the final plan. It integrates with booking systems (e.g., Expedia API) to ensure all necessary reservations are completed. As a result, the reservation information is returned to the terminal.

[0528] Step 6:

[0529] The user confirms the details again through the device, and the overall plan is finalized. At the start of the trip, the device navigates the user's movements in real time and provides appropriate redirects if changes occur. A generative AI model optimizes prompts in a timely manner and provides the necessary information.

[0530] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0531] In an embodiment of this invention, the user uses a terminal and an interface to input a specific event name or artist name. They also select information related to their interests and preferences. The terminal sends the collected data to a server, which then collects relevant information based on the input. This includes retrieving data from an external database.

[0532] The server then uses an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's facial expressions and voice data to determine the user's emotional state at that moment. This emotional information is then used in the subsequent suggestion process to propose optimized tourist destinations and modes of transportation tailored to the user's state.

[0533] The guidance system provides interactive information based on the user's emotions. For example, if the user is feeling stressed, it will suggest relaxing sightseeing activities; conversely, if they are excited, it will suggest active events. This response is optimized in real time by an emotion engine.

[0534] The resulting schedule is designed to reflect the user's preferences while ensuring the most emotionally appropriate experience. Users can review this plan through their device and make changes if necessary. Reservations for accommodations and transportation based on the schedule are also automatically handled through the server.

[0535] For example, if a user is planning to attend an artist's concert, this system uses an emotion engine to analyze the user's motivation for that day and then suggests sightseeing destinations and plans that match their mood. If the user wants to relax that day, it suggests visiting quiet places; if they want energy, it suggests plans that include dynamic activities. This allows users to experience a fulfilling fan activity that includes emotional satisfaction.

[0536] The following describes the processing flow.

[0537] Step 1:

[0538] The user launches the application using their device and enters the name of an event or artist they are interested in into the search bar. They also specify a category of interest (such as "Concert" or "Tourism") as selection information.

[0539] Step 2:

[0540] The device sends unique and selected information entered by the user to the server. This data also includes the user's location information, preparing the suggestions for greater personalization.

[0541] Step 3:

[0542] Based on the information received, the server retrieves relevant event information from external APIs and internal databases. This includes information such as the event date, location, and associated cast.

[0543] Step 4:

[0544] The server activates the emotion engine and analyzes the user's current emotional state from facial images and voice data received from the terminal. This includes a process that uses machine learning models to identify emotions such as joy, sadness, and excitement.

[0545] Step 5:

[0546] The server integrates event information and the results of the emotion engine's analysis to suggest optimal sightseeing spots and travel routes based on the user's emotional state. These suggestions are prioritized based on emotion. For example, quiet places are recommended if relaxation is needed, while active events are recommended if stimulation is desired.

[0547] Step 6:

[0548] The server generates an optimal schedule for fan activities that reflects the results of the emotion engine. The generated schedule includes travel methods and sightseeing spots for each time of day, and is designed to provide the most comfortable experience for the user.

[0549] Step 7:

[0550] The generated schedule is sent to the device and displayed to the user. The user can review this plan and make fine adjustments according to their preferences.

[0551] Step 8:

[0552] Based on the user's final selections and adjustments, the terminal sends the final plan to the server, which then handles necessary accommodation bookings and transportation arrangements.

[0553] Step 9:

[0554] The server works in conjunction with the reservation system to complete reservations for services necessary for the user's fan activity plan. This includes booking hotel rooms and purchasing transportation tickets.

[0555] Step 10:

[0556] Information confirming the booking is sent to the terminal and notified to the user. The user can then use this information to proceed with their travel plans. (This is an expression for systemic multi-locale dynamic mutual multilayer flow processing systems based on multilingual communication across multi-digit local input-output proficiency.)

[0557] (Example 2)

[0558] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0559] Traditional systems had the problem of failing to improve user satisfaction because they suggested tourist destinations and transportation methods without considering the user's emotional state. Furthermore, they lacked efficiency because they required manual information gathering and booking procedures.

[0560] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0561] In this invention, the server includes terminal means, information processing means, emotion recognition means, guidance means that proposes experience information using a generative AI model, and reservation means. This enables the proposal of an optimal experience based on the user's emotional state and automated reservation processing.

[0562] A "terminal device" is an electronic device used by users to input information and collects event names and selection information through a user interface.

[0563] An "information processing device" is a device that generates information to be provided to the user by acquiring relevant data from an external information source based on data received from a terminal device.

[0564] An "emotion recognition device" is a device that analyzes the user's facial expression data and voice data in real time to determine the user's emotional state.

[0565] A "guidance device" is a system that uses a generative AI model to suggest optimal experience information based on the user's emotional state and interests.

[0566] A "reservation method" is a device that automatically arranges reservations for accommodations and transportation based on generated experience information.

[0567] A "generative AI model" is an artificial intelligence model that analyzes relevant information based on user input and emotional state, and optimizes the suggested content.

[0568] To implement this invention, the user uses a terminal to input information including the event name and artist name. The terminal is equipped with a user interface and has a function to receive selection information based on the user's interests and preferences. The terminal is responsible for transmitting the input data to the server.

[0569] The server uses information processing tools to retrieve relevant data from external sources based on data sent by the user. The generative AI model used in this step analyzes the retrieved information and generates optimal experience information tailored to the user's interests. This analysis process utilizes machine learning algorithms to capture data patterns and provide optimal suggestions.

[0570] Furthermore, the server uses emotion recognition to analyze the user's facial expressions and voice data in real time and determine their emotional state. This emotional information is used to make the generated experience information more aligned with the user's expectations. Image processing and speech recognition technologies are used for emotion recognition.

[0571] Through the guidance system, the server generates suggestions based on the user's emotional state and collected event information. Subsequently, reservations for tourist destinations and transportation are automatically made through the reservation system. This reservation process utilizes APIs that integrate with online reservation platforms. For example, if a user is planning to attend an artist's concert, the emotion engine analyzes the user's motivation for that day and provides corresponding tourist destinations and plans.

[0572] An example of a prompt for a generative AI model is, "If the user is looking to relax, what tourist attractions or activities would you suggest?" Using this prompt, it's possible to provide the optimal experience tailored to the user's needs.

[0573] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0574] Step 1:

[0575] The user uses the terminal to input a specific event name or artist name. The entered data is stored on the terminal through the user interface. At this stage, the output from the terminal is the string data entered by the user.

[0576] Step 2:

[0577] The terminal sends the collected input data to the server. This transmission process uses a communication protocol to transfer the data. The server receives the event name and artist name from the terminal as input.

[0578] Step 3:

[0579] The server uses information processing tools to retrieve relevant data from external sources based on the received data. This involves issuing database queries and performing data processing to gather event and artist information. The retrieved information is then stored on the server as relevant data.

[0580] Step 4:

[0581] The server uses emotion recognition to analyze the user's facial expressions and voice data. Data processing involves using face recognition and voice recognition algorithms to determine the user's emotional state. The output is metadata indicating the user's emotional state.

[0582] Step 5:

[0583] The server uses a generative AI model to generate optimal suggestions based on the user's emotional state and related data. Here, the AI ​​employs pattern recognition and machine learning to respond with prompt sentences. The suggested content is output as a plan for the user.

[0584] Step 6:

[0585] The server provides the user with generated suggestions through a guidance system. This presentation uses a visually engaging interface designed to capture the user's interest. The user receives this information and decides on their next action.

[0586] Step 7:

[0587] Based on the user's decision, the server automatically makes reservations for accommodations and transportation using booking methods. Here, an API is utilized to integrate with the booking system and proceed with the actual booking process. As output, booking confirmation information is presented to the user.

[0588] (Application Example 2)

[0589] Next, we will explain Application Example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0590] In modern society, it is difficult for travelers to choose appropriate tourist destinations and experiences that suit their interests and emotional state at the time. In particular, the lack of real-time suggestions that take into account travelers' emotional states makes it challenging to provide highly satisfying tourist experiences. Furthermore, the suggestion and booking of transportation and accommodations optimized for travelers' needs are not being done efficiently.

[0591] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0592] In this invention, the server includes input means for the user to input unique information, selection information, and emotional information; information processing means for collecting relevant information based on the unique information, selection information, and emotional information; and guidance means for suggesting the optimal experience based on the relevant information and using an emotional analysis engine. This makes it possible to suggest the optimal tourist destinations and means of transportation according to the traveler's emotional state, thereby improving the traveler's satisfaction with the experience.

[0593] "Unique information" refers to individual information related to a specific person, place, or event that a user enters.

[0594] "Selected information" refers to information that users choose based on their own interests and preferences, and is data that concretizes their tourism options.

[0595] "Emotional information" refers to information that indicates the user's current psychological state, and is usually extracted from voice data or facial expression data.

[0596] "Information processing means" refers to a system component that has the function of accumulating and analyzing relevant information based on unique information, selection information, and emotional information obtained from the user.

[0597] "Guidance methods" refer to the system's function of suggesting appropriate tourist destinations and experiences to users based on collected data.

[0598] A "reservation processing method" is a system function that automatically arranges accommodation and transportation based on the generated information.

[0599] An "emotion analysis engine" is a technical means for identifying emotions from a user's voice and facial expressions and processing information accordingly.

[0600] An "external database" is a data aggregation platform used to obtain information required by a system from external sources.

[0601] The embodiment of the invention is realized through a user terminal, a server, and integration with an external database via the internet. The user terminal is a device such as a smartphone or tablet, and provides an interface for the user to input unique information, selection information, and emotional information. To acquire emotional information, a camera and microphone are used to perform image recognition and voice analysis.

[0602] The server collects information entered by the user and analyzes the data through information processing tools. This allows it to suggest optimal tourist destinations and experiences based on the user's emotional state. For example, sentiment analysis can be performed using Google Cloud Vision API or Amazon Rekognition. Information is also retrieved from external tourism databases, and real-time data analysis is performed.

[0603] Furthermore, by utilizing generative AI models, it is possible to generate prompt messages that correspond to the user's emotions and propose specific experiences based on those prompts. For example, if the user's emotional state is analyzed as "wanting to relax," the system will propose a plan that includes quiet tourist destinations and relaxing experiences.

[0604] Specifically, if a user inputs "I would like to be shown relaxing tourist destinations," the system will provide optimal suggestions based on prompts such as, "Please suggest quiet and relaxing tourist destinations and activities based on the user's current emotional state. The user is currently in Kyoto and is looking for a calming place." This makes it possible to provide a fulfilling tourist experience tailored to each individual user.

[0605] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0606] Step 1:

[0607] Users input unique information, selection information, and emotional information through the device. The device uses a camera and microphone to collect the user's facial expressions and voice, and sends this information to a server. The input data includes the user's name, location, activities of interest, and real-time emotional data.

[0608] Step 2:

[0609] The server begins processing information using the received data. Based on unique and selected information, it retrieves relevant tourist information from an external database. It also analyzes emotional information using an emotion analysis engine (e.g., Google Cloud Vision API) to identify the user's current emotional state. The input is unique information and emotional data from the user, and the output is the emotional state as an analysis result and candidate tourist information.

[0610] Step 3:

[0611] The server uses an AI model to generate prompts for the optimal tourist experience based on the analyzed emotional state. For example, it might generate a prompt such as, "Please suggest relaxing tourist destinations based on the user's current emotional state." Here, the emotional state (input) is converted into a prompt (output).

[0612] Step 4:

[0613] Based on the generated prompt, the server retrieves detailed information on the most suitable tourist destinations and experiences from an external database and provides it to the user through the guidance system. The final selected tourist destination or suggested experience is output. Specifically, this includes map information of the suggested location, the required time, and the booking status of the activity.

[0614] Step 5:

[0615] The user reviews the suggested experience and, if necessary, uses the guidance system to make reservations for accommodation and transportation. The server uses the reservation processing system to access the external reservation system and retrieve the reservation information. In response to the user's selections (input), it provides final reservation confirmation information (output).

[0616] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0617] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0618] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0619] [Fourth Embodiment]

[0620] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0621] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0622] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0623] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0624] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0625] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0626] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0627] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0628] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0629] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0630] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0631] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0632] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0633] In an embodiment of this invention, there is a terminal used by the user and a server that performs information processing and provides guidance. The user uses the terminal to launch an application and inputs unique information (e.g., a specific artist or event name) and selected information (e.g., "concert," "sightseeing"). The terminal sends this input to the server.

[0634] Based on the information received, the server retrieves relevant event information from external APIs and internal databases and performs analysis. Based on the analyzed data, it selects potential tourist spots in and around the event venue. In this process, it creates an optimal schedule to guide users on recommended travel routes and tourist destinations tailored to their interests.

[0635] The server sends the generated sightseeing schedule to the user's device via a guidance system, presenting it to the user. The user can then review the proposed plan and make changes as needed. If accommodation or transportation reservations are required based on the plan, the user can confirm and select them through the device and proceed with the necessary procedures.

[0636] All suggestions and procedures are automated through the booking process, with the server coordinating with the booking system to properly complete the booking and returning the booking information to the terminal. This entire process allows users to efficiently plan their trips.

[0637] For example, if a user plans to attend a concert by a specific artist and wishes to do some sightseeing before and after the concert, the system will suggest the best sightseeing destinations and transportation options, and simultaneously provide accommodation choices. The user can view all this information at once through their device and easily make all the necessary reservations for their trip.

[0638] The following describes the processing flow.

[0639] Step 1:

[0640] The user launches the application using their device and first enters unique information such as the event name and artist name. They also enter information about their areas of interest, such as "concerts" or "tourism."

[0641] Step 2:

[0642] The device sends the information entered by the user to the server. The transmitted data also includes supplementary information that takes into account the user's location and preferences.

[0643] Step 3:

[0644] The server uses databases and external APIs to search for and retrieve relevant event information based on the received unique and selected information. This is where information such as the date, time, and location of the event is collected.

[0645] Step 4:

[0646] The server analyzes the acquired event information and selects tourist spots around the event venue. It then scores these spots, taking into account user interests and past data, to narrow down the recommended locations.

[0647] Step 5:

[0648] The server collects information about travel routes and suggests the most suitable mode of transportation (such as public transport or rental car). This includes route selection that takes time, cost, and comfort into consideration.

[0649] Step 6:

[0650] The server integrates event information, tourist attractions, and transportation options to generate an optimal schedule for the user's activities. This schedule includes a detailed timeline.

[0651] Step 7:

[0652] Schedule information is sent to the device, and the user reviews the suggested plans. They can customize the options as needed and select their preferred plan.

[0653] Step 8:

[0654] The user selects the accommodations and transportation services that require reservations and sends that information to the server via their device. The server then initiates the reservation process based on the user's selection.

[0655] Step 9:

[0656] The server works with the reservation system to complete reservations for accommodations and transportation, and sends confirmation information back to the terminal. Users receive the reservation confirmation information and can make changes as needed.

[0657] Step 10:

[0658] Users can review their final schedule and reservation information and save it on their device. This completes their event planning schedule, allowing them to proceed with preparations.

[0659] (Example 1)

[0660] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0661] When planning a trip, users face the challenge of having to manually gather a large amount of information and select the optimal routes and sightseeing destinations, which is time-consuming and laborious. Furthermore, there is a lack of systems that efficiently handle customized itineraries tailored to individual users' hobbies and interests, as well as on-the-spot booking procedures.

[0662] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0663] In this invention, the server includes input means for the user to input unique information and selected information; information processing means for collecting relevant information from external information sources or internal data stores based on the unique information and selected information; guidance means for guiding the user to a specific venue and its surrounding tourist spots along an optimized travel route based on the information; and reservation processing means for automatically making reservations for transportation and accommodation. This enables the user to efficiently plan their trip and make various reservations smoothly through a customized travel schedule.

[0664] A "user" refers to an ordinary consumer who uses this system to input unique and selected information and to plan their trip.

[0665] "Specific information" refers to detailed information related to a particular event or activity.

[0666] "Selection information" refers to information that allows users to choose activity categories or services they are interested in.

[0667] "Input means" refers to a system that provides a device or interface for users to input information.

[0668] "Information processing means" refers to a system that collects relevant information from external sources or internal data stores based on information entered by the user.

[0669] "Guidance methods" refer to systems that present travel routes and tourist spots to users based on collected information.

[0670] A "reservation processing method" refers to a system that automatically makes reservations for transportation and accommodation using generated information.

[0671] "External information sources" refer to external data providers that the system accesses to obtain relevant information.

[0672] An "internal data store" refers to an internal database or information storage area that a system uses to retrieve relevant information.

[0673] "Venue" refers to the geographical location where a specific event or activity takes place.

[0674] A "tourist spot" refers to a tourist attraction selected for the purpose of guiding users to visit.

[0675] To implement this invention, an information terminal used by the user and a server for processing information are required. The user launches an application through the information terminal and inputs specific information about the event they wish to participate in (e.g., a specific artist's name or event name) and selection information (e.g., "concert," "sightseeing"). The information terminal transmits this input information to the server.

[0676] The server retrieves and analyzes the necessary relevant information from external sources (e.g., an API providing event information) and internal data stores (e.g., a MySQL database) based on the received information. This analysis can utilize Python analysis libraries and RESTful APIs for data collection. The analysis identifies the event location and surrounding tourist attractions.

[0677] The server generates an optimal sightseeing schedule tailored to the user's interests, including optimizing travel routes using the Google Maps API and other tools. This generated information is sent back to the information terminal and presented to the user. The user can review the suggested plan and modify it as needed through the information terminal.

[0678] Furthermore, if users need to book accommodations or transportation according to their travel schedule, they can check and adjust reservations through their terminal. The server automates the reservation process and completes reservations properly by linking with the Booking API and schedule data. As a result, the reservation information is returned to the information terminal, allowing users to check their travel plan all at once.

[0679] For example, if a user wants to attend a concert by a particular musician and plans sightseeing before and after the concert, the system will suggest tourist destinations and optimal transportation options that match the user's interests, and also provide accommodation options. An example of a prompt might be, "I'm planning to attend a concert by a specific artist and would like to do some sightseeing before and after. Please suggest recommended tourist destinations and accommodation options."

[0680] As described above, this invention is a system that enables users to efficiently plan their trips and smoothly complete necessary reservations.

[0681] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0682] Step 1:

[0683] The user launches the application using an information terminal and enters specific information and selection details for the event they wish to attend. The input data includes the name of a particular artist and the event category (e.g., "Concert," "Tourism"). This allows the system to obtain initial information to determine what to base its planning on.

[0684] Step 2:

[0685] The terminal sends user input information to the server. The transmitted data is typically in JSON format and is securely transferred over the network using the HTTPS protocol. This allows the server to receive the basic data necessary to process the user's request.

[0686] Step 3:

[0687] The server uses the received information to call external APIs and retrieve relevant event information. Specifically, it uses the event platform API to collect the latest information about the specified artist and event. In this process, it parses the data from the external APIs and converts it from JSON format to an internal data structure. This prepares the data for processing in a neutral format.

[0688] Step 4:

[0689] The server queries internal data stores (e.g., databases), using MySQL, for example, to retrieve historical event data and data based on user preferences, and collects highly relevant additional information. This information is related to the event location and nearby tourist attractions. This provides detailed data to make the best possible suggestions to the user.

[0690] Step 5:

[0691] The server uses a Python analysis library to analyze collected data and generate a travel schedule tailored to the user's interests. The analysis utilizes the Google Maps API to calculate the optimal travel route and finalize the proposed travel plan. This results in a rational and personalized travel plan.

[0692] Step 6:

[0693] The server sends the generated sightseeing schedule and travel plan to the terminal. The data is encoded in JSON format, allowing for real-time display on the terminal. This allows the user to review the suggested travel plan and easily visit the locations mentioned.

[0694] Step 7:

[0695] Users review the information displayed on their device and, if necessary, select and proceed with reservations for accommodations or transportation. A user interface (UI) is provided on the device that allows users to proceed further once the reservation information is confirmed.

[0696] Step 8:

[0697] The server uses a reservation processing mechanism to automatically complete accommodation and transportation reservations in conjunction with an external reservation system (e.g., a reservation site's API). After the reservation is complete, confirmation information is returned to the terminal, allowing the user to finalize the overall plan and receive notifications regarding any necessary details.

[0698] Through this process, users can efficiently plan their trips and make related reservations smoothly using this system.

[0699] (Application Example 1)

[0700] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0701] In the modern smart city tourism industry, there is a demand for personalized travel experiences based on the preferences and interests of individual tourists. This requires the efficient management of a series of travel plans, including detailed travel schedules, accommodations, and transportation bookings. However, performing these processes individually leads to wasted time and effort, and can detract from the user experience.

[0702] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0703] In this invention, the server includes input means for the user to input unique information, selected information, and planned visit dates; information processing means for collecting relevant information based on the unique information, selected information, and planned visit dates, and for analyzing it while considering the user's interests and past activities; and guidance means for generating tourist destination information, including optimal travel routes and stay durations, based on the relevant information. This makes it possible to automatically generate travel plans tailored to individual tourists and complete the entire process, including booking, in a consistent manner.

[0704] A "user" is an individual who operates a terminal into which specific unique information and selected information are entered.

[0705] "Unique information" refers to information that can uniquely identify a particular user, such as the name of an artist or event that the user is interested in.

[0706] "Selection information" refers to optional information such as activities or destinations that the user desires.

[0707] An "input method" is an interface that allows a user to input unique or selected information into a terminal.

[0708] "Information processing means" refers to a device or mechanism that has the function of collecting and analyzing necessary data based on user input.

[0709] A "guidance tool" is a means of generating optimal travel routes and tourist destination information using relevant data.

[0710] A "reservation processing method" is a means for automatically completing reservations for accommodations and transportation based on the generated information.

[0711] An "external database" is a collection of data used to retrieve relevant information from various external sources.

[0712] A "Geographic Information System" is a system that uses location information to calculate the optimal travel route.

[0713] "User interests and past activities" refer to criteria information used to personalize travel plans based on user trends and history.

[0714] As an embodiment of this invention, a terminal such as a smartphone or smart glasses is prepared, and an application is installed on it. The user operates this terminal to input specific unique information and selection information. The terminal transmits this input information to a server. The server performs analysis using information processing means based on the unique information, selection information, and planned visit date received from the user. In this process, external databases and geographic information systems (e.g., Google Maps and OpenStreetMap) are utilized to collect and analyze relevant event information. Furthermore, the user's interests and past activities are analyzed to generate optimal travel routes and tourist destination candidates for each individual user.

[0715] The guidance system displays the generated tourist information and travel plan on the user's device. The user can review the suggested plan and customize it as needed. The booking system automatically completes reservations for accommodations and transportation as required and returns the reservation information to the device. This allows the user to consistently execute an efficient travel plan.

[0716] For example, if a user plans to attend a specific concert and visit the surrounding area using their smartphone, the server will collect information related to the event and tourist destinations and suggest an optimal travel schedule. Booking accommodations and transportation can also be done smoothly.

[0717] An example of a prompt for a generative AI model is: "The user has selected desired events and tourist destinations of interest. Please suggest a one-day sightseeing schedule combining attending a concert in Tokyo with sightseeing in Asakusa." The server then creates the optimal plan based on this prompt and presents it to the user.

[0718] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0719] Step 1:

[0720] Users input unique information, selection information, and planned visit dates via devices such as smartphones or smart glasses. The entered data is transmitted to the server via the input interface on the device. At this stage, the entered data undergoes an integrity check and is converted to an appropriate format.

[0721] Step 2:

[0722] Based on the user information received by the server, relevant information is collected using information processing tools, referencing external databases and geographic information systems (GIS). The data retrieved from these databases includes various types of data related to events and tourist destinations. Furthermore, personalized interest analysis is performed based on past user activity history.

[0723] Step 3:

[0724] The server uses the analyzed relevant information to generate the optimal travel route and order of visiting tourist spots using a guidance system. In this process, user interests and priorities derived from past activities are considered, and the shortest route is identified by referencing GPS data. The generated schedule is then sent to the device.

[0725] Step 4:

[0726] The user reviews the suggested travel plan on their device. At this stage, the user can customize the plan. The customized content is then fed back to the server for further analysis as needed.

[0727] Step 5:

[0728] The server automatically makes reservations for accommodations and transportation using booking processing methods based on the final plan. It integrates with booking systems (e.g., Expedia API) to ensure all necessary reservations are completed. As a result, the reservation information is returned to the terminal.

[0729] Step 6:

[0730] The user confirms the details again through the device, and the overall plan is finalized. At the start of the trip, the device navigates the user's movements in real time and provides appropriate redirects if changes occur. A generative AI model optimizes prompts in a timely manner and provides the necessary information.

[0731] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0732] In an embodiment of this invention, the user uses a terminal and an interface to input a specific event name or artist name. They also select information related to their interests and preferences. The terminal sends the collected data to a server, which then collects relevant information based on the input. This includes retrieving data from an external database.

[0733] The server then uses an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's facial expressions and voice data to determine the user's emotional state at that moment. This emotional information is then used in the subsequent suggestion process to propose optimized tourist destinations and modes of transportation tailored to the user's state.

[0734] The guidance system provides interactive information based on the user's emotions. For example, if the user is feeling stressed, it will suggest relaxing sightseeing activities; conversely, if they are excited, it will suggest active events. This response is optimized in real time by an emotion engine.

[0735] The resulting schedule is designed to reflect the user's preferences while ensuring the most emotionally appropriate experience. Users can review this plan through their device and make changes if necessary. Reservations for accommodations and transportation based on the schedule are also automatically handled through the server.

[0736] For example, if a user is planning to attend an artist's concert, this system uses an emotion engine to analyze the user's motivation for that day and then suggests sightseeing destinations and plans that match their mood. If the user wants to relax that day, it suggests visiting quiet places; if they want energy, it suggests plans that include dynamic activities. This allows users to experience a fulfilling fan activity that includes emotional satisfaction.

[0737] The following describes the processing flow.

[0738] Step 1:

[0739] The user launches the application using their device and enters the name of an event or artist they are interested in into the search bar. They also specify a category of interest (such as "Concert" or "Tourism") as selection information.

[0740] Step 2:

[0741] The device sends unique and selected information entered by the user to the server. This data also includes the user's location information, preparing the suggestions for greater personalization.

[0742] Step 3:

[0743] Based on the information received, the server retrieves relevant event information from external APIs and internal databases. This includes information such as the event date, location, and associated cast.

[0744] Step 4:

[0745] The server activates the emotion engine and analyzes the user's current emotional state from facial images and voice data received from the terminal. This includes a process that uses machine learning models to identify emotions such as joy, sadness, and excitement.

[0746] Step 5:

[0747] The server integrates event information and the results of the emotion engine's analysis to suggest optimal sightseeing spots and travel routes based on the user's emotional state. These suggestions are prioritized based on emotion. For example, quiet places are recommended if relaxation is needed, while active events are recommended if stimulation is desired.

[0748] Step 6:

[0749] The server generates an optimal schedule for fan activities that reflects the results of the emotion engine. The generated schedule includes travel methods and sightseeing spots for each time of day, and is designed to provide the most comfortable experience for the user.

[0750] Step 7:

[0751] The generated schedule is sent to the device and displayed to the user. The user can review this plan and make fine adjustments according to their preferences.

[0752] Step 8:

[0753] Based on the user's final selections and adjustments, the terminal sends the final plan to the server, which then handles necessary accommodation bookings and transportation arrangements.

[0754] Step 9:

[0755] The server works in conjunction with the reservation system to complete reservations for services necessary for the user's fan activity plan. This includes booking hotel rooms and purchasing transportation tickets.

[0756] Step 10:

[0757] Information confirming the booking is sent to the terminal and notified to the user. The user can then use this information to proceed with their travel plans. (This is an expression for systemic multi-locale dynamic mutual multilayer flow processing systems based on multilingual communication across multi-digit local input-output proficiency.)

[0758] (Example 2)

[0759] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0760] Traditional systems had the problem of failing to improve user satisfaction because they suggested tourist destinations and transportation methods without considering the user's emotional state. Furthermore, they lacked efficiency because they required manual information gathering and booking procedures.

[0761] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0762] In this invention, the server includes terminal means, information processing means, emotion recognition means, guidance means that proposes experience information using a generative AI model, and reservation means. This enables the proposal of an optimal experience based on the user's emotional state and automated reservation processing.

[0763] A "terminal device" is an electronic device used by users to input information and collects event names and selection information through a user interface.

[0764] An "information processing device" is a device that generates information to be provided to the user by acquiring relevant data from an external information source based on data received from a terminal device.

[0765] An "emotion recognition device" is a device that analyzes the user's facial expression data and voice data in real time to determine the user's emotional state.

[0766] A "guidance device" is a system that uses a generative AI model to suggest optimal experience information based on the user's emotional state and interests.

[0767] A "reservation method" is a device that automatically arranges reservations for accommodations and transportation based on generated experience information.

[0768] A "generative AI model" is an artificial intelligence model that analyzes relevant information based on user input and emotional state, and optimizes the suggested content.

[0769] To implement this invention, the user uses a terminal to input information including the event name and artist name. The terminal is equipped with a user interface and has a function to receive selection information based on the user's interests and preferences. The terminal is responsible for transmitting the input data to the server.

[0770] The server uses information processing tools to retrieve relevant data from external sources based on data sent by the user. The generative AI model used in this step analyzes the retrieved information and generates optimal experience information tailored to the user's interests. This analysis process utilizes machine learning algorithms to capture data patterns and provide optimal suggestions.

[0771] Furthermore, the server uses emotion recognition to analyze the user's facial expressions and voice data in real time and determine their emotional state. This emotional information is used to make the generated experience information more aligned with the user's expectations. Image processing and speech recognition technologies are used for emotion recognition.

[0772] Through the guidance system, the server generates suggestions based on the user's emotional state and collected event information. Subsequently, reservations for tourist destinations and transportation are automatically made through the reservation system. This reservation process utilizes APIs that integrate with online reservation platforms. For example, if a user is planning to attend an artist's concert, the emotion engine analyzes the user's motivation for that day and provides corresponding tourist destinations and plans.

[0773] An example of a prompt for a generative AI model is, "If the user is looking to relax, what tourist attractions or activities would you suggest?" Using this prompt, it's possible to provide the optimal experience tailored to the user's needs.

[0774] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0775] Step 1:

[0776] The user uses the terminal to input a specific event name or artist name. The entered data is stored on the terminal through the user interface. At this stage, the output from the terminal is the string data entered by the user.

[0777] Step 2:

[0778] The terminal sends the collected input data to the server. This transmission process uses a communication protocol to transfer the data. The server receives the event name and artist name from the terminal as input.

[0779] Step 3:

[0780] The server uses information processing tools to retrieve relevant data from external sources based on the received data. This involves issuing database queries and performing data processing to gather event and artist information. The retrieved information is then stored on the server as relevant data.

[0781] Step 4:

[0782] The server uses emotion recognition to analyze the user's facial expressions and voice data. Data processing involves using face recognition and voice recognition algorithms to determine the user's emotional state. The output is metadata indicating the user's emotional state.

[0783] Step 5:

[0784] The server uses a generative AI model to generate optimal suggestions based on the user's emotional state and related data. Here, the AI ​​employs pattern recognition and machine learning to respond with prompt sentences. The suggested content is output as a plan for the user.

[0785] Step 6:

[0786] The server provides the user with generated suggestions through a guidance system. This presentation uses a visually engaging interface designed to capture the user's interest. The user receives this information and decides on their next action.

[0787] Step 7:

[0788] Based on the user's decision, the server automatically makes reservations for accommodations and transportation using booking methods. Here, an API is utilized to integrate with the booking system and proceed with the actual booking process. As output, booking confirmation information is presented to the user.

[0789] (Application Example 2)

[0790] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0791] In modern society, it is difficult for travelers to choose appropriate tourist destinations and experiences that suit their interests and emotional state at the time. In particular, the lack of real-time suggestions that take into account travelers' emotional states makes it challenging to provide highly satisfying tourist experiences. Furthermore, the suggestion and booking of transportation and accommodations optimized for travelers' needs are not being done efficiently.

[0792] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0793] In this invention, the server includes input means for the user to input unique information, selection information, and emotional information; information processing means for collecting relevant information based on the unique information, selection information, and emotional information; and guidance means for suggesting the optimal experience based on the relevant information and using an emotional analysis engine. This makes it possible to suggest the optimal tourist destinations and means of transportation according to the traveler's emotional state, thereby improving the traveler's satisfaction with the experience.

[0794] "Unique information" refers to individual information related to a specific person, place, or event that a user enters.

[0795] "Selected information" refers to information that users choose based on their own interests and preferences, and is data that concretizes their tourism options.

[0796] "Emotional information" refers to information that indicates the user's current psychological state, and is usually extracted from voice data or facial expression data.

[0797] "Information processing means" refers to a system component that has the function of accumulating and analyzing relevant information based on unique information, selection information, and emotional information obtained from the user.

[0798] "Guidance methods" refer to the system's function of suggesting appropriate tourist destinations and experiences to users based on collected data.

[0799] A "reservation processing method" is a system function that automatically arranges accommodation and transportation based on the generated information.

[0800] An "emotion analysis engine" is a technical means for identifying emotions from a user's voice and facial expressions and processing information accordingly.

[0801] An "external database" is a data aggregation platform used to obtain information required by a system from external sources.

[0802] The embodiment of the invention is realized through a user terminal, a server, and integration with an external database via the internet. The user terminal is a device such as a smartphone or tablet, and provides an interface for the user to input unique information, selection information, and emotional information. To acquire emotional information, a camera and microphone are used to perform image recognition and voice analysis.

[0803] The server collects information entered by the user and analyzes the data through information processing tools. This allows it to suggest optimal tourist destinations and experiences based on the user's emotional state. For example, sentiment analysis can be performed using Google Cloud Vision API or Amazon Rekognition. Information is also retrieved from external tourism databases, and real-time data analysis is performed.

[0804] Furthermore, by utilizing generative AI models, it is possible to generate prompt messages that correspond to the user's emotions and propose specific experiences based on those prompts. For example, if the user's emotional state is analyzed as "wanting to relax," the system will propose a plan that includes quiet tourist destinations and relaxing experiences.

[0805] Specifically, if a user inputs "I would like to be shown relaxing tourist destinations," the system will provide optimal suggestions based on prompts such as, "Please suggest quiet and relaxing tourist destinations and activities based on the user's current emotional state. The user is currently in Kyoto and is looking for a calming place." This makes it possible to provide a fulfilling tourist experience tailored to each individual user.

[0806] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0807] Step 1:

[0808] Users input unique information, selection information, and emotional information through the device. The device uses a camera and microphone to collect the user's facial expressions and voice, and sends this information to a server. The input data includes the user's name, location, activities of interest, and real-time emotional data.

[0809] Step 2:

[0810] The server begins processing information using the received data. Based on unique and selected information, it retrieves relevant tourist information from an external database. It also analyzes emotional information using an emotion analysis engine (e.g., Google Cloud Vision API) to identify the user's current emotional state. The input is unique information and emotional data from the user, and the output is the emotional state as an analysis result and candidate tourist information.

[0811] Step 3:

[0812] The server uses an AI model to generate prompts for the optimal tourist experience based on the analyzed emotional state. For example, it might generate a prompt such as, "Please suggest relaxing tourist destinations based on the user's current emotional state." Here, the emotional state (input) is converted into a prompt (output).

[0813] Step 4:

[0814] Based on the generated prompt, the server retrieves detailed information on the most suitable tourist destinations and experiences from an external database and provides it to the user through the guidance system. The final selected tourist destination or suggested experience is output. Specifically, this includes map information of the suggested location, the required time, and the booking status of the activity.

[0815] Step 5:

[0816] The user reviews the suggested experience and, if necessary, uses the guidance system to make reservations for accommodation and transportation. The server uses the reservation processing system to access the external reservation system and retrieve the reservation information. In response to the user's selections (input), it provides final reservation confirmation information (output).

[0817] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0818] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0819] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0820] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0821] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0822] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0823] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0824] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0825] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0826] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0827] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0828] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0829] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0830] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0831] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0832] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0833] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0834] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0835] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0836] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0837] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0838] The following is further disclosed regarding the embodiments described above.

[0839] (Claim 1)

[0840] An input means for the user to input unique information and selected information,

[0841] Information processing means for collecting related information based on the aforementioned unique information and selected information,

[0842] A guidance means for generating optimal travel routes and tourist destination information based on the aforementioned related information,

[0843] A reservation processing means for making a reservation using the generated information,

[0844] A system that includes this.

[0845] (Claim 2)

[0846] The system according to claim 1, wherein the information processing means includes a function for acquiring data from an external database.

[0847] (Claim 3)

[0848] The system according to claim 1, wherein the guidance means has the function of presenting multiple options.

[0849] "Example 1"

[0850] (Claim 1)

[0851] An input method for the user to input example information as unique information and activity categories as selected information,

[0852] Information processing means for collecting relevant information from an external information source or an internal data store based on the aforementioned unique information and selected information,

[0853] A guidance means for providing information on a specific event venue and surrounding tourist spots along an optimized travel route based on the aforementioned related information,

[0854] A reservation processing means for automatically making reservations for transportation and accommodation using the generated information,

[0855] A system that includes this.

[0856] (Claim 2)

[0857] The system according to claim 1, wherein the information processing means includes a function for acquiring data from an external data store and an internal analysis capability.

[0858] (Claim 3)

[0859] The system according to claim 1, wherein the guidance means has the function of presenting multiple sightseeing activities and travel plans based on the user's interests.

[0860] "Application Example 1"

[0861] (Claim 1)

[0862] An input method for the user to enter unique information, selected information, and the planned date of visit,

[0863] Information processing means for collecting relevant information based on the aforementioned unique information, selection information, and planned visit date, and for analyzing it while considering the user's interests and past activities,

[0864] A guidance means for generating tourist destination information, including the optimal travel route and length of stay, based on the aforementioned related information,

[0865] A reservation processing means for automatically making reservations for accommodations and transportation using the generated information,

[0866] A system that includes this.

[0867] (Claim 2)

[0868] The system according to claim 1, wherein the information processing means includes a function for acquiring data from an external database and a geographic information system.

[0869] (Claim 3)

[0870] The system according to claim 1, wherein the guidance means presents multiple options and has a function that allows the user to customize them.

[0871] "Example 2 of combining an emotion engine"

[0872] (Claim 1)

[0873] A terminal means for the user to input,

[0874] Information processing means for obtaining related data from an external information source based on information received from the aforementioned terminal,

[0875] An emotion recognition method for analyzing the user's emotional state,

[0876] A guidance method that uses a generative AI model to suggest the most suitable experience information,

[0877] A reservation means for automating reservations based on the generated experience information,

[0878] A system that includes this.

[0879] (Claim 2)

[0880] The system according to claim 1, wherein the information processing means has a function to acquire data in cooperation with an external information source.

[0881] (Claim 3)

[0882] The system according to claim 1, wherein the emotion recognition means has the function of analyzing the user's facial expression data and voice data in real time.

[0883] "Application example 2 of combining emotional engines"

[0884] (Claim 1)

[0885] An input means for the user to input unique information, selection information, and emotional information,

[0886] Information processing means for collecting relevant information based on the aforementioned unique information, selection information, and emotional information,

[0887] Based on the aforementioned related information, a guidance means for suggesting the optimal experience using an emotion analysis engine is provided.

[0888] A reservation processing means for making reservations using the generated information and optimizing the user experience,

[0889] A system that includes this.

[0890] (Claim 2)

[0891] The system according to claim 1, wherein the information processing means comprises a function for acquiring data from an external database and an emotion analysis engine.

[0892] (Claim 3)

[0893] The system according to claim 1, wherein the guidance means has a function to optimize and present multiple options in real time based on the user's emotional state. [Explanation of Symbols]

[0894] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. An input means for the user to input unique information and selected information, Information processing means for collecting related information based on the aforementioned unique information and selected information, A guidance means for generating optimal travel routes and tourist destination information based on the aforementioned related information, A reservation processing means for making a reservation using the generated information, A system that includes this.

2. The system according to claim 1, wherein the information processing means includes a function for acquiring data from an external database.

3. The system according to claim 1, wherein the guidance means has the function of presenting multiple options.

Images