System

Abstract

A system is provided.SOLUTION: A system comprising: means for registering a traveler's interest, concern, and budget; means for the traveler to check in at a visiting place; means for proposing tourist spots, restaurants, and souvenir information in real time based on the check-in information; means for making a re-proposal when the degree of satisfaction with the proposal is low; means for providing route guidance, ticket reservation, store reservation, and partner coupon information when a destination is determined; means for acquiring points by sharing reviews and images after travel; and means for proposing a next destination by learning the traveler's action history and reviews.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Traditional travel planning methods require detailed schedules to be created in advance, which is inconvenient for people who are not good at planning or who want flexibility when they arrive. Additionally, there are no real-time suggestions during the trip, making it difficult to find experiences that match your interests. Furthermore, travel-related companies have limited means to collect and analyze detailed traveler behavior data and use it for marketing and service improvement. [Means for solving the problem]

[0005] This invention provides a system that suggests tourist spots, restaurants, and souvenir information in real time to travelers by having them first register their interests, preferences, and budget and then check in at their destinations. If the suggestions are not satisfactory, the system will make new suggestions, and once the destination is decided, it will provide route guidance, ticket reservations, and partner coupon information. It also allows travelers to earn points by sharing reviews and images after the trip, and learns from travelers' behavioral history and reviews to suggest their next destination, personalizing and enhancing the travel experience. Furthermore, the system supports multiple languages, allowing small businesses and local governments to expand their services over a wide area, and the system allows for the use of detailed traveler data for marketing and service improvement.

[0006] "Traveler" refers to a person who travels and is a user of this system.

[0007] "Interests" refer to specific themes or activities that a traveler is interested in, and are items registered in this system.

[0008] "Interests" refers to the things or subjects that a traveler is specifically interested in, and is information about the traveler's hobbies and preferences.

[0009] "Budget" refers to the amount of money a traveler plans to spend during their trip, and is an item that is registered in this system.

[0010] "Checking in" refers to the act of a traveler notifying the system that they have arrived at a place they are visiting, and is the process of sending their current location information.

[0011] "Suggestions" refers to a list of recommended tourist spots, restaurants, souvenir information, etc. that the system generates based on the traveler's current location and registered information.

[0012] "Route Guidance" refers to the function of providing travelers with information showing them how to get to their destination.

[0013] "Ticket reservation" refers to the process of securing admission tickets to tourist attractions, events, etc. in advance.

[0014] "Coupon information" refers to information about discounts and benefits that can be used at affiliated stores and services.

[0015] "Reviews" refer to ratings and impressions of places visited and experiences, and are information shared within the system.

[0016] "Points" refers to rewards that travelers can earn through activities such as reviews and photo sharing.

[0017] "Behavioral history" refers to the record of places visited and activities undertaken by travelers using the system.

[0018] "Re-suggestion" refers to the process by which the system makes an alternative suggestion if the traveler is not satisfied with the initial suggestion.

[0019] "Multilingual" refers to the system's ability to be available in multiple languages, accommodating travelers who speak different languages.

[0020] "Small-scale stores" refer to stores that are small in scale and have limited number of employees and store space.

[0021] "Local government" refers to a local public body that has jurisdiction over a specific area, including local governments and cities, towns, and villages.

[0022] "Deploying a Service" refers to the widespread development of services and features offered.

[0023] "Travel-related companies" refers to companies and organizations related to the travel industry, including travel agencies, hotels, and tourist facilities.

[0024] "Marketing" refers to the activities and methods used to promote and spread products and services to consumers.

[0025] "Service Improvement" refers to efforts or changes made to improve the quality of the services we provide.

[0026] "Utilizing data" refers to analyzing collected information and using it to provide better services and make proposals. [Brief explanation of the drawings]

[0027] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0028] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0029] First, the terms used in the following description will be explained.

[0030] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0031] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0032] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0033] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0034] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0035] [First embodiment]

[0036] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0037] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0038] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0039] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0040] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0041] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0042] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0043] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0044] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0045] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0046] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0047] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0048] To implement this invention, the following system configuration and program processing are required. The system is primarily comprised of interactions between three parties: a server, a terminal, and a user. Because questions about each processing step will be asked later, we will not go into detail about the processing steps here, but will explain the overall flow and provide specific examples.

[0049] System Configuration

[0050] The system includes a traveler (user) device, a central server, and a database and APIs that provide various travel-related services. The server stores user registration information and handles real-time suggestions, reservations, and review collection. The device provides an interface for users to plan trips and accept suggestions through the app.

[0051] Program processing overview

[0052] User Registration

[0053] Users launch the app on their device and enter their interests and budget.

[0054] The terminal sends this information to the server, which stores it in a database.

[0055] Arrival and check-in

[0056] When the user arrives at the location and presses the check-in button, the device obtains the user's current location information.

[0057] The device sends its current location information to the server, which then searches for information on nearby tourist attractions, restaurants, and souvenirs in real time.

[0058] Real-time suggestions

[0059] The server generates a list of suggestions based on the user's current location and registered information (interests, concerns, budget) and sends it to the device.

[0060] The user can review the list of suggestions on their device and make a selection.

[0061] If the proposal is not satisfactory, a re-proposal request is sent to the server, which makes a new proposal.

[0062] Destination confirmation, navigation and reservations

[0063] Once the user selects a destination, the device sends that information to the server.

[0064] The server provides detailed route guidance, necessary ticket information, and store reservation procedures, and obtains coupon information from affiliated companies.

[0065] The server sends all this information to the terminal, which displays it to the user.

[0066] Review and earn points after your visit

[0067] Once users have completed their experience at a destination, they can post reviews and photos on their device.

[0068] The terminal sends the review information to the server, which stores it in a database.

[0069] The server awards points to the user and sends a point notification to the terminal.

[0070] Plan your next trip

[0071] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews.

[0072] The server sends the new proposal list to the terminal, which displays it to the user.

[0073] Specific examples

[0074] Example 1: Sightseeing in Tokyo

[0075] The user (Mr. Tanaka) launches the app and registers his interests as "history" and "food" and his budget as "5,000 yen a day."

[0076] Tanaka arrives at Tokyo Station and checks in.

[0077] The server generates a list of suggestions for historical buildings and restaurants around Tokyo Station and sends it to Tanaka's device.

[0078] Tanaka selects the suggested Sensoji Temple and a famous udon restaurant and checks the details.

[0079] The server provides route guidance and handles reservation procedures, and all information is displayed on Tanaka's device.

[0080] After visiting, Tanaka posts a review and photos and earns points.

[0081] In this way, the system gives travelers flexibility in their travels and allows them to enjoy experiences that are tailored to their interests in real time, while enabling travel companies to use detailed data to improve their marketing and services.

[0082] The processing flow will be explained below.

[0083] User Registration

[0084] Step 1:

[0085] The user installs the app on their device and launches it for the first time.

[0086] Step 2:

[0087] The device displays a form for the user to enter their interests and budget.

[0088] Step 3:

[0089] The user fills out the form with their interests, concerns, and budget and clicks the submit button.

[0090] Step 4:

[0091] The terminal transmits the input information to the server.

[0092] Step 5:

[0093] The server stores the received information in a database and sends a registration confirmation response to the terminal.

[0094] Step 6:

[0095] The device will display "Registration complete" to the user.

[0096] Arrival and check-in

[0097] Step 1:

[0098] The user arrives at the location and opens the app.

[0099] Step 2:

[0100] The device obtains GPS data and determines its current location.

[0101] Step 3:

[0102] The user clicks the check-in button.

[0103] Step 4:

[0104] The device sends its current location and user ID to the server.

[0105] Step 5:

[0106] The server searches for information on tourist spots, restaurants, and souvenirs around the current location and generates a list of suggestions.

[0107] Step 6:

[0108] The server sends the generated list to the terminal.

[0109] Step 7:

[0110] The device displays a list of suggestions to the user.

[0111] Real-time suggestions

[0112] Step 1:

[0113] The user taps on an item of interest from the list of suggestions.

[0114] Step 2:

[0115] The device displays a detailed information screen for the selected item.

[0116] Step 3:

[0117] The user checks for more information.

[0118] Step 4:

[0119] If the user is not satisfied with the suggestion, he or she clicks the Re-suggest button.

[0120] Step 5:

[0121] The terminal sends a re-proposal request to the server.

[0122] Step 6:

[0123] The server generates a list of alternative suggestions and sends it to the terminal.

[0124] Step 7:

[0125] The device will display the new suggestions list to the user.

[0126] Destination confirmation, navigation and reservations

[0127] Step 1:

[0128] The user selects the proposal that satisfies them and confirms their destination.

[0129] Step 2:

[0130] The terminal transmits destination confirmation information to the server.

[0131] Step 3:

[0132] The server generates detailed route directions to the destination.

[0133] Step 4:

[0134] The server handles the necessary ticket information and restaurant reservation procedures.

[0135] Step 5:

[0136] The server acquires coupon information from the partner.

[0137] Step 6:

[0138] The server sends all the information to the terminal.

[0139] Step 7:

[0140] The device displays route guidance, ticket information, reservation confirmation, and coupon information to the user.

[0141] Review and earn points after your visit

[0142] Step 1:

[0143] The user opens the app after visiting a location.

[0144] Step 2:

[0145] The user is directed to the review submission screen.

[0146] Step 3:

[0147] The device will display a review input form.

[0148] Step 4:

[0149] The user enters a review and image and clicks the submit button.

[0150] Step 5:

[0151] The device sends the review and image data to the server.

[0152] Step 6:

[0153] The server stores the data in a database.

[0154] Step 7:

[0155] The server awards points to the user and sends a point notification to the terminal.

[0156] Step 8:

[0157] The terminal will display a message to the user saying that points have been added.

[0158] Plan your next trip

[0159] Step 1:

[0160] The user restarts the app the next time they travel.

[0161] Step 2:

[0162] The device sends the user ID to the server.

[0163] Step 3:

[0164] The server generates a new list of suggestions based on past travel data and reviews.

[0165] Step 4:

[0166] The server sends the new proposal list to the terminal.

[0167] Step 5:

[0168] The device displays a list of suggestions to the user.

[0169] Through these detailed processing steps, the system provides travelers with real-time personalized information to optimize their travel experience, while enabling travel-related companies to improve their services by providing detailed data analysis.

[0170] Example 1

[0171] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0172] Today's travelers are required to plan trips that meet their diverse needs and interests. However, existing travel support systems face challenges in that they are unable to respond flexibly in real time or provide optimal suggestions for individual travelers. In particular, there is a demand for technology that can efficiently and centrally handle a series of processes, including on-site information gathering, updating of suggestions, reservation procedures, and point awarding.

[0173] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0174] In this invention, the server includes means for registering a traveler's interests, concerns, and budget, means for the traveler to check in at a destination, means for suggesting tourist spots, restaurants, and souvenir information in real time based on check-in information, means for making re-suggestions if satisfaction with the suggestions is low, means for providing route guidance, ticket reservations, store reservations, and affiliated coupon information when the destination is decided, means for sharing reviews and images after the trip and earning points, means for learning the traveler's behavioral history and reviews to suggest the next destination, means for generating a suggestion list based on the traveler's current location and registration information using a generative AI model, means for sending the suggestion list to a terminal and making new suggestions based on a re-suggestion request, means for saving review information after the visit in a database and awarding points, means for obtaining surrounding information in real time using an affiliated tourist information providing API, means for the terminal to obtain current location information using GPS, and means for providing detailed route guidance, ticket information, and store reservation procedures using an external API.

[0175] This will enable us to respond to the diverse needs of travelers, provide optimal travel plans for each individual traveler in real time, and ensure an efficient travel experience.

[0176] "Tourist" refers to an individual or group traveling for the purpose of travel.

[0177] "Interest" refers to a traveler's interest or motivation in a particular topic or activity.

[0178] "Interests" refers to the interest a traveler has in a particular place, culture, activity, etc.

[0179] "Budget" refers to the amount of money a traveler can spend on a trip.

[0180] "Terminal" refers to an electronic device used by a user, such as a smartphone or tablet.

[0181] A "server" refers to a computer system that communicates with terminals via a network and processes and stores data.

[0182] A "database" refers to a system that stores information in an organized manner and enables it to be searched and manipulated.

[0183] "GPS" refers to the Global Positioning System, a system for determining locations on Earth.

[0184] "Check-in" refers to the act of a traveler reporting their arrival at a particular location via a terminal.

[0185] "Suggestion list" refers to a list of recommended tourist spots, restaurants, etc. generated by the server based on the traveler's interests, preferences, budget, and current location information.

[0186] "Re-proposal" refers to the process of making a new proposal if the initial proposal is dissatisfied.

[0187] "Destination" refers to the place a traveler chooses to visit.

[0188] "Route guidance" refers to guidance information that provides travelers with the optimal route to reach their destination.

[0189] "Ticket reservation" refers to the process of securing tickets in advance for transportation, events, etc.

[0190] "Coupon Information" refers to information regarding discounts and benefits offered by our partners.

[0191] A "review" refers to a traveler's act of writing an evaluation or opinion about their experience at a destination.

[0192] "Points" refers to rewards travelers earn through reviews and other activities.

[0193] "Behavioral history" refers to a record of a traveler's past trips and places visited.

[0194] A "generative AI model" refers to an algorithmic model that uses machine learning to make optimal suggestions and predictions from data.

[0195] "API" refers to an application programming interface that enables communication with other software systems.

[0196] To implement this invention, a system configuration is required that includes a traveler (user) terminal, a central server, and a database and APIs that provide various travel-related services. The system is primarily comprised of interactions between the server, terminal, and user.

[0197] System Configuration

[0198] The system consists of a user's device (such as a smartphone or tablet), a central server, and partnered external tourism information APIs (e.g., Google Places API and Google Maps API). The server stores user registration information and provides real-time suggestions, reservations, and reviews. The device provides an interface for users to accept travel plans and suggestions through the app.

[0199] Program processing overview

[0200] The program works as follows:

[0201] 1. User Registration

[0202] The user launches the app and enters their interests and budget, and the device sends this information to the server.

[0203] The server stores the received information in a database.

[0204] Examples:

[0205] A user registers their interests as "history" and "food" and a budget of "5,000 yen per day."

[0206] Example prompt: "What are your hobbies at your travel destination? For example, history, food, shopping, etc."

[0207] 2. Arrival and check-in

[0208] When the user arrives at the location and presses the check-in button, the device uses GPS to obtain their current location information.

[0209] The device sends its current location information to the server, and the server then calls an affiliated tourist information provider API to obtain information about the surrounding area.

[0210] Examples:

[0211] The user arrives at Tokyo Station and checks in.

[0212] Example prompt: "Send me tourist information about my current location. Generate a list of nearby attractions."

[0213] 3. Real-time suggestions

[0214] The server uses a generative AI model based on the user's current location and registration information to generate a list of suggestions and sends it to the device.

[0215] The user can view and select from a list of suggestions on their device. If they are not satisfied with the suggestions, a re-suggestion request is sent to the server, and a new suggestion is made.

[0216] Examples:

[0217] Users can select Sensoji Temple or a famous udon restaurant and check detailed information.

[0218] Example prompt: "Create a new list of suggestions based on the user's interests and location."

[0219] 4. Destination confirmation, navigation and reservations

[0220] Once the user selects their destination, the device sends that information to the server, which then provides detailed route guidance, necessary ticket information, store reservations, and obtains coupon information from affiliated companies.

[0221] All this information is sent to the terminal and displayed to the user.

[0222] Examples:

[0223] The server provides route guidance and handles reservation procedures, and all information is displayed on the user's device.

[0224] Example prompt: "Suggest route directions, ticket information, and booking procedures."

[0225] 5. Review after your visit and earn points

[0226] After the user has finished their experience at a destination, they can post a review and photos on their device, which then sends the review information to the server, which then stores it in a database.

[0227] The server awards points and sends a point notification to the terminal.

[0228] Examples:

[0229] Users post reviews and photos and earn points.

[0230] Example prompt: "Receive user ratings and photo submissions and generate point award notifications."

[0231] 6. Planning your next trip

[0232] The next time the user launches the app, the server generates a new list of suggestions based on past behavioral history and reviews and sends it to the device.

[0233] The device displays a list of suggestions to the user.

[0234] Examples:

[0235] The server analyzes past behavioral history and reviews to create a new list of suggestions.

[0236] Example prompt: "Create a new list of suggestions based on your past behavioral history and reviews."

[0237] The system allows users to enjoy flexible travel plans tailored to their interests in real time, while travel-related companies can use the detailed data to improve their marketing and services.

[0238] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0239] Program processing flow

[0240] Step 1: User Registration

[0241] The user launches the app.

[0242] The user inputs their interests and budget. The input data is interests (e.g., "history," "food"), interests (e.g., "activity," "shopping"), and budget (e.g., "5,000 yen per day").

[0243] The terminal converts the input data into JSON format and sends it to the server.

[0244] The server stores the received information in a database, using a database such as MySQL, and performs transaction processing to maintain data consistency.

[0245] Input: User interests, preferences, and budget data

[0246] Data processing: Convert to JSON format

[0247] Output: User data sent to the server

[0248] Step 2: Arrival and check-in

[0249] The user arrives at the location and presses the check-in button on the app.

[0250] The device uses GPS to obtain the current location information.

[0251] The device converts the current location information into JSON format and sends it to the server.

[0252] The server calls an affiliated tourist information provider API (e.g., Google Places API) based on the current location information, formats the data obtained from the API, and saves it.

[0253] Input: Current location information (GPS data)

[0254] Data processing: Convert to JSON format, call tourist information API

[0255] Output: Current location data and tourist information sent to the server

[0256] Step 3: Real-time proposals

[0257] The server uses a generative AI model to generate a list of suggestions based on the user's current location and registration information.

[0258] The generative AI model takes inputs such as interests, preferences, budget, and current location, and suggests travel plans suitable for the user in real time.

[0259] The server converts the generated proposal list into JSON format and sends it to the device.

[0260] The device displays a list of suggestions to the user.

[0261] Input: User location, interests, preferences, and budget data

[0262] Data processing: Generate a proposal list using a generative AI model and convert it into JSON format

[0263] Output: Suggestion list

[0264] Step 4: Confirm destination, navigate and book

[0265] The user selects a destination from a list of suggestions.

[0266] The terminal converts the selected data into JSON format and sends it to the server.

[0267] Based on the selection information, the server calls an external API (e.g., Google Maps API, API for a reservation site) to provide route guidance, ticket information, and store reservation procedures.

[0268] The server acquires coupon information from the partner.

[0269] The server converts this information into JSON format and sends it to the terminal.

[0270] The device displays the information it receives to the user.

[0271] Input: Destination selection information

[0272] Data processing: Convert to JSON format, call external API, get coupon information

[0273] Output: Route directions, ticket information, reservation information

[0274] Step 5: Review after your visit and earn points

[0275] After visiting, users post reviews and photos within the app.

[0276] The device converts reviews and images into JSON format and sends them to the server.

[0277] The server stores the review information in a database, where it is analyzed by a rating algorithm.

[0278] The server awards points, converts the point notification into JSON format, and sends it to the terminal.

[0279] The terminal displays a point award notification to the user.

[0280] Input: Review information and images

[0281] Data processing: Convert to JSON format and analyze using evaluation algorithms

[0282] Output: Save to database, point allocation notification

[0283] Step 6: Plan your next trip

[0284] The next time the user launches the app.

[0285] The server uses a generative AI model to create a new list of suggestions based on past behavioral history and reviews.

[0286] The server converts the generated new proposal list into JSON format and sends it to the device.

[0287] The device displays a list of suggestions to the user.

[0288] Input: Past activity history and reviews

[0289] Data processing: Generate a new proposal list using a generative AI model and convert it into JSON format

[0290] Output: New proposal list

[0291] In this way, detailed data processing and calculations are carried out at each step, and the system provides optimal travel plans in real time. This process allows users to plan their trips flexibly, and travel-related companies can make more efficient marketing efforts.

[0292] (Application example 1)

[0293] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0294] Conventional travel support systems suggest tourist spots and restaurants based on travelers' interests and budgets, but provide transportation options individually and lack a centralized means for managing real-time suggestions and reservation procedures. As a result, travelers often spend time and effort traveling to their destinations and completing various reservation procedures. To achieve greater efficiency and improve user experience, a system is needed that can summon an autonomous vehicle based on the traveler's current location and provide real-time suggestions for tourist spots and restaurants, route guidance, and reservation procedures in an integrated manner.

[0295] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0296] In this invention, the server includes means for registering a traveler's interests, preferences, and budget, means for the traveler to check in at a destination, means for suggesting tourist spots, restaurants, and souvenirs in real time based on the check-in information, means for making re-suggestions if the suggestion is not satisfactory, means for providing route guidance, ticket reservations, restaurant reservations, and partner coupon information when the destination is decided, means for sharing reviews and images after the trip and earning points, means for learning the traveler's behavioral history and reviews to suggest the next destination, means for calling an autonomous vehicle and guiding it to the destination based on the traveler's current location information, and means for linking with the autonomous vehicle to suggest tourist spots and restaurants, provide route guidance, and make reservations in real time. This enables travelers to manage transportation, tourist information, and reservation procedures in an integrated manner within a single system.

[0297] "Tourist" refers to a person who visits a tourist spot or destination.

[0298] "Interest" refers to a traveler's interest in a particular activity or place.

[0299] "Interest" refers to a focus on specific genres or themes that interest travelers.

[0300] "Budget" refers to the amount of money a traveler decides to spend on their trip.

[0301] "Location Information" refers to a traveler's real-time geographic location obtained through GPS or location-based services.

[0302] "Check-in" refers to the act of a traveler notifying the system that they have arrived at a particular location.

[0303] "Real-time suggestions" refers to providing instant information about tourist spots and restaurants based on the traveler's current location and registration information.

[0304] "Re-proposal" refers to making a new proposal if the traveler is not satisfied with the initial proposal.

[0305] A "destination" refers to a specific place or facility that a traveler ultimately wants to reach.

[0306] "Route Guidance" refers to providing detailed directions for a traveler to travel from their current location to their destination.

[0307] "Ticket reservation" refers to the process of reserving tickets for transportation or tourist attractions in advance.

[0308] "Restaurant reservations" refers to the process of making advance reservations for restaurants, shops, and other establishments.

[0309] "Coupon information from affiliated stores" refers to discount and special offer information provided by affiliated stores and facilities.

[0310] A "review" refers to a traveler's evaluation or impressions of the places or facilities they visited after their trip.

[0311] "Points" refers to rewards given to travelers for actions such as writing reviews and sharing photos after a trip.

[0312] "Behavioral history" refers to records of places a traveler has visited and services they have used in the past.

[0313] An "autonomous vehicle" is a vehicle that has the ability to travel automatically to a destination without a human driver.

[0314] "Navigation" refers to providing guidance on the route to a destination.

[0315] "Real-time" refers to the instantaneous provision of information and services.

[0316] The system includes a traveler (user) device, a central server, and a database and API that provide various travel-related services. The server stores user registration information, makes real-time suggestions, and collects reviews. The device provides an interface for users to plan trips and accept suggestions through the app.

[0317] First, users launch the app on their device and enter their interests and budget. This information is sent from the device to the server, which stores it in a database. When the user arrives at a destination and presses the check-in button, the device acquires their current location information and sends it to the server. The server receives this information and makes real-time recommendations about tourist spots, restaurants, and souvenirs based on the user's current location and registered information.

[0318] The server also has the ability to make a second suggestion if the user is not satisfied with the suggestion. When the user selects a suggestion that satisfies them, the destination is determined and the device sends this information to the server. The server then provides detailed route guidance, necessary ticket information, and store reservation procedures, and also obtains coupon information from affiliated companies. This information is then sent to the device and displayed to the user.

[0319] When using an autonomous vehicle, the system will call the vehicle based on the user's current location and guide them to their destination. The autonomous vehicle will then integrate and manage real-time suggestions for tourist spots and restaurants, route guidance, and reservation procedures.

[0320] After a trip, users can share reviews and photos on their devices and send them to the server. The server stores this information in a database and awards points to the user. The server also learns from the user's behavioral history and reviews, and generates a new list of recommendations for the next trip.

[0321] The main hardware used is a smartphone, and the software is an HTTP request library (requests) that handles communication between the user device and the server. User input and location information are sent to the server, which then retrieves data from multiple APIs and makes suggestions tailored to the user's interests and budget.

[0322] As a concrete example, suppose a user starts the app, registers their interest in "history" and "food," and sets their travel budget to "5,000 yen." If the user arrives at the center of a large city as their destination, the server will suggest nearby historical buildings and famous restaurants. If the user selects a historical building and a well-known restaurant in Asakusa, detailed route guidance and reservation information will be displayed on the smartphone. Then, the autonomous vehicle will safely guide the user to their destination.

[0323] An example prompt for a generative AI model is:

[0324] "What is the specification for an application that, after a user arrives in the center of a large city, recommends tourist spots and restaurants based on his interests and budget?"

[0325] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0326] Step 1:

[0327] User Registration

[0328] The user launches the application on their smartphone and enters their interests and budget. This inputs the user's personal information and travel preferences into the application. The device then sends this information to the server, which stores it in a database. The output is that the user's information is recorded in a database stored on the server.

[0329] Step 2:

[0330] Arrival and check-in

[0331] When the user arrives at their destination, they press the check-in button on the device. The device uses GPS to obtain the user's current location and sends that location data to the server. The server uses the user's current location information as input, and records the current location information in real time on the server side as output.

[0332] Step 3:

[0333] Real-time suggestions

[0334] The server generates a list of recommendations for tourist spots, restaurants, and souvenirs based on the user's current location and pre-registered interests and budget. The server then calls the relevant APIs to retrieve the necessary data and filters the information that matches the user's criteria. The output is a recommendation list that is sent to the user's device.

[0335] Step 4:

[0336] Re-proposal

[0337] If the user is not satisfied with the proposal list, they request a re-proposal. The device sends this request to the server, and the server generates a new proposal list and sends it back to the user device. The input is the user's re-proposal request, and the output is the new proposal list.

[0338] Step 5:

[0339] Destination confirmation, navigation and reservations

[0340] When a user selects a destination from the list of suggestions, the device sends the selection information to the server, which then generates detailed route guidance and uses partner APIs to handle ticket information and reservation procedures. The output is obtained by sending route guidance, ticket information, and store reservation information to the user's device.

[0341] Step 6:

[0342] Autonomous vehicle collaboration

[0343] Based on the user's current location information, an autonomous vehicle is called and navigation to the destination is provided. The device sends the current location information to the server, and the server calls the autonomous vehicle's API to dispatch a vehicle and send navigation information to the user's device. The input is the user's current location information, and the output is vehicle dispatch and navigation information.

[0344] Step 7:

[0345] Post-trip reviews and points

[0346] Users review their experiences at the places they visit and upload images. The device sends this information to the server, which stores it in a database. The server then awards points to the user and sends a notification to the device. The input is the review information and images, and the output is the saved database and a notification that points have been awarded.

[0347] Step 8:

[0348] Plan your next trip

[0349] The next time the user launches the app, the server generates a new list of suggestions based on their past travel history and reviews, providing them with an up-to-date travel plan tailored to their preferences. The input is their past travel history and reviews, and the output is a new list of suggestions.

[0350] As a concrete example, consider the case where a user launches the app, registers their interest in "history" and "gourmet food," and sets a travel budget of "5,000 yen." When the user arrives at the center of a large city as their destination, the server suggests nearby historical buildings and famous restaurants. After the user selects a historical building and a well-known restaurant in Asakusa, detailed route guidance and reservation information are displayed on the smartphone, and the autonomous vehicle safely guides the user to their destination.

[0351] An example prompt for a generative AI model is:

[0352] "What is the specification for an application that, after a user arrives in the center of a large city, recommends tourist spots and restaurants based on his interests and budget?"

[0353] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0354] System Configuration

[0355] To implement this invention, the following system configuration is required. The system is primarily comprised of interactions between the server, the terminal, and the user. In addition, the emotion engine has the function of recognizing the user's emotional state and adjusting the content of suggestions based on that. Since questions about each processing step will be asked later, we will now provide an overview of the processing steps and explain the overall system flow using concrete examples.

[0356] System Configuration and Functions

[0357] The system includes a traveler (user) device, a central server, a database and APIs that provide various travel-related services, and an emotion engine. The server stores user registration information and is responsible for real-time suggestions, reservations, and review collection. The emotion engine recognizes emotions from the user's facial expressions and voice and sends the data to the server.

[0358] Program processing overview

[0359] User Registration

[0360] The user installs the app on their device and launches it for the first time.

[0361] The device displays a form for the user to enter their interests and budget.

[0362] The user fills out the form with their interests, concerns, and budget and clicks the submit button.

[0363] The terminal sends the entered information to the server, which stores it in a database.

[0364] Arrival and check-in

[0365] When the user arrives at the location and presses the check-in button, the device obtains the user's current location information.

[0366] The device sends its current location information to the server, which then searches for information on nearby tourist attractions, restaurants, and souvenirs in real time.

[0367] Emotion Recognition and Real-Time Suggestions

[0368] The server generates a proposal list and sends it to the terminal.

[0369] The emotion engine analyzes the user's facial expressions and voice to recognize their emotional state.

[0370] The device also sends emotional data to the server, which then adjusts the suggestion list based on the user's emotional state.

[0371] Users can tap on an item of interest from the list of suggestions to view more information.

[0372] If the proposal is not satisfactory, a re-proposal request is sent to the server, which makes a new proposal.

[0373] Destination confirmation, navigation and reservations

[0374] Once the user selects a destination, the device sends that information to the server.

[0375] The server provides detailed route guidance, necessary ticket information, and store reservation procedures, and obtains coupon information from affiliated companies.

[0376] The server sends all this information to the terminal, which displays it to the user.

[0377] Review and earn points after your visit

[0378] Once users have completed their experience at a destination, they can post reviews and photos on their device.

[0379] The terminal sends the review information to the server, which stores it in a database.

[0380] The server awards points to the user and sends a point notification to the terminal.

[0381] Plan your next trip

[0382] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews.

[0383] The server sends the new proposal list to the terminal, which displays it to the user.

[0384] Specific examples

[0385] Example 1: Sightseeing in Tokyo

[0386] The user (Mr. Tanaka) launches the app and registers his interests as "history" and "food" and his budget as "5,000 yen a day."

[0387] Tanaka arrives at Tokyo Station and checks in.

[0388] The server generates a list of suggestions for historical buildings and restaurants around Tokyo Station and sends it to Tanaka's device.

[0389] The emotion engine analyzes Tanaka's facial expression and recognizes that she is relaxed.

[0390] Based on this emotional data, the server will include relaxing cafes and quiet tourist spots in its suggestion list.

[0391] Tanaka selects the suggested Sensoji Temple and a famous Japanese restaurant and checks the details.

[0392] The server provides route guidance and handles reservation procedures, and all information is displayed on Tanaka's device.

[0393] After visiting, Tanaka posts a review and photos and earns points.

[0394] In this way, the system allows travelers to be flexible in their travels and enjoy experiences tailored to their interests and emotional state in real time, while enabling travel companies to use detailed data to improve their marketing and services.

[0395] The processing flow will be explained below.

[0396] User Registration

[0397] Step 1:

[0398] The user installs the app on their device and launches it for the first time.

[0399] Step 2:

[0400] The device displays a form for the user to enter their interests and budget.

[0401] Step 3:

[0402] The user fills out the form with their interests, concerns, and budget and clicks the submit button.

[0403] Step 4:

[0404] The terminal transmits the input information to the server.

[0405] Step 5:

[0406] The server stores the received information in a database and sends a registration confirmation response to the terminal.

[0407] Step 6:

[0408] The device will display "Registration complete" to the user.

[0409] Arrival and check-in

[0410] Step 1:

[0411] The user arrives at the location and opens the app.

[0412] Step 2:

[0413] The device obtains GPS data and determines its current location.

[0414] Step 3:

[0415] The user clicks the check-in button.

[0416] Step 4:

[0417] The device sends its current location and user ID to the server.

[0418] Step 5:

[0419] The server searches for information on tourist spots, restaurants, and souvenirs around the current location and generates a list of suggestions.

[0420] Step 6:

[0421] The server sends the generated list to the terminal.

[0422] Step 7:

[0423] The device displays a list of suggestions to the user.

[0424] Emotion Recognition and Real-Time Suggestions

[0425] Step 1:

[0426] The emotion engine analyzes the user's facial expressions and voice to recognize their emotional state.

[0427] Step 2:

[0428] The device transmits the emotion data to the server.

[0429] Step 3:

[0430] The server adjusts the suggestion list based on the user's emotional state.

[0431] Step 4:

[0432] The user taps on an item of interest from the list of suggestions.

[0433] Step 5:

[0434] The device displays a detailed information screen for the selected item.

[0435] Step 6:

[0436] The user checks for more information.

[0437] Step 7:

[0438] If the user is not satisfied with the suggestion, he or she clicks the Re-suggest button.

[0439] Step 8:

[0440] The terminal sends a re-proposal request to the server.

[0441] Step 9:

[0442] The server generates a list of alternative suggestions and sends it to the terminal.

[0443] Step 10:

[0444] The device will display the new suggestions list to the user.

[0445] Destination confirmation, navigation and reservations

[0446] Step 1:

[0447] The user selects the proposal that satisfies them and confirms their destination.

[0448] Step 2:

[0449] The terminal transmits destination confirmation information to the server.

[0450] Step 3:

[0451] The server generates detailed route directions to the destination.

[0452] Step 4:

[0453] The server handles the necessary ticket information and restaurant reservation procedures.

[0454] Step 5:

[0455] The server acquires coupon information from the partner.

[0456] Step 6:

[0457] The server sends all the information to the terminal.

[0458] Step 7:

[0459] The device displays route guidance, ticket information, reservation confirmation, and coupon information to the user.

[0460] Review and earn points after your visit

[0461] Step 1:

[0462] The user opens the app after visiting a location.

[0463] Step 2:

[0464] The user is directed to the review submission screen.

[0465] Step 3:

[0466] The device will display a review input form.

[0467] Step 4:

[0468] The user enters a review and image and clicks the submit button.

[0469] Step 5:

[0470] The device sends the review and image data to the server.

[0471] Step 6:

[0472] The server stores the data in a database.

[0473] Step 7:

[0474] The server awards points to the user and sends a point notification to the terminal.

[0475] Step 8:

[0476] The terminal will display a message to the user saying that points have been added.

[0477] Plan your next trip

[0478] Step 1:

[0479] The user restarts the app the next time they travel.

[0480] Step 2:

[0481] The device sends the user ID to the server.

[0482] Step 3:

[0483] The server generates a new list of suggestions based on past travel data and reviews.

[0484] Step 4:

[0485] The server sends the new proposal list to the terminal.

[0486] Step 5:

[0487] The device displays a list of suggestions to the user.

[0488] Specific examples

[0489] Example 1: Sightseeing in Tokyo

[0490] Step 1:

[0491] The user (Mr. Tanaka) launches the app and registers his interests as "history" and "food" and his budget as "5,000 yen a day."

[0492] Step 2:

[0493] Tanaka arrives at Tokyo Station and checks in.

[0494] Step 3:

[0495] The server generates a list of suggestions for historical buildings and restaurants around Tokyo Station and sends it to Tanaka's device.

[0496] Step 4:

[0497] The emotion engine analyzes Tanaka's facial expression and recognizes that she is relaxed.

[0498] Step 5:

[0499] Based on this emotional data, the server will include relaxing cafes and quiet tourist spots in its suggestion list.

[0500] Step 6:

[0501] Tanaka selects the suggested Sensoji Temple and a famous Japanese restaurant and checks the details.

[0502] Step 7:

[0503] The server provides route guidance and handles reservation procedures, and all information is displayed on Tanaka's device.

[0504] Step 8:

[0505] After visiting, Tanaka posts a review and photos and earns points.

[0506] In this way, the system allows travelers to be flexible in their travels and enjoy experiences tailored to their interests and emotional state in real time, while enabling travel companies to use detailed data to improve their marketing and services.

[0507] Example 2

[0508] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0509] While traditional travel planning systems can register travelers' interests, preferences, and budgets, the proposed content often does not adapt to the traveler's real-time emotional state, resulting in low satisfaction. While they offer on-site check-in and sightseeing information, they are unable to respond appropriately when travelers need further suggestions. Furthermore, there are limitations to their ability to support multiple languages ​​and utilize detailed traveler data for marketing and service improvement, making it difficult for travel-related businesses to increase their customer attraction.

[0510] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0511] In this invention, the server includes: a means for registering a traveler's interests, preferences, and budget; a means for the traveler to check in at a destination; a means for suggesting tourist spots, restaurants, and souvenirs in real time based on the check-in information; a means for making re-suggestions if the suggestion results in low satisfaction; a means for recognizing the user's emotional state and adjusting the suggestion content based on the user's emotional state; a means for providing route guidance, ticket reservations, restaurant reservations, and partner coupon information once the destination is decided; a means for sharing reviews and images after the trip and earning points; a means for learning the traveler's behavioral history and reviews to suggest the next destination; and a means for transmitting and receiving data between the terminal and the server. This allows travelers to be flexible in their activities and receive optimal suggestions based on their real-time emotional state. Furthermore, re-suggestions are made even if the suggestion is dissatisfied, thereby improving traveler satisfaction. Furthermore, multilingual support and detailed traveler data can be used to increase the customer attraction and marketing capabilities of travel-related businesses.

[0512] "Means for registering traveler interests, preferences, and budget" refers to devices or functions that allow travelers to input and save their areas of interest, specific concerns, and the budget they intend to use for their trip.

[0513] "Means for travelers to check in at a destination" refers to the devices and functionality that allow travelers to confirm their arrival at a destination and register their arrival information in the system using a terminal or mobile application.

[0514] "Means for suggesting information on tourist attractions, restaurants, and souvenirs in real time based on check-in information" refers to devices and functions that use travelers' check-in information to search for information on local tourist attractions, restaurants, souvenir shops, etc. in real time and suggest it to travelers.

[0515] "Means for making a new proposal if the traveler is not satisfied with the proposal" refers to a device or function for generating a new proposal and presenting it to the traveler again if the initial proposal is not satisfactory to the traveler.

[0516] "Means for recognizing the user's emotional state and adjusting the content of suggestions based on that" refers to devices or functions that analyze the user's facial expressions and voice to recognize their emotional state, and change or adapt the content of suggestions in real time based on that data.

[0517] "Means of providing route guidance, ticket reservations, restaurant reservations, and partner coupon information once a destination has been decided" refers to devices and functions that, once a traveler has decided on a destination, provide guidance on how to get to that location, reserve necessary tickets, make reservations at restaurants, etc., and provide partner coupon information.

[0518] "Means for sharing reviews and images after a trip and earning points" refers to devices and functions that allow travelers to post reviews and images about their experiences at their travel destinations, and for the system to award points for those posts.

[0519] "Means of learning from travelers' behavioral history and reviews to suggest their next destination" refers to devices or functions that analyze travelers' past behavioral history and posted reviews and suggest their next travel plans based on that information.

[0520] "Means for transmitting and receiving data between a terminal and a server" refers to devices and functions for exchanging data bidirectionally between a user's terminal and a central server.

[0521] System Configuration and Hardware / Software Usage

[0522] This invention is a system that includes a traveler (user) terminal, a central server, and an emotion engine. This system includes a user interface for registering the user's interests and budget, a database and API for suggesting tourist destination information in real time, an emotion engine that recognizes the user's emotional state, and a communication module for bidirectional data exchange. Specific implementation methods for each element are described below.

[0523] User Registration

[0524] A user installs and launches a travel application. On first launch, the device displays a form for the traveler to enter their interests, preferences, and budget. The information entered by the user is sent from the device to a server, which stores it in a database (e.g., MySQL).

[0525] Arrival and check-in

[0526] When the user arrives at a destination, they press the check-in button. The device uses GPS (e.g., Google Maps API) to obtain their current location and sends that information to the server. Based on the current location, the server obtains real-time information about tourist spots, restaurants, etc. from an API (e.g., Google Places API) and sends it to the device as a list of suggestions.

[0527] Emotion Recognition and Real-Time Suggestions

[0528] The server generates a list of suggestions and sends it to the device. An emotion engine (e.g., OpenCV, TensorFlow) analyzes the user's facial expressions and voice to recognize their emotional state. The device sends the emotion data to the server, which then adjusts the suggestions based on that data. For example, if the user is in a relaxed state, quiet tourist spots and cafes will be added to the suggestion list.

[0529] Destination confirmation, navigation and reservations

[0530] Once the user selects their destination, that information is sent from the device to the server, which then uses the Google Maps API and other tools to provide detailed route guidance, book tickets, and make store reservations, and obtain coupon information from partner companies and send it to the device.

[0531] Review and earn points after your visit

[0532] When a user finishes their experience at a destination, they post their review and photos from their device to the server. The server stores these in a database and awards points to the user. The device then displays a notification to the user that they have received points.

[0533] Plan your next trip

[0534] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews, and sends the list to the device, which then displays it to the user.

[0535] Specific examples

[0536] Example 1: Sightseeing in Tokyo

[0537] 1. The user launches the application and registers "History," "Gourmet," and a budget of "5,000 yen per day." The device sends this information to the server, which then stores it in a database.

[0538] 2. When a user arrives at Tokyo Station, they press the check-in button. The device retrieves their current location from GPS and sends it to the server. The server then uses the Google Places API to retrieve information about tourist spots and restaurants and generates a list of suggestions.

[0539] 3. The emotion engine analyzes the user's facial expressions and voice and recognizes that they are in a relaxed state. The device sends the emotion data to the server, which then adds relaxing cafes and quiet tourist spots to a list of suggestions.

[0540] 4. For example, a user selects Sensoji Temple and a famous Japanese restaurant and checks the details. The server uses the Google Maps API to provide route guidance and make reservations, and sends the information to the device.

[0541] 5. After your visit, launch the app and post a review and photos. The device sends this information to the server, which stores it in a database and awards points.

[0542] The system allows travelers to be flexible on-site and receive optimal recommendations based on their real-time emotional state, while also enabling travel-related businesses to improve their customer attraction and marketing.

[0543] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0544] Step 1:

[0545] The user installs the travel app and launches it for the first time.

[0546] When the device is first started, it displays a form for travelers to enter their interests, preferences, and budget.

[0547] The user fills in the form and clicks the submit button.

[0548] The input here is text data such as interests, concerns, budget, etc.

[0549] The device sends the entered information to the server, which receives the data and stores it in a database such as MySQL.

[0550] During this process, user profile information such as interests, preferences, and budget are registered in a database.

[0551] Step 2:

[0552] The user arrives at the location and presses the check-in button within the app.

[0553] The input here is check-in operation and GPS information.

[0554] The device uses the GPS function to obtain current location information and sends that information to the server.

[0555] The server receives the current location information and searches for nearby tourist spots, restaurants, and souvenir information using the Google Places API, etc. The search results data is aggregated on the server.

[0556] The server generates data as a proposal list and transmits it to the terminal.

[0557] In this step, tourist spots and restaurant information are suggested to the user in real time based on the check-in information.

[0558] Step 3:

[0559] The server sends the generated proposal list to the terminal.

[0560] The input here is the data for the suggestion list.

[0561] The emotion engine collects the user's facial expressions and voice through the camera and microphone and converts them into emotion data. The emotion engine uses OpenCV and TensorFlow to analyze the user's emotional state.

[0562] Output data from the emotion engine is sent to the terminal.

[0563] The device receives the emotion data and transmits it to the server.

[0564] The server adjusts the suggestion list based on the user's emotional data. If a new suggestion is needed, it generates a new suggestion and sends it to the device as data.

[0565] In this step, the suggestions are adjusted based on the results of emotion recognition.

[0566] Step 4:

[0567] Users can select the offers that interest them and view more information in the app.

[0568] The input here is the information of the selected proposal.

[0569] The terminal transmits the selected information to the server.

[0570] The server retrieves the necessary details from the Google Maps API, etc., and then coordinates and retrieves route guidance, ticket reservations, store reservations, and coupon information.

[0571] The server transmits this data to the terminal.

[0572] This step provides specific actionable guidance based on the plan the user has chosen.

[0573] Step 5:

[0574] After users arrive at their destination and complete their experience, they post reviews and photos on the app.

[0575] The input here is the text data and image data of the review.

[0576] The terminal transmits the posted review information to the server.

[0577] The server registers the review information and image data in a database.

[0578] Once registration is complete, the server will grant points to the user and send a notification of point acquisition to the terminal.

[0579] In this step, the user's experience review is saved in the database and points are awarded.

[0580] Step 6:

[0581] The user launches the app again to plan their next trip.

[0582] The server retrieves past behavioral history and reviews from the database and generates a new list of suggestions.

[0583] The server sends the proposal list to the terminal.

[0584] The device will present the new list of suggestions to the user.

[0585] In this step, new travel plans are suggested based on past data.

[0586] (Application example 2)

[0587] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0588] Modern travelers often want to receive specific information and suggestions based on their interests, preferences, and budget in real time while visiting their destination. However, current systems are unable to provide suggestions that take into account the traveler's emotional state, which can lead to low traveler satisfaction. Additionally, changing plans or making new suggestions while visiting a destination can be time-consuming, resulting in inflexible travel planning. Furthermore, reviews and point systems are not being fully utilized, which presents an issue of not being able to fully utilize the information when planning their next trip.

[0589] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for registering the traveler's interests, concerns, and budget; means for the traveler to check in at a destination; means for suggesting tourist spots, restaurants, and souvenirs in real time based on the check-in information; means for making re-suggestions if the suggestion is unsatisfactory; means for providing route guidance, ticket reservations, restaurant reservations, and partner coupon information once the destination is decided; means for sharing reviews and images after the trip and earning points; means for recognizing the traveler's emotional state from facial expressions or voice and adjusting the suggestion content based on that emotional state; and means for learning the traveler's behavior history and reviews to suggest the next destination. This allows travelers to flexibly plan their activities on site and receive suggestions tailored to their emotional state. Furthermore, utilizing reviews and point systems can further enhance their next travel plans.

[0590] "Tourist" refers to an individual or group traveling with the intention of visiting a place.

[0591] "Interests" refer to the themes or activities that a traveler is particularly interested in.

[0592] "Interest" refers to the things that tourists pay particular attention to or information that attracts their attention.

[0593] "Budget" refers to the range of amounts a traveler is willing to spend on a travel activity.

[0594] "Checking in" is the act of a traveler registering their presence at a destination in the system upon arrival.

[0595] "Real-time" refers to data being updated and processed almost instantly.

[0596] "Tourist destination" means a historical, cultural or natural attraction that is intended for visits by tourists.

[0597] "Restaurant" means an establishment that serves food and beverages.

[0598] "Souvenir information" refers to information about souvenirs and local specialties that can be purchased at the destination.

[0599] "Recommendation" means the act of providing a traveler with recommendations for places to visit, activities, or services.

[0600] "Route guidance" is information that shows the optimal route to reach a destination.

[0601] "Ticket reservation" refers to the process of securing admission tickets to a facility or event in advance.

[0602] "Emotional state" refers to the traveler's current psychological and emotional state.

[0603] "Facial expressions" refers to visual expressions used to read a traveler's emotions.

[0604] "Voice" refers to vocal expressions used to read the traveler's emotions.

[0605] A "review" is when a traveler shares their rating or opinion about a destination or service.

[0606] "Points" refers to points in a reward system awarded for reviews and actions.

[0607] "Behavioral history" refers to a record of a traveler's past activities and visits.

[0608] "Partners" refers to businesses and service providers that are affiliated with the system.

[0609] System Configuration

[0610] To implement this invention, the following system configuration is required: The system is composed of a traveler's terminal, a central server, a database, an API that provides various travel-related services, and an emotion engine.

[0611] Program processing overview

[0612] The main operations of the system are as follows.

[0613] Hardware and Software

[0614] Server: A central computer for processing large amounts of data and making real-time recommendations.

[0615] Device: A user's mobile device, such as a smartphone or tablet.

[0616] Emotion Engine: Dedicated software to analyze the user's facial expressions and voice to detect their emotional state.

[0617] GPS module: A location information acquisition device installed on a terminal.

[0618] Network: A communications infrastructure that connects various devices and transmits and receives data.

[0619] Data Processing

[0620] User registration: The device sends the user's entered interests, preferences, and budget information to the server, which stores the information in a database.

[0621] Emotion Recognition: The emotion engine uses the device's camera and microphone to analyze the user's facial expressions and voice, and sends the results to the server.

[0622] Suggestion generation: Based on the user's location information and emotional state, the server searches the database for relevant tourist spots, restaurants, and souvenir information in real time and generates a suggestion list.

[0623] Re-proposal: If the user is not satisfied with the proposal, the device sends a re-proposal request to the server, and the server generates a new proposal list and sends it to the device.

[0624] Navigation and reservations: Once the user selects a destination, the server provides route guidance, ticket reservations, and store reservations information and sends this information to the device.

[0625] Reviews and point awarding: When a user writes a review after a visit, the device sends the information to the server, which stores it in a database and awards points.

[0626] Specific examples

[0627] User registration: When a "user" launches the app for the first time, they register their interests as "history" and "food" and their budget as "5,000 yen per day."

[0628] Emotion recognition: The "emotion engine" analyzes the "user's" facial expressions and recognizes that they are relaxed.

[0629] Suggestion generation: The "server" searches for tourist attractions and restaurants around Tokyo Station in real time and generates a list of suggestions including relaxing cafes and quiet tourist spots.

[0630] Navigation and Reservations: Once the "user" selects Sensoji Temple, the "server" sends route directions to the device and makes any necessary ticket reservations.

[0631] Prompt Sentence Examples

[0632] "Name is Tanaka, interests are history and food, budget is 5000 yen, emotional state is relaxed."

[0633] The system allows travelers to plan their activities more flexibly while on-site, provides suggestions based on their emotional state, and provides a more satisfying travel experience. It also allows travelers to make more fulfilling plans for their next trip by utilizing reviews and a points system.

[0634] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0635] Step 1: User Registration

[0636] When a user installs and launches the app for the first time, the device displays a form asking the user to enter their interests, preferences, and budget. After the user enters the information and clicks the submit button, the device sends this information to the server, which receives it and stores it in a database.

[0637] Input: User interests, concerns, budget

[0638] Data processing: Send input information to the server and save it

[0639] Output: The information is saved to the database

[0640] Step 2: Arrival and check-in

[0641] When the user arrives at their destination, they press the check-in button. The device uses a GPS module to obtain their current location and sends that information to the server. The server then uses that location information to search for nearby tourist attractions, restaurants, and souvenir information.

[0642] Input: User's current location

[0643] Data processing: Search for information based on current location information

[0644] Output: Generate a list of suggestions

[0645] Step 3: Emotion Recognition

[0646] The emotion engine uses the device's camera and microphone to analyze the user's facial expressions and voice, and sends the results to the server, which receives the user's emotional state and adjusts the suggestions it makes to the user.

[0647] Input: User's facial expressions and voice

[0648] Data processing: Emotional state analysis and proposal adjustment

[0649] Output: A list of suggestions based on emotional state

[0650] Step 4: Propose and Re-Propose

[0651] The server generates a list of suggestions, such as tourist spots, restaurants, and souvenirs, based on the user's current location and emotional state, and sends it to the device. If the user is not satisfied with the items in the suggestion list, a re-suggestion request is sent from the device to the server. The server then generates a new suggestion list and sends it again to the device.

[0652] Input: current location, emotional state, re-suggestion request

[0653] Data processing: Proposal list generation and refinement

[0654] Output: Refined proposal list

[0655] Step 5: Confirm destination, navigate and make reservations

[0656] The user selects a destination they wish to visit from the list of suggestions. The device sends this information to the server. The server then provides detailed route guidance, book tickets, and store reservations, and obtains coupon information from partner companies, and sends all of this information to the device. The device then displays this to the user.

[0657] Input: User's destination selection information

[0658] Data processing: route guidance and reservation procedures

[0659] Output: Route guidance, ticket information, coupon information

[0660] Step 6: Review after visit and earn points

[0661] After a user has completed their experience at a destination, they can post reviews and photos on their device. Once the user has entered and submitted their review, the device sends this information to the server, which then stores the review information in a database and awards points to the user.

[0662] Input: Review information, image

[0663] Data processing: Saving review information and awarding points

[0664] Output: Saved review information, awarded points

[0665] Step 7: Plan your next trip

[0666] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews, and sends the list to the device, which then displays it to the user.

[0667] Input: User behavior history, review information

[0668] Data processing: Generate a proposal list based on past data

[0669] Output: Suggestion list

[0670] In this way, users can flexibly plan their activities while on-site, receive suggestions based on their emotional state, and utilize reviews and a points system to enhance their next travel plans.

[0671] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0672] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0673] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0674] [Second embodiment]

[0675] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0676] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0677] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0678] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0679] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0680] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0681] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0682] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0683] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0684] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0685] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0686] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0687] To implement this invention, the following system configuration and program processing are required. The system is primarily comprised of interactions between three parties: a server, a terminal, and a user. Because questions about each processing step will be asked later, we will not go into detail about the processing steps here, but will explain the overall flow and provide specific examples.

[0688] System Configuration

[0689] The system includes a traveler (user) device, a central server, and a database and APIs that provide various travel-related services. The server stores user registration information and handles real-time suggestions, reservations, and review collection. The device provides an interface for users to plan trips and accept suggestions through the app.

[0690] Program processing overview

[0691] User Registration

[0692] Users launch the app on their device and enter their interests and budget.

[0693] The terminal sends this information to the server, which stores it in a database.

[0694] Arrival and check-in

[0695] When the user arrives at the location and presses the check-in button, the device obtains the user's current location information.

[0696] The device sends its current location information to the server, which then searches for information on nearby tourist attractions, restaurants, and souvenirs in real time.

[0697] Real-time suggestions

[0698] The server generates a list of suggestions based on the user's current location and registered information (interests, concerns, budget) and sends it to the device.

[0699] The user can review the list of suggestions on their device and make a selection.

[0700] If the proposal is not satisfactory, a re-proposal request is sent to the server, which makes a new proposal.

[0701] Destination confirmation, navigation and reservations

[0702] Once the user selects a destination, the device sends that information to the server.

[0703] The server provides detailed route guidance, necessary ticket information, and store reservation procedures, and obtains coupon information from affiliated companies.

[0704] The server sends all this information to the terminal, which displays it to the user.

[0705] Review and earn points after your visit

[0706] Once users have completed their experience at a destination, they can post reviews and photos on their device.

[0707] The terminal sends the review information to the server, which stores it in a database.

[0708] The server awards points to the user and sends a point notification to the terminal.

[0709] Plan your next trip

[0710] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews.

[0711] The server sends the new proposal list to the terminal, which displays it to the user.

[0712] Specific examples

[0713] Example 1: Sightseeing in Tokyo

[0714] The user (Mr. Tanaka) launches the app and registers his interests as "history" and "food" and his budget as "5,000 yen a day."

[0715] Tanaka arrives at Tokyo Station and checks in.

[0716] The server generates a list of suggestions for historical buildings and restaurants around Tokyo Station and sends it to Tanaka's device.

[0717] Tanaka selects the suggested Sensoji Temple and a famous udon restaurant and checks the details.

[0718] The server provides route guidance and handles reservation procedures, and all information is displayed on Tanaka's device.

[0719] After visiting, Tanaka posts a review and photos and earns points.

[0720] In this way, the system gives travelers flexibility in their travels and allows them to enjoy experiences that are tailored to their interests in real time, while enabling travel companies to use detailed data to improve their marketing and services.

[0721] The processing flow will be explained below.

[0722] User Registration

[0723] Step 1:

[0724] The user installs the app on their device and launches it for the first time.

[0725] Step 2:

[0726] The device displays a form for the user to enter their interests and budget.

[0727] Step 3:

[0728] The user fills out the form with their interests, concerns, and budget and clicks the submit button.

[0729] Step 4:

[0730] The terminal transmits the input information to the server.

[0731] Step 5:

[0732] The server stores the received information in a database and sends a registration confirmation response to the terminal.

[0733] Step 6:

[0734] The device will display "Registration complete" to the user.

[0735] Arrival and check-in

[0736] Step 1:

[0737] The user arrives at the location and opens the app.

[0738] Step 2:

[0739] The device obtains GPS data and determines its current location.

[0740] Step 3:

[0741] The user clicks the check-in button.

[0742] Step 4:

[0743] The device sends its current location and user ID to the server.

[0744] Step 5:

[0745] The server searches for information on tourist spots, restaurants, and souvenirs around the current location and generates a list of suggestions.

[0746] Step 6:

[0747] The server sends the generated list to the terminal.

[0748] Step 7:

[0749] The device displays a list of suggestions to the user.

[0750] Real-time suggestions

[0751] Step 1:

[0752] The user taps on an item of interest from the list of suggestions.

[0753] Step 2:

[0754] The device displays a detailed information screen for the selected item.

[0755] Step 3:

[0756] The user checks for more information.

[0757] Step 4:

[0758] If the user is not satisfied with the suggestion, he or she clicks the Re-suggest button.

[0759] Step 5:

[0760] The terminal sends a re-proposal request to the server.

[0761] Step 6:

[0762] The server generates a list of alternative suggestions and sends it to the terminal.

[0763] Step 7:

[0764] The device will display the new suggestions list to the user.

[0765] Destination confirmation, navigation and reservations

[0766] Step 1:

[0767] The user selects the proposal that satisfies them and confirms their destination.

[0768] Step 2:

[0769] The terminal transmits destination confirmation information to the server.

[0770] Step 3:

[0771] The server generates detailed route directions to the destination.

[0772] Step 4:

[0773] The server handles the necessary ticket information and restaurant reservation procedures.

[0774] Step 5:

[0775] The server acquires coupon information from the partner.

[0776] Step 6:

[0777] The server sends all the information to the terminal.

[0778] Step 7:

[0779] The device displays route guidance, ticket information, reservation confirmation, and coupon information to the user.

[0780] Review and earn points after your visit

[0781] Step 1:

[0782] The user opens the app after visiting a location.

[0783] Step 2:

[0784] The user is directed to the review submission screen.

[0785] Step 3:

[0786] The device will display a review input form.

[0787] Step 4:

[0788] The user enters a review and image and clicks the submit button.

[0789] Step 5:

[0790] The device sends the review and image data to the server.

[0791] Step 6:

[0792] The server stores the data in a database.

[0793] Step 7:

[0794] The server awards points to the user and sends a point notification to the terminal.

[0795] Step 8:

[0796] The terminal will display a message to the user saying that points have been added.

[0797] Plan your next trip

[0798] Step 1:

[0799] The user restarts the app the next time they travel.

[0800] Step 2:

[0801] The device sends the user ID to the server.

[0802] Step 3:

[0803] The server generates a new list of suggestions based on past travel data and reviews.

[0804] Step 4:

[0805] The server sends the new proposal list to the terminal.

[0806] Step 5:

[0807] The device displays a list of suggestions to the user.

[0808] Through these detailed processing steps, the system provides travelers with real-time personalized information to optimize their travel experience, while enabling travel-related companies to improve their services by providing detailed data analysis.

[0809] Example 1

[0810] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0811] Today's travelers are required to plan trips that meet their diverse needs and interests. However, existing travel support systems face challenges in that they are unable to respond flexibly in real time or provide optimal suggestions for individual travelers. In particular, there is a demand for technology that can efficiently and centrally handle a series of processes, including on-site information gathering, updating of suggestions, reservation procedures, and point awarding.

[0812] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0813] In this invention, the server includes means for registering a traveler's interests, concerns, and budget, means for the traveler to check in at a destination, means for suggesting tourist spots, restaurants, and souvenir information in real time based on check-in information, means for making re-suggestions if satisfaction with the suggestions is low, means for providing route guidance, ticket reservations, store reservations, and affiliated coupon information when the destination is decided, means for sharing reviews and images after the trip and earning points, means for learning the traveler's behavioral history and reviews to suggest the next destination, means for generating a suggestion list based on the traveler's current location and registration information using a generative AI model, means for sending the suggestion list to a terminal and making new suggestions based on a re-suggestion request, means for saving review information after the visit in a database and awarding points, means for obtaining surrounding information in real time using an affiliated tourist information providing API, means for the terminal to obtain current location information using GPS, and means for providing detailed route guidance, ticket information, and store reservation procedures using an external API.

[0814] This will enable us to respond to the diverse needs of travelers, provide optimal travel plans for each individual traveler in real time, and ensure an efficient travel experience.

[0815] "Tourist" refers to an individual or group traveling for the purpose of travel.

[0816] "Interest" refers to a traveler's interest or motivation in a particular topic or activity.

[0817] "Interests" refers to the interest a traveler has in a particular place, culture, activity, etc.

[0818] "Budget" refers to the amount of money a traveler can spend on a trip.

[0819] "Terminal" refers to an electronic device used by a user, such as a smartphone or tablet.

[0820] A "server" refers to a computer system that communicates with terminals via a network and processes and stores data.

[0821] A "database" refers to a system that stores information in an organized manner and enables it to be searched and manipulated.

[0822] "GPS" refers to the Global Positioning System, a system for determining locations on Earth.

[0823] "Check-in" refers to the act of a traveler reporting their arrival at a particular location via a terminal.

[0824] "Suggestion list" refers to a list of recommended tourist spots, restaurants, etc. generated by the server based on the traveler's interests, preferences, budget, and current location information.

[0825] "Re-proposal" refers to the process of making a new proposal if the initial proposal is dissatisfied.

[0826] "Destination" refers to the place a traveler chooses to visit.

[0827] "Route guidance" refers to guidance information that provides travelers with the optimal route to reach their destination.

[0828] "Ticket reservation" refers to the process of securing tickets in advance for transportation, events, etc.

[0829] "Coupon Information" refers to information regarding discounts and benefits offered by our partners.

[0830] A "review" refers to a traveler's act of writing an evaluation or opinion about their experience at a destination.

[0831] "Points" refers to rewards travelers earn through reviews and other activities.

[0832] "Behavioral history" refers to a record of a traveler's past trips and places visited.

[0833] A "generative AI model" refers to an algorithmic model that uses machine learning to make optimal suggestions and predictions from data.

[0834] "API" refers to an application programming interface that enables communication with other software systems.

[0835] To implement this invention, a system configuration is required that includes a traveler (user) terminal, a central server, and a database and APIs that provide various travel-related services. The system is primarily comprised of interactions between the server, terminal, and user.

[0836] System Configuration

[0837] The system consists of a user's device (such as a smartphone or tablet), a central server, and partnered external tourism information APIs (e.g., Google Places API and Google Maps API). The server stores user registration information and provides real-time suggestions, reservations, and reviews. The device provides an interface for users to accept travel plans and suggestions through the app.

[0838] Program processing overview

[0839] The program works as follows:

[0840] 1. User Registration

[0841] The user launches the app and enters their interests and budget, and the device sends this information to the server.

[0842] The server stores the received information in a database.

[0843] Examples:

[0844] A user registers their interests as "history" and "food" and a budget of "5,000 yen per day."

[0845] Example prompt: "What are your hobbies at your travel destination? For example, history, food, shopping, etc."

[0846] 2. Arrival and check-in

[0847] When the user arrives at the location and presses the check-in button, the device uses GPS to obtain their current location information.

[0848] The device sends its current location information to the server, and the server then calls an affiliated tourist information provider API to obtain information about the surrounding area.

[0849] Examples:

[0850] The user arrives at Tokyo Station and checks in.

[0851] Example prompt: "Send me tourist information about my current location. Generate a list of nearby attractions."

[0852] 3. Real-time suggestions

[0853] The server uses a generative AI model based on the user's current location and registration information to generate a list of suggestions and sends it to the device.

[0854] The user can view and select from a list of suggestions on their device. If they are not satisfied with the suggestions, a re-suggestion request is sent to the server, and a new suggestion is made.

[0855] Examples:

[0856] Users can select Sensoji Temple or a famous udon restaurant and check detailed information.

[0857] Example prompt: "Create a new list of suggestions based on the user's interests and location."

[0858] 4. Destination confirmation, navigation and reservations

[0859] Once the user selects their destination, the device sends that information to the server, which then provides detailed route guidance, necessary ticket information, store reservations, and obtains coupon information from affiliated companies.

[0860] All this information is sent to the terminal and displayed to the user.

[0861] Examples:

[0862] The server provides route guidance and handles reservation procedures, and all information is displayed on the user's device.

[0863] Example prompt: "Suggest route directions, ticket information, and booking procedures."

[0864] 5. Review after your visit and earn points

[0865] After the user has finished their experience at a destination, they can post a review and photos on their device, which then sends the review information to the server, which then stores it in a database.

[0866] The server awards points and sends a point notification to the terminal.

[0867] Examples:

[0868] Users post reviews and photos and earn points.

[0869] Example prompt: "Receive user ratings and photo submissions and generate point award notifications."

[0870] 6. Planning your next trip

[0871] The next time the user launches the app, the server generates a new list of suggestions based on past behavioral history and reviews and sends it to the device.

[0872] The device displays a list of suggestions to the user.

[0873] Examples:

[0874] The server analyzes past behavioral history and reviews to create a new list of suggestions.

[0875] Example prompt: "Create a new list of suggestions based on your past behavioral history and reviews."

[0876] The system allows users to enjoy flexible travel plans tailored to their interests in real time, while travel-related companies can use the detailed data to improve their marketing and services.

[0877] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0878] Program processing flow

[0879] Step 1: User Registration

[0880] The user launches the app.

[0881] The user inputs their interests and budget. The input data is interests (e.g., "history," "food"), interests (e.g., "activity," "shopping"), and budget (e.g., "5,000 yen per day").

[0882] The terminal converts the input data into JSON format and sends it to the server.

[0883] The server stores the received information in a database, using a database such as MySQL, and performs transaction processing to maintain data consistency.

[0884] Input: User interests, preferences, and budget data

[0885] Data processing: Convert to JSON format

[0886] Output: User data sent to the server

[0887] Step 2: Arrival and check-in

[0888] The user arrives at the location and presses the check-in button on the app.

[0889] The device uses GPS to obtain the current location information.

[0890] The device converts the current location information into JSON format and sends it to the server.

[0891] The server calls an affiliated tourist information provider API (e.g., Google Places API) based on the current location information, formats the data obtained from the API, and saves it.

[0892] Input: Current location information (GPS data)

[0893] Data processing: Convert to JSON format, call tourist information API

[0894] Output: Current location data and tourist information sent to the server

[0895] Step 3: Real-time proposals

[0896] The server uses a generative AI model to generate a list of suggestions based on the user's current location and registration information.

[0897] The generative AI model takes inputs such as interests, preferences, budget, and current location, and suggests travel plans suitable for the user in real time.

[0898] The server converts the generated proposal list into JSON format and sends it to the device.

[0899] The device displays a list of suggestions to the user.

[0900] Input: User location, interests, preferences, and budget data

[0901] Data processing: Generate a proposal list using a generative AI model and convert it into JSON format

[0902] Output: Suggestion list

[0903] Step 4: Confirm destination, navigate and book

[0904] The user selects a destination from a list of suggestions.

[0905] The terminal converts the selected data into JSON format and sends it to the server.

[0906] Based on the selection information, the server calls an external API (e.g., Google Maps API, API for a reservation site) to provide route guidance, ticket information, and store reservation procedures.

[0907] The server acquires coupon information from the partner.

[0908] The server converts this information into JSON format and sends it to the terminal.

[0909] The device displays the information it receives to the user.

[0910] Input: Destination selection information

[0911] Data processing: Convert to JSON format, call external API, get coupon information

[0912] Output: Route directions, ticket information, reservation information

[0913] Step 5: Review after your visit and earn points

[0914] After visiting, users post reviews and photos within the app.

[0915] The device converts reviews and images into JSON format and sends them to the server.

[0916] The server stores the review information in a database, where it is analyzed by a rating algorithm.

[0917] The server awards points, converts the point notification into JSON format, and sends it to the terminal.

[0918] The terminal displays a point award notification to the user.

[0919] Input: Review information and images

[0920] Data processing: Convert to JSON format and analyze using evaluation algorithms

[0921] Output: Save to database, point allocation notification

[0922] Step 6: Plan your next trip

[0923] The next time the user launches the app.

[0924] The server uses a generative AI model to create a new list of suggestions based on past behavioral history and reviews.

[0925] The server converts the generated new proposal list into JSON format and sends it to the device.

[0926] The device displays a list of suggestions to the user.

[0927] Input: Past activity history and reviews

[0928] Data processing: Generate a new proposal list using a generative AI model and convert it into JSON format

[0929] Output: New proposal list

[0930] In this way, detailed data processing and calculations are carried out at each step, and the system provides optimal travel plans in real time. This process allows users to plan their trips flexibly, and travel-related companies can make more efficient marketing efforts.

[0931] (Application example 1)

[0932] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0933] Conventional travel support systems suggest tourist spots and restaurants based on travelers' interests and budgets, but provide transportation options individually and lack a centralized means for managing real-time suggestions and reservation procedures. As a result, travelers often spend time and effort traveling to their destinations and completing various reservation procedures. To achieve greater efficiency and improve user experience, a system is needed that can summon an autonomous vehicle based on the traveler's current location and provide real-time suggestions for tourist spots and restaurants, route guidance, and reservation procedures in an integrated manner.

[0934] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0935] In this invention, the server includes means for registering a traveler's interests, preferences, and budget, means for the traveler to check in at a destination, means for suggesting tourist spots, restaurants, and souvenirs in real time based on the check-in information, means for making re-suggestions if the suggestion is not satisfactory, means for providing route guidance, ticket reservations, restaurant reservations, and partner coupon information when the destination is decided, means for sharing reviews and images after the trip and earning points, means for learning the traveler's behavioral history and reviews to suggest the next destination, means for calling an autonomous vehicle and guiding it to the destination based on the traveler's current location information, and means for linking with the autonomous vehicle to suggest tourist spots and restaurants, provide route guidance, and make reservations in real time. This enables travelers to manage transportation, tourist information, and reservation procedures in an integrated manner within a single system.

[0936] "Tourist" refers to a person who visits a tourist spot or destination.

[0937] "Interest" refers to a traveler's interest in a particular activity or place.

[0938] "Interest" refers to a focus on specific genres or themes that interest travelers.

[0939] "Budget" refers to the amount of money a traveler decides to spend on their trip.

[0940] "Location Information" refers to a traveler's real-time geographic location obtained through GPS or location-based services.

[0941] "Check-in" refers to the act of a traveler notifying the system that they have arrived at a particular location.

[0942] "Real-time suggestions" refers to providing instant information about tourist spots and restaurants based on the traveler's current location and registration information.

[0943] "Re-proposal" refers to making a new proposal if the traveler is not satisfied with the initial proposal.

[0944] A "destination" refers to a specific place or facility that a traveler ultimately wants to reach.

[0945] "Route Guidance" refers to providing detailed directions for a traveler to travel from their current location to their destination.

[0946] "Ticket reservation" refers to the process of reserving tickets for transportation or tourist attractions in advance.

[0947] "Restaurant reservations" refers to the process of making advance reservations for restaurants, shops, and other establishments.

[0948] "Coupon information from affiliated stores" refers to discount and special offer information provided by affiliated stores and facilities.

[0949] A "review" refers to a traveler's evaluation or impressions of the places or facilities they visited after their trip.

[0950] "Points" refers to rewards given to travelers for actions such as writing reviews and sharing photos after a trip.

[0951] "Behavioral history" refers to records of places a traveler has visited and services they have used in the past.

[0952] An "autonomous vehicle" is a vehicle that has the ability to travel automatically to a destination without a human driver.

[0953] "Navigation" refers to providing guidance on the route to a destination.

[0954] "Real-time" refers to the instantaneous provision of information and services.

[0955] The system includes a traveler (user) device, a central server, and a database and API that provide various travel-related services. The server stores user registration information, makes real-time suggestions, and collects reviews. The device provides an interface for users to plan trips and accept suggestions through the app.

[0956] First, users launch the app on their device and enter their interests and budget. This information is sent from the device to the server, which stores it in a database. When the user arrives at a destination and presses the check-in button, the device acquires their current location information and sends it to the server. The server receives this information and makes real-time recommendations about tourist spots, restaurants, and souvenirs based on the user's current location and registered information.

[0957] The server also has the ability to make a second suggestion if the user is not satisfied with the suggestion. When the user selects a suggestion that satisfies them, the destination is determined and the device sends this information to the server. The server then provides detailed route guidance, necessary ticket information, and store reservation procedures, and also obtains coupon information from affiliated companies. This information is then sent to the device and displayed to the user.

[0958] When using an autonomous vehicle, the system will call the vehicle based on the user's current location and guide them to their destination. The autonomous vehicle will then integrate and manage real-time suggestions for tourist spots and restaurants, route guidance, and reservation procedures.

[0959] After a trip, users can share reviews and photos on their devices and send them to the server. The server stores this information in a database and awards points to the user. The server also learns from the user's behavioral history and reviews, and generates a new list of recommendations for the next trip.

[0960] The main hardware used is a smartphone, and the software is an HTTP request library (requests) that handles communication between the user device and the server. User input and location information are sent to the server, which then retrieves data from multiple APIs and makes suggestions tailored to the user's interests and budget.

[0961] As a concrete example, suppose a user starts the app, registers their interest in "history" and "food," and sets their travel budget to "5,000 yen." If the user arrives at the center of a large city as their destination, the server will suggest nearby historical buildings and famous restaurants. If the user selects a historical building and a well-known restaurant in Asakusa, detailed route guidance and reservation information will be displayed on the smartphone. Then, the autonomous vehicle will safely guide the user to their destination.

[0962] An example prompt for a generative AI model is:

[0963] "What is the specification for an application that, after a user arrives in the center of a large city, recommends tourist spots and restaurants based on his interests and budget?"

[0964] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0965] Step 1:

[0966] User Registration

[0967] The user launches the application on their smartphone and enters their interests and budget. This inputs the user's personal information and travel preferences into the application. The device then sends this information to the server, which stores it in a database. The output is that the user's information is recorded in a database stored on the server.

[0968] Step 2:

[0969] Arrival and check-in

[0970] When the user arrives at their destination, they press the check-in button on the device. The device uses GPS to obtain the user's current location and sends that location data to the server. The server uses the user's current location information as input, and records the current location information in real time on the server side as output.

[0971] Step 3:

[0972] Real-time suggestions

[0973] The server generates a list of recommendations for tourist spots, restaurants, and souvenirs based on the user's current location and pre-registered interests and budget. The server then calls the relevant APIs to retrieve the necessary data and filters the information that matches the user's criteria. The output is a recommendation list that is sent to the user's device.

[0974] Step 4:

[0975] Re-proposal

[0976] If the user is not satisfied with the proposal list, they request a re-proposal. The device sends this request to the server, and the server generates a new proposal list and sends it back to the user device. The input is the user's re-proposal request, and the output is the new proposal list.

[0977] Step 5:

[0978] Destination confirmation, navigation and reservations

[0979] When a user selects a destination from the list of suggestions, the device sends the selection information to the server, which then generates detailed route guidance and uses partner APIs to handle ticket information and reservation procedures. The output is obtained by sending route guidance, ticket information, and store reservation information to the user's device.

[0980] Step 6:

[0981] Autonomous vehicle collaboration

[0982] Based on the user's current location information, an autonomous vehicle is called and navigation to the destination is provided. The device sends the current location information to the server, and the server calls the autonomous vehicle's API to dispatch a vehicle and send navigation information to the user's device. The input is the user's current location information, and the output is vehicle dispatch and navigation information.

[0983] Step 7:

[0984] Post-trip reviews and points

[0985] Users review their experiences at the places they visit and upload images. The device sends this information to the server, which stores it in a database. The server then awards points to the user and sends a notification to the device. The input is the review information and images, and the output is the saved database and a notification that points have been awarded.

[0986] Step 8:

[0987] Plan your next trip

[0988] The next time the user launches the app, the server generates a new list of suggestions based on their past travel history and reviews, providing them with an up-to-date travel plan tailored to their preferences. The input is their past travel history and reviews, and the output is a new list of suggestions.

[0989] As a concrete example, consider the case where a user launches the app, registers their interest in "history" and "gourmet food," and sets a travel budget of "5,000 yen." When the user arrives at the center of a large city as their destination, the server suggests nearby historical buildings and famous restaurants. After the user selects a historical building and a well-known restaurant in Asakusa, detailed route guidance and reservation information are displayed on the smartphone, and the autonomous vehicle safely guides the user to their destination.

[0990] An example prompt for a generative AI model is:

[0991] "What is the specification for an application that, after a user arrives in the center of a large city, recommends tourist spots and restaurants based on his interests and budget?"

[0992] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0993] System Configuration

[0994] To implement this invention, the following system configuration is required. The system is primarily comprised of interactions between the server, the terminal, and the user. In addition, the emotion engine has the function of recognizing the user's emotional state and adjusting the content of suggestions based on that. Since questions about each processing step will be asked later, we will now provide an overview of the processing steps and explain the overall system flow using concrete examples.

[0995] System Configuration and Functions

[0996] The system includes a traveler (user) device, a central server, a database and APIs that provide various travel-related services, and an emotion engine. The server stores user registration information and is responsible for real-time suggestions, reservations, and review collection. The emotion engine recognizes emotions from the user's facial expressions and voice and sends the data to the server.

[0997] Program processing overview

[0998] User Registration

[0999] The user installs the app on their device and launches it for the first time.

[1000] The device displays a form for the user to enter their interests and budget.

[1001] The user fills out the form with their interests, concerns, and budget and clicks the submit button.

[1002] The terminal sends the entered information to the server, which stores it in a database.

[1003] Arrival and check-in

[1004] When the user arrives at the location and presses the check-in button, the device obtains the user's current location information.

[1005] The device sends its current location information to the server, which then searches for information on nearby tourist attractions, restaurants, and souvenirs in real time.

[1006] Emotion Recognition and Real-Time Suggestions

[1007] The server generates a proposal list and sends it to the terminal.

[1008] The emotion engine analyzes the user's facial expressions and voice to recognize their emotional state.

[1009] The device also sends emotional data to the server, which then adjusts the suggestion list based on the user's emotional state.

[1010] Users can tap on an item of interest from the list of suggestions to view more information.

[1011] If the proposal is not satisfactory, a re-proposal request is sent to the server, which makes a new proposal.

[1012] Destination confirmation, navigation and reservations

[1013] Once the user selects a destination, the device sends that information to the server.

[1014] The server provides detailed route guidance, necessary ticket information, and store reservation procedures, and obtains coupon information from affiliated companies.

[1015] The server sends all this information to the terminal, which displays it to the user.

[1016] Review and earn points after your visit

[1017] Once users have completed their experience at a destination, they can post reviews and photos on their device.

[1018] The terminal sends the review information to the server, which stores it in a database.

[1019] The server awards points to the user and sends a point notification to the terminal.

[1020] Plan your next trip

[1021] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews.

[1022] The server sends the new proposal list to the terminal, which displays it to the user.

[1023] Specific examples

[1024] Example 1: Sightseeing in Tokyo

[1025] The user (Mr. Tanaka) launches the app and registers his interests as "history" and "food" and his budget as "5,000 yen a day."

[1026] Tanaka arrives at Tokyo Station and checks in.

[1027] The server generates a list of suggestions for historical buildings and restaurants around Tokyo Station and sends it to Tanaka's device.

[1028] The emotion engine analyzes Tanaka's facial expression and recognizes that she is relaxed.

[1029] Based on this emotional data, the server will include relaxing cafes and quiet tourist spots in its suggestion list.

[1030] Tanaka selects the suggested Sensoji Temple and a famous Japanese restaurant and checks the details.

[1031] The server provides route guidance and handles reservation procedures, and all information is displayed on Tanaka's device.

[1032] After visiting, Tanaka posts a review and photos and earns points.

[1033] In this way, the system allows travelers to be flexible in their travels and enjoy experiences tailored to their interests and emotional state in real time, while enabling travel companies to use detailed data to improve their marketing and services.

[1034] The processing flow will be explained below.

[1035] User Registration

[1036] Step 1:

[1037] The user installs the app on their device and launches it for the first time.

[1038] Step 2:

[1039] The device displays a form for the user to enter their interests and budget.

[1040] Step 3:

[1041] The user fills out the form with their interests, concerns, and budget and clicks the submit button.

[1042] Step 4:

[1043] The terminal transmits the input information to the server.

[1044] Step 5:

[1045] The server stores the received information in a database and sends a registration confirmation response to the terminal.

[1046] Step 6:

[1047] The device will display "Registration complete" to the user.

[1048] Arrival and check-in

[1049] Step 1:

[1050] The user arrives at the location and opens the app.

[1051] Step 2:

[1052] The device obtains GPS data and determines its current location.

[1053] Step 3:

[1054] The user clicks the check-in button.

[1055] Step 4:

[1056] The device sends its current location and user ID to the server.

[1057] Step 5:

[1058] The server searches for information on tourist spots, restaurants, and souvenirs around the current location and generates a list of suggestions.

[1059] Step 6:

[1060] The server sends the generated list to the terminal.

[1061] Step 7:

[1062] The device displays a list of suggestions to the user.

[1063] Emotion Recognition and Real-Time Suggestions

[1064] Step 1:

[1065] The emotion engine analyzes the user's facial expressions and voice to recognize their emotional state.

[1066] Step 2:

[1067] The device transmits the emotion data to the server.

[1068] Step 3:

[1069] The server adjusts the suggestion list based on the user's emotional state.

[1070] Step 4:

[1071] The user taps on an item of interest from the list of suggestions.

[1072] Step 5:

[1073] The device displays a detailed information screen for the selected item.

[1074] Step 6:

[1075] The user checks for more information.

[1076] Step 7:

[1077] If the user is not satisfied with the suggestion, he or she clicks the Re-suggest button.

[1078] Step 8:

[1079] The terminal sends a re-proposal request to the server.

[1080] Step 9:

[1081] The server generates a list of alternative suggestions and sends it to the terminal.

[1082] Step 10:

[1083] The device will display the new suggestions list to the user.

[1084] Destination confirmation, navigation and reservations

[1085] Step 1:

[1086] The user selects the proposal that satisfies them and confirms their destination.

[1087] Step 2:

[1088] The terminal transmits destination confirmation information to the server.

[1089] Step 3:

[1090] The server generates detailed route directions to the destination.

[1091] Step 4:

[1092] The server handles the necessary ticket information and restaurant reservation procedures.

[1093] Step 5:

[1094] The server acquires coupon information from the partner.

[1095] Step 6:

[1096] The server sends all the information to the terminal.

[1097] Step 7:

[1098] The device displays route guidance, ticket information, reservation confirmation, and coupon information to the user.

[1099] Review and earn points after your visit

[1100] Step 1:

[1101] The user opens the app after visiting a location.

[1102] Step 2:

[1103] The user is directed to the review submission screen.

[1104] Step 3:

[1105] The device will display a review input form.

[1106] Step 4:

[1107] The user enters a review and image and clicks the submit button.

[1108] Step 5:

[1109] The device sends the review and image data to the server.

[1110] Step 6:

[1111] The server stores the data in a database.

[1112] Step 7:

[1113] The server awards points to the user and sends a point notification to the terminal.

[1114] Step 8:

[1115] The terminal will display a message to the user saying that points have been added.

[1116] Plan your next trip

[1117] Step 1:

[1118] The user restarts the app the next time they travel.

[1119] Step 2:

[1120] The device sends the user ID to the server.

[1121] Step 3:

[1122] The server generates a new list of suggestions based on past travel data and reviews.

[1123] Step 4:

[1124] The server sends the new proposal list to the terminal.

[1125] Step 5:

[1126] The device displays a list of suggestions to the user.

[1127] Specific examples

[1128] Example 1: Sightseeing in Tokyo

[1129] Step 1:

[1130] The user (Mr. Tanaka) launches the app and registers his interests as "history" and "food" and his budget as "5,000 yen a day."

[1131] Step 2:

[1132] Tanaka arrives at Tokyo Station and checks in.

[1133] Step 3:

[1134] The server generates a list of suggestions for historical buildings and restaurants around Tokyo Station and sends it to Tanaka's device.

[1135] Step 4:

[1136] The emotion engine analyzes Tanaka's facial expression and recognizes that she is relaxed.

[1137] Step 5:

[1138] Based on this emotional data, the server will include relaxing cafes and quiet tourist spots in its suggestion list.

[1139] Step 6:

[1140] Tanaka selects the suggested Sensoji Temple and a famous Japanese restaurant and checks the details.

[1141] Step 7:

[1142] The server provides route guidance and handles reservation procedures, and all information is displayed on Tanaka's device.

[1143] Step 8:

[1144] After visiting, Tanaka posts a review and photos and earns points.

[1145] In this way, the system allows travelers to be flexible in their travels and enjoy experiences tailored to their interests and emotional state in real time, while enabling travel companies to use detailed data to improve their marketing and services.

[1146] Example 2

[1147] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1148] While traditional travel planning systems can register travelers' interests, preferences, and budgets, the proposed content often does not adapt to the traveler's real-time emotional state, resulting in low satisfaction. While they offer on-site check-in and sightseeing information, they are unable to respond appropriately when travelers need further suggestions. Furthermore, there are limitations to their ability to support multiple languages ​​and utilize detailed traveler data for marketing and service improvement, making it difficult for travel-related businesses to increase their customer attraction.

[1149] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1150] In this invention, the server includes: a means for registering a traveler's interests, preferences, and budget; a means for the traveler to check in at a destination; a means for suggesting tourist spots, restaurants, and souvenirs in real time based on the check-in information; a means for making re-suggestions if the suggestion results in low satisfaction; a means for recognizing the user's emotional state and adjusting the suggestion content based on the user's emotional state; a means for providing route guidance, ticket reservations, restaurant reservations, and partner coupon information once the destination is decided; a means for sharing reviews and images after the trip and earning points; a means for learning the traveler's behavioral history and reviews to suggest the next destination; and a means for transmitting and receiving data between the terminal and the server. This allows travelers to be flexible in their activities and receive optimal suggestions based on their real-time emotional state. Furthermore, re-suggestions are made even if the suggestion is dissatisfied, thereby improving traveler satisfaction. Furthermore, multilingual support and detailed traveler data can be used to increase the customer attraction and marketing capabilities of travel-related businesses.

[1151] "Means for registering traveler interests, preferences, and budget" refers to devices or functions that allow travelers to input and save their areas of interest, specific concerns, and the budget they intend to use for their trip.

[1152] "Means for travelers to check in at a destination" refers to the devices and functionality that allow travelers to confirm their arrival at a destination and register their arrival information in the system using a terminal or mobile application.

[1153] "Means for suggesting information on tourist attractions, restaurants, and souvenirs in real time based on check-in information" refers to devices and functions that use travelers' check-in information to search for information on local tourist attractions, restaurants, souvenir shops, etc. in real time and suggest it to travelers.

[1154] "Means for making a new proposal if the traveler is not satisfied with the proposal" refers to a device or function for generating a new proposal and presenting it to the traveler again if the initial proposal is not satisfactory to the traveler.

[1155] "Means for recognizing the user's emotional state and adjusting the content of suggestions based on that" refers to devices or functions that analyze the user's facial expressions and voice to recognize their emotional state, and change or adapt the content of suggestions in real time based on that data.

[1156] "Means of providing route guidance, ticket reservations, restaurant reservations, and partner coupon information once a destination has been decided" refers to devices and functions that, once a traveler has decided on a destination, provide guidance on how to get to that location, reserve necessary tickets, make reservations at restaurants, etc., and provide partner coupon information.

[1157] "Means for sharing reviews and images after a trip and earning points" refers to devices and functions that allow travelers to post reviews and images about their experiences at their travel destinations, and for the system to award points for those posts.

[1158] "Means of learning from travelers' behavioral history and reviews to suggest their next destination" refers to devices or functions that analyze travelers' past behavioral history and posted reviews and suggest their next travel plans based on that information.

[1159] "Means for transmitting and receiving data between a terminal and a server" refers to devices and functions for exchanging data bidirectionally between a user's terminal and a central server.

[1160] System Configuration and Hardware / Software Usage

[1161] This invention is a system that includes a traveler (user) terminal, a central server, and an emotion engine. This system includes a user interface for registering the user's interests and budget, a database and API for suggesting tourist destination information in real time, an emotion engine that recognizes the user's emotional state, and a communication module for bidirectional data exchange. Specific implementation methods for each element are described below.

[1162] User Registration

[1163] A user installs and launches a travel application. On first launch, the device displays a form for the traveler to enter their interests, preferences, and budget. The information entered by the user is sent from the device to a server, which stores it in a database (e.g., MySQL).

[1164] Arrival and check-in

[1165] When the user arrives at a destination, they press the check-in button. The device uses GPS (e.g., Google Maps API) to obtain their current location and sends that information to the server. Based on the current location, the server obtains real-time information about tourist spots, restaurants, etc. from an API (e.g., Google Places API) and sends it to the device as a list of suggestions.

[1166] Emotion Recognition and Real-Time Suggestions

[1167] The server generates a list of suggestions and sends it to the device. An emotion engine (e.g., OpenCV, TensorFlow) analyzes the user's facial expressions and voice to recognize their emotional state. The device sends the emotion data to the server, which then adjusts the suggestions based on that data. For example, if the user is in a relaxed state, quiet tourist spots and cafes will be added to the suggestion list.

[1168] Destination confirmation, navigation and reservations

[1169] Once the user selects their destination, that information is sent from the device to the server, which then uses the Google Maps API and other tools to provide detailed route guidance, book tickets, and make store reservations, and obtain coupon information from partner companies and send it to the device.

[1170] Review and earn points after your visit

[1171] When a user finishes their experience at a destination, they post their review and photos from their device to the server. The server stores these in a database and awards points to the user. The device then displays a notification to the user that they have received points.

[1172] Plan your next trip

[1173] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews, and sends the list to the device, which then displays it to the user.

[1174] Specific examples

[1175] Example 1: Sightseeing in Tokyo

[1176] 1. The user launches the application and registers "History," "Gourmet," and a budget of "5,000 yen per day." The device sends this information to the server, which then stores it in a database.

[1177] 2. When a user arrives at Tokyo Station, they press the check-in button. The device retrieves their current location from GPS and sends it to the server. The server then uses the Google Places API to retrieve information about tourist spots and restaurants and generates a list of suggestions.

[1178] 3. The emotion engine analyzes the user's facial expressions and voice and recognizes that they are in a relaxed state. The device sends the emotion data to the server, which then adds relaxing cafes and quiet tourist spots to a list of suggestions.

[1179] 4. For example, a user selects Sensoji Temple and a famous Japanese restaurant and checks the details. The server uses the Google Maps API to provide route guidance and make reservations, and sends the information to the device.

[1180] 5. After your visit, launch the app and post a review and photos. The device sends this information to the server, which stores it in a database and awards points.

[1181] The system allows travelers to be flexible on-site and receive optimal recommendations based on their real-time emotional state, while also enabling travel-related businesses to improve their customer attraction and marketing.

[1182] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1183] Step 1:

[1184] The user installs the travel app and launches it for the first time.

[1185] When the device is first started, it displays a form for travelers to enter their interests, preferences, and budget.

[1186] The user fills in the form and clicks the submit button.

[1187] The input here is text data such as interests, concerns, budget, etc.

[1188] The device sends the entered information to the server, which receives the data and stores it in a database such as MySQL.

[1189] During this process, user profile information such as interests, preferences, and budget are registered in a database.

[1190] Step 2:

[1191] The user arrives at the location and presses the check-in button within the app.

[1192] The input here is check-in operation and GPS information.

[1193] The device uses the GPS function to obtain current location information and sends that information to the server.

[1194] The server receives the current location information and searches for nearby tourist spots, restaurants, and souvenir information using the Google Places API, etc. The search results data is aggregated on the server.

[1195] The server generates data as a proposal list and transmits it to the terminal.

[1196] In this step, tourist spots and restaurant information are suggested to the user in real time based on the check-in information.

[1197] Step 3:

[1198] The server sends the generated proposal list to the terminal.

[1199] The input here is the data for the suggestion list.

[1200] The emotion engine collects the user's facial expressions and voice through the camera and microphone and converts them into emotion data. The emotion engine uses OpenCV and TensorFlow to analyze the user's emotional state.

[1201] Output data from the emotion engine is sent to the terminal.

[1202] The device receives the emotion data and transmits it to the server.

[1203] The server adjusts the suggestion list based on the user's emotional data. If a new suggestion is needed, it generates a new suggestion and sends it to the device as data.

[1204] In this step, the suggestions are adjusted based on the results of emotion recognition.

[1205] Step 4:

[1206] Users can select the offers that interest them and view more information in the app.

[1207] The input here is the information of the selected proposal.

[1208] The terminal transmits the selected information to the server.

[1209] The server retrieves the necessary details from the Google Maps API, etc., and then coordinates and retrieves route guidance, ticket reservations, store reservations, and coupon information.

[1210] The server transmits this data to the terminal.

[1211] This step provides specific actionable guidance based on the plan the user has chosen.

[1212] Step 5:

[1213] After users arrive at their destination and complete their experience, they post reviews and photos on the app.

[1214] The input here is the text data and image data of the review.

[1215] The terminal transmits the posted review information to the server.

[1216] The server registers the review information and image data in a database.

[1217] Once registration is complete, the server will grant points to the user and send a notification of point acquisition to the terminal.

[1218] In this step, the user's experience review is saved in the database and points are awarded.

[1219] Step 6:

[1220] The user launches the app again to plan their next trip.

[1221] The server retrieves past behavioral history and reviews from the database and generates a new list of suggestions.

[1222] The server sends the proposal list to the terminal.

[1223] The device will present the new list of suggestions to the user.

[1224] In this step, new travel plans are suggested based on past data.

[1225] (Application example 2)

[1226] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1227] Modern travelers often want to receive specific information and suggestions based on their interests, preferences, and budget in real time while visiting their destination. However, current systems are unable to provide suggestions that take into account the traveler's emotional state, which can lead to low traveler satisfaction. Additionally, changing plans or making new suggestions while visiting a destination can be time-consuming, resulting in inflexible travel planning. Furthermore, reviews and point systems are not being fully utilized, which presents an issue of not being able to fully utilize the information when planning their next trip.

[1228] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for registering the traveler's interests, concerns, and budget; means for the traveler to check in at a destination; means for suggesting tourist spots, restaurants, and souvenirs in real time based on the check-in information; means for making re-suggestions if the suggestion is unsatisfactory; means for providing route guidance, ticket reservations, restaurant reservations, and partner coupon information once the destination is decided; means for sharing reviews and images after the trip and earning points; means for recognizing the traveler's emotional state from facial expressions or voice and adjusting the suggestion content based on that emotional state; and means for learning the traveler's behavior history and reviews to suggest the next destination. This allows travelers to flexibly plan their activities on site and receive suggestions tailored to their emotional state. Furthermore, utilizing reviews and point systems can further enhance their next travel plans.

[1229] "Tourist" refers to an individual or group traveling with the intention of visiting a place.

[1230] "Interests" refer to the themes or activities that a traveler is particularly interested in.

[1231] "Interest" refers to the things that tourists pay particular attention to or information that attracts their attention.

[1232] "Budget" refers to the range of amounts a traveler is willing to spend on a travel activity.

[1233] "Checking in" is the act of a traveler registering their presence at a destination in the system upon arrival.

[1234] "Real-time" refers to data being updated and processed almost instantly.

[1235] "Tourist destination" means a historical, cultural or natural attraction that is intended for visits by tourists.

[1236] "Restaurant" means an establishment that serves food and beverages.

[1237] "Souvenir information" refers to information about souvenirs and local specialties that can be purchased at the destination.

[1238] "Recommendation" means the act of providing a traveler with recommendations for places to visit, activities, or services.

[1239] "Route guidance" is information that shows the optimal route to reach a destination.

[1240] "Ticket reservation" refers to the process of securing admission tickets to a facility or event in advance.

[1241] "Emotional state" refers to the traveler's current psychological and emotional state.

[1242] "Facial expressions" refers to visual expressions used to read a traveler's emotions.

[1243] "Voice" refers to vocal expressions used to read the traveler's emotions.

[1244] A "review" is when a traveler shares their rating or opinion about a destination or service.

[1245] "Points" refers to points in a reward system awarded for reviews and actions.

[1246] "Behavioral history" refers to a record of a traveler's past activities and visits.

[1247] "Partners" refers to businesses and service providers that are affiliated with the system.

[1248] System Configuration

[1249] To implement this invention, the following system configuration is required: The system is composed of a traveler's terminal, a central server, a database, an API that provides various travel-related services, and an emotion engine.

[1250] Program processing overview

[1251] The main operations of the system are as follows.

[1252] Hardware and Software

[1253] Server: A central computer for processing large amounts of data and making real-time recommendations.

[1254] Device: A user's mobile device, such as a smartphone or tablet.

[1255] Emotion Engine: Dedicated software to analyze the user's facial expressions and voice to detect their emotional state.

[1256] GPS module: A location information acquisition device installed on a terminal.

[1257] Network: A communications infrastructure that connects various devices and transmits and receives data.

[1258] Data Processing

[1259] User registration: The device sends the user's entered interests, preferences, and budget information to the server, which stores the information in a database.

[1260] Emotion Recognition: The emotion engine uses the device's camera and microphone to analyze the user's facial expressions and voice, and sends the results to the server.

[1261] Suggestion generation: Based on the user's location information and emotional state, the server searches the database for relevant tourist spots, restaurants, and souvenir information in real time and generates a suggestion list.

[1262] Re-proposal: If the user is not satisfied with the proposal, the device sends a re-proposal request to the server, and the server generates a new proposal list and sends it to the device.

[1263] Navigation and reservations: Once the user selects a destination, the server provides route guidance, ticket reservations, and store reservations information and sends this information to the device.

[1264] Reviews and point awarding: When a user writes a review after a visit, the device sends the information to the server, which stores it in a database and awards points.

[1265] Specific examples

[1266] User registration: When a "user" launches the app for the first time, they register their interests as "history" and "food" and their budget as "5,000 yen per day."

[1267] Emotion recognition: The "emotion engine" analyzes the "user's" facial expressions and recognizes that they are relaxed.

[1268] Suggestion generation: The "server" searches for tourist attractions and restaurants around Tokyo Station in real time and generates a list of suggestions including relaxing cafes and quiet tourist spots.

[1269] Navigation and Reservations: Once the "user" selects Sensoji Temple, the "server" sends route directions to the device and makes any necessary ticket reservations.

[1270] Prompt Sentence Examples

[1271] "Name is Tanaka, interests are history and food, budget is 5000 yen, emotional state is relaxed."

[1272] The system allows travelers to plan their activities more flexibly while on-site, provides suggestions based on their emotional state, and provides a more satisfying travel experience. It also allows travelers to make more fulfilling plans for their next trip by utilizing reviews and a points system.

[1273] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1274] Step 1: User Registration

[1275] When a user installs and launches the app for the first time, the device displays a form asking the user to enter their interests, preferences, and budget. After the user enters the information and clicks the submit button, the device sends this information to the server, which receives it and stores it in a database.

[1276] Input: User interests, concerns, budget

[1277] Data processing: Send input information to the server and save it

[1278] Output: The information is saved to the database

[1279] Step 2: Arrival and check-in

[1280] When the user arrives at their destination, they press the check-in button. The device uses a GPS module to obtain their current location and sends that information to the server. The server then uses that location information to search for nearby tourist attractions, restaurants, and souvenir information.

[1281] Input: User's current location

[1282] Data processing: Search for information based on current location information

[1283] Output: Generate a list of suggestions

[1284] Step 3: Emotion Recognition

[1285] The emotion engine uses the device's camera and microphone to analyze the user's facial expressions and voice, and sends the results to the server, which receives the user's emotional state and adjusts the suggestions it makes to the user.

[1286] Input: User's facial expressions and voice

[1287] Data processing: Emotional state analysis and proposal adjustment

[1288] Output: A list of suggestions based on emotional state

[1289] Step 4: Propose and Re-Propose

[1290] The server generates a list of suggestions, such as tourist spots, restaurants, and souvenirs, based on the user's current location and emotional state, and sends it to the device. If the user is not satisfied with the items in the suggestion list, a re-suggestion request is sent from the device to the server. The server then generates a new suggestion list and sends it again to the device.

[1291] Input: current location, emotional state, re-suggestion request

[1292] Data processing: Proposal list generation and refinement

[1293] Output: Refined proposal list

[1294] Step 5: Confirm destination, navigate and make reservations

[1295] The user selects a destination they wish to visit from the list of suggestions. The device sends this information to the server. The server then provides detailed route guidance, book tickets, and store reservations, and obtains coupon information from partner companies, and sends all of this information to the device. The device then displays this to the user.

[1296] Input: User's destination selection information

[1297] Data processing: route guidance and reservation procedures

[1298] Output: Route guidance, ticket information, coupon information

[1299] Step 6: Review after visit and earn points

[1300] After a user has completed their experience at a destination, they can post reviews and photos on their device. Once the user has entered and submitted their review, the device sends this information to the server, which then stores the review information in a database and awards points to the user.

[1301] Input: Review information, image

[1302] Data processing: Saving review information and awarding points

[1303] Output: Saved review information, awarded points

[1304] Step 7: Plan your next trip

[1305] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews, and sends the list to the device, which then displays it to the user.

[1306] Input: User behavior history, review information

[1307] Data processing: Generate a proposal list based on past data

[1308] Output: Suggestion list

[1309] In this way, users can flexibly plan their activities while on-site, receive suggestions based on their emotional state, and utilize reviews and a points system to enhance their next travel plans.

[1310] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1311] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1312] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1313] [Third embodiment]

[1314] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1315] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1316] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1317] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1318] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1319] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1320] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1321] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1322] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1323] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1324] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1325] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1326] To implement this invention, the following system configuration and program processing are required. The system is primarily comprised of interactions between three parties: a server, a terminal, and a user. Because questions about each processing step will be asked later, we will not go into detail about the processing steps here, but will explain the overall flow and provide specific examples.

[1327] System Configuration

[1328] The system includes a traveler (user) device, a central server, and a database and APIs that provide various travel-related services. The server stores user registration information and handles real-time suggestions, reservations, and review collection. The device provides an interface for users to plan trips and accept suggestions through the app.

[1329] Program processing overview

[1330] User Registration

[1331] Users launch the app on their device and enter their interests and budget.

[1332] The terminal sends this information to the server, which stores it in a database.

[1333] Arrival and check-in

[1334] When the user arrives at the location and presses the check-in button, the device obtains the user's current location information.

[1335] The device sends its current location information to the server, which then searches for information on nearby tourist attractions, restaurants, and souvenirs in real time.

[1336] Real-time suggestions

[1337] The server generates a list of suggestions based on the user's current location and registered information (interests, concerns, budget) and sends it to the device.

[1338] The user can review the list of suggestions on their device and make a selection.

[1339] If the proposal is not satisfactory, a re-proposal request is sent to the server, which makes a new proposal.

[1340] Destination confirmation, navigation and reservations

[1341] Once the user selects a destination, the device sends that information to the server.

[1342] The server provides detailed route guidance, necessary ticket information, and store reservation procedures, and obtains coupon information from affiliated companies.

[1343] The server sends all this information to the terminal, which displays it to the user.

[1344] Review and earn points after your visit

[1345] Once users have completed their experience at a destination, they can post reviews and photos on their device.

[1346] The terminal sends the review information to the server, which stores it in a database.

[1347] The server awards points to the user and sends a point notification to the terminal.

[1348] Plan your next trip

[1349] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews.

[1350] The server sends the new proposal list to the terminal, which displays it to the user.

[1351] Specific examples

[1352] Example 1: Sightseeing in Tokyo

[1353] The user (Mr. Tanaka) launches the app and registers his interests as "history" and "food" and his budget as "5,000 yen a day."

[1354] Tanaka arrives at Tokyo Station and checks in.

[1355] The server generates a list of suggestions for historical buildings and restaurants around Tokyo Station and sends it to Tanaka's device.

[1356] Tanaka selects the suggested Sensoji Temple and a famous udon restaurant and checks the details.

[1357] The server provides route guidance and handles reservation procedures, and all information is displayed on Tanaka's device.

[1358] After visiting, Tanaka posts a review and photos and earns points.

[1359] In this way, the system gives travelers flexibility in their travels and allows them to enjoy experiences that are tailored to their interests in real time, while enabling travel companies to use detailed data to improve their marketing and services.

[1360] The processing flow will be explained below.

[1361] User Registration

[1362] Step 1:

[1363] The user installs the app on their device and launches it for the first time.

[1364] Step 2:

[1365] The device displays a form for the user to enter their interests and budget.

[1366] Step 3:

[1367] The user fills out the form with their interests, concerns, and budget and clicks the submit button.

[1368] Step 4:

[1369] The terminal transmits the input information to the server.

[1370] Step 5:

[1371] The server stores the received information in a database and sends a registration confirmation response to the terminal.

[1372] Step 6:

[1373] The device will display "Registration complete" to the user.

[1374] Arrival and check-in

[1375] Step 1:

[1376] The user arrives at the location and opens the app.

[1377] Step 2:

[1378] The device obtains GPS data and determines its current location.

[1379] Step 3:

[1380] The user clicks the check-in button.

[1381] Step 4:

[1382] The device sends its current location and user ID to the server.

[1383] Step 5:

[1384] The server searches for information on tourist spots, restaurants, and souvenirs around the current location and generates a list of suggestions.

[1385] Step 6:

[1386] The server sends the generated list to the terminal.

[1387] Step 7:

[1388] The device displays a list of suggestions to the user.

[1389] Real-time suggestions

[1390] Step 1:

[1391] The user taps on an item of interest from the list of suggestions.

[1392] Step 2:

[1393] The device displays a detailed information screen for the selected item.

[1394] Step 3:

[1395] The user checks for more information.

[1396] Step 4:

[1397] If the user is not satisfied with the suggestion, he or she clicks the Re-suggest button.

[1398] Step 5:

[1399] The terminal sends a re-proposal request to the server.

[1400] Step 6:

[1401] The server generates a list of alternative suggestions and sends it to the terminal.

[1402] Step 7:

[1403] The device will display the new suggestions list to the user.

[1404] Destination confirmation, navigation and reservations

[1405] Step 1:

[1406] The user selects the proposal that satisfies them and confirms their destination.

[1407] Step 2:

[1408] The terminal transmits destination confirmation information to the server.

[1409] Step 3:

[1410] The server generates detailed route directions to the destination.

[1411] Step 4:

[1412] The server handles the necessary ticket information and restaurant reservation procedures.

[1413] Step 5:

[1414] The server acquires coupon information from the partner.

[1415] Step 6:

[1416] The server sends all the information to the terminal.

[1417] Step 7:

[1418] The device displays route guidance, ticket information, reservation confirmation, and coupon information to the user.

[1419] Review and earn points after your visit

[1420] Step 1:

[1421] The user opens the app after visiting a location.

[1422] Step 2:

[1423] The user is directed to the review submission screen.

[1424] Step 3:

[1425] The device will display a review input form.

[1426] Step 4:

[1427] The user enters a review and image and clicks the submit button.

[1428] Step 5:

[1429] The device sends the review and image data to the server.

[1430] Step 6:

[1431] The server stores the data in a database.

[1432] Step 7:

[1433] The server awards points to the user and sends a point notification to the terminal.

[1434] Step 8:

[1435] The terminal will display a message to the user saying that points have been added.

[1436] Plan your next trip

[1437] Step 1:

[1438] The user restarts the app the next time they travel.

[1439] Step 2:

[1440] The device sends the user ID to the server.

[1441] Step 3:

[1442] The server generates a new list of suggestions based on past travel data and reviews.

[1443] Step 4:

[1444] The server sends the new proposal list to the terminal.

[1445] Step 5:

[1446] The device displays a list of suggestions to the user.

[1447] Through these detailed processing steps, the system provides travelers with real-time personalized information to optimize their travel experience, while enabling travel-related companies to improve their services by providing detailed data analysis.

[1448] Example 1

[1449] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1450] Today's travelers are required to plan trips that meet their diverse needs and interests. However, existing travel support systems face challenges in that they are unable to respond flexibly in real time or provide optimal suggestions for individual travelers. In particular, there is a demand for technology that can efficiently and centrally handle a series of processes, including on-site information gathering, updating of suggestions, reservation procedures, and point awarding.

[1451] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1452] In this invention, the server includes means for registering a traveler's interests, concerns, and budget, means for the traveler to check in at a destination, means for suggesting tourist spots, restaurants, and souvenir information in real time based on check-in information, means for making re-suggestions if satisfaction with the suggestions is low, means for providing route guidance, ticket reservations, store reservations, and affiliated coupon information when the destination is decided, means for sharing reviews and images after the trip and earning points, means for learning the traveler's behavioral history and reviews to suggest the next destination, means for generating a suggestion list based on the traveler's current location and registration information using a generative AI model, means for sending the suggestion list to a terminal and making new suggestions based on a re-suggestion request, means for saving review information after the visit in a database and awarding points, means for obtaining surrounding information in real time using an affiliated tourist information providing API, means for the terminal to obtain current location information using GPS, and means for providing detailed route guidance, ticket information, and store reservation procedures using an external API.

[1453] This will enable us to respond to the diverse needs of travelers, provide optimal travel plans for each individual traveler in real time, and ensure an efficient travel experience.

[1454] "Tourist" refers to an individual or group traveling for the purpose of travel.

[1455] "Interest" refers to a traveler's interest or motivation in a particular topic or activity.

[1456] "Interests" refers to the interest a traveler has in a particular place, culture, activity, etc.

[1457] "Budget" refers to the amount of money a traveler can spend on a trip.

[1458] "Terminal" refers to an electronic device used by a user, such as a smartphone or tablet.

[1459] A "server" refers to a computer system that communicates with terminals via a network and processes and stores data.

[1460] A "database" refers to a system that stores information in an organized manner and enables it to be searched and manipulated.

[1461] "GPS" refers to the Global Positioning System, a system for determining locations on Earth.

[1462] "Check-in" refers to the act of a traveler reporting their arrival at a particular location via a terminal.

[1463] "Suggestion list" refers to a list of recommended tourist spots, restaurants, etc. generated by the server based on the traveler's interests, preferences, budget, and current location information.

[1464] "Re-proposal" refers to the process of making a new proposal if the initial proposal is dissatisfied.

[1465] "Destination" refers to the place a traveler chooses to visit.

[1466] "Route guidance" refers to guidance information that provides travelers with the optimal route to reach their destination.

[1467] "Ticket reservation" refers to the process of securing tickets in advance for transportation, events, etc.

[1468] "Coupon Information" refers to information regarding discounts and benefits offered by our partners.

[1469] A "review" refers to a traveler's act of writing an evaluation or opinion about their experience at a destination.

[1470] "Points" refers to rewards travelers earn through reviews and other activities.

[1471] "Behavioral history" refers to a record of a traveler's past trips and places visited.

[1472] A "generative AI model" refers to an algorithmic model that uses machine learning to make optimal suggestions and predictions from data.

[1473] "API" refers to an application programming interface that enables communication with other software systems.

[1474] To implement this invention, a system configuration is required that includes a traveler (user) terminal, a central server, and a database and APIs that provide various travel-related services. The system is primarily comprised of interactions between the server, terminal, and user.

[1475] System Configuration

[1476] The system consists of a user's device (such as a smartphone or tablet), a central server, and partnered external tourism information APIs (e.g., Google Places API and Google Maps API). The server stores user registration information and provides real-time suggestions, reservations, and reviews. The device provides an interface for users to accept travel plans and suggestions through the app.

[1477] Program processing overview

[1478] The program works as follows:

[1479] 1. User Registration

[1480] The user launches the app and enters their interests and budget, and the device sends this information to the server.

[1481] The server stores the received information in a database.

[1482] Examples:

[1483] A user registers their interests as "history" and "food" and a budget of "5,000 yen per day."

[1484] Example prompt: "What are your hobbies at your travel destination? For example, history, food, shopping, etc."

[1485] 2. Arrival and check-in

[1486] When the user arrives at the location and presses the check-in button, the device uses GPS to obtain their current location information.

[1487] The device sends its current location information to the server, and the server then calls an affiliated tourist information provider API to obtain information about the surrounding area.

[1488] Examples:

[1489] The user arrives at Tokyo Station and checks in.

[1490] Example prompt: "Send me tourist information about my current location. Generate a list of nearby attractions."

[1491] 3. Real-time suggestions

[1492] The server uses a generative AI model based on the user's current location and registration information to generate a list of suggestions and sends it to the device.

[1493] The user can view and select from a list of suggestions on their device. If they are not satisfied with the suggestions, a re-suggestion request is sent to the server, and a new suggestion is made.

[1494] Examples:

[1495] Users can select Sensoji Temple or a famous udon restaurant and check detailed information.

[1496] Example prompt: "Create a new list of suggestions based on the user's interests and location."

[1497] 4. Destination confirmation, navigation and reservations

[1498] Once the user selects their destination, the device sends that information to the server, which then provides detailed route guidance, necessary ticket information, store reservations, and obtains coupon information from affiliated companies.

[1499] All this information is sent to the terminal and displayed to the user.

[1500] Examples:

[1501] The server provides route guidance and handles reservation procedures, and all information is displayed on the user's device.

[1502] Example prompt: "Suggest route directions, ticket information, and booking procedures."

[1503] 5. Review after your visit and earn points

[1504] After the user has finished their experience at a destination, they can post a review and photos on their device, which then sends the review information to the server, which then stores it in a database.

[1505] The server awards points and sends a point notification to the terminal.

[1506] Examples:

[1507] Users post reviews and photos and earn points.

[1508] Example prompt: "Receive user ratings and photo submissions and generate point award notifications."

[1509] 6. Planning your next trip

[1510] The next time the user launches the app, the server generates a new list of suggestions based on past behavioral history and reviews and sends it to the device.

[1511] The device displays a list of suggestions to the user.

[1512] Examples:

[1513] The server analyzes past behavioral history and reviews to create a new list of suggestions.

[1514] Example prompt: "Create a new list of suggestions based on your past behavioral history and reviews."

[1515] The system allows users to enjoy flexible travel plans tailored to their interests in real time, while travel-related companies can use the detailed data to improve their marketing and services.

[1516] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1517] Program processing flow

[1518] Step 1: User Registration

[1519] The user launches the app.

[1520] The user inputs their interests and budget. The input data is interests (e.g., "history," "food"), interests (e.g., "activity," "shopping"), and budget (e.g., "5,000 yen per day").

[1521] The terminal converts the input data into JSON format and sends it to the server.

[1522] The server stores the received information in a database, using a database such as MySQL, and performs transaction processing to maintain data consistency.

[1523] Input: User interests, preferences, and budget data

[1524] Data processing: Convert to JSON format

[1525] Output: User data sent to the server

[1526] Step 2: Arrival and check-in

[1527] The user arrives at the location and presses the check-in button on the app.

[1528] The device uses GPS to obtain the current location information.

[1529] The device converts the current location information into JSON format and sends it to the server.

[1530] The server calls an affiliated tourist information provider API (e.g., Google Places API) based on the current location information, formats the data obtained from the API, and saves it.

[1531] Input: Current location information (GPS data)

[1532] Data processing: Convert to JSON format, call tourist information API

[1533] Output: Current location data and tourist information sent to the server

[1534] Step 3: Real-time proposals

[1535] The server uses a generative AI model to generate a list of suggestions based on the user's current location and registration information.

[1536] The generative AI model takes inputs such as interests, preferences, budget, and current location, and suggests travel plans suitable for the user in real time.

[1537] The server converts the generated proposal list into JSON format and sends it to the device.

[1538] The device displays a list of suggestions to the user.

[1539] Input: User location, interests, preferences, and budget data

[1540] Data processing: Generate a proposal list using a generative AI model and convert it into JSON format

[1541] Output: Suggestion list

[1542] Step 4: Confirm destination, navigate and book

[1543] The user selects a destination from a list of suggestions.

[1544] The terminal converts the selected data into JSON format and sends it to the server.

[1545] Based on the selection information, the server calls an external API (e.g., Google Maps API, API for a reservation site) to provide route guidance, ticket information, and store reservation procedures.

[1546] The server acquires coupon information from the partner.

[1547] The server converts this information into JSON format and sends it to the terminal.

[1548] The device displays the information it receives to the user.

[1549] Input: Destination selection information

[1550] Data processing: Convert to JSON format, call external API, get coupon information

[1551] Output: Route directions, ticket information, reservation information

[1552] Step 5: Review after your visit and earn points

[1553] After visiting, users post reviews and photos within the app.

[1554] The device converts reviews and images into JSON format and sends them to the server.

[1555] The server stores the review information in a database, where it is analyzed by a rating algorithm.

[1556] The server awards points, converts the point notification into JSON format, and sends it to the terminal.

[1557] The terminal displays a point award notification to the user.

[1558] Input: Review information and images

[1559] Data processing: Convert to JSON format and analyze using evaluation algorithms

[1560] Output: Save to database, point allocation notification

[1561] Step 6: Plan your next trip

[1562] The next time the user launches the app.

[1563] The server uses a generative AI model to create a new list of suggestions based on past behavioral history and reviews.

[1564] The server converts the generated new proposal list into JSON format and sends it to the device.

[1565] The device displays a list of suggestions to the user.

[1566] Input: Past activity history and reviews

[1567] Data processing: Generate a new proposal list using a generative AI model and convert it into JSON format

[1568] Output: New proposal list

[1569] In this way, detailed data processing and calculations are carried out at each step, and the system provides optimal travel plans in real time. This process allows users to plan their trips flexibly, and travel-related companies can make more efficient marketing efforts.

[1570] (Application example 1)

[1571] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1572] Conventional travel support systems suggest tourist spots and restaurants based on travelers' interests and budgets, but provide transportation options individually and lack a centralized means for managing real-time suggestions and reservation procedures. As a result, travelers often spend time and effort traveling to their destinations and completing various reservation procedures. To achieve greater efficiency and improve user experience, a system is needed that can summon an autonomous vehicle based on the traveler's current location and provide real-time suggestions for tourist spots and restaurants, route guidance, and reservation procedures in an integrated manner.

[1573] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1574] In this invention, the server includes means for registering a traveler's interests, preferences, and budget, means for the traveler to check in at a destination, means for suggesting tourist spots, restaurants, and souvenirs in real time based on the check-in information, means for making re-suggestions if the suggestion is not satisfactory, means for providing route guidance, ticket reservations, restaurant reservations, and partner coupon information when the destination is decided, means for sharing reviews and images after the trip and earning points, means for learning the traveler's behavioral history and reviews to suggest the next destination, means for calling an autonomous vehicle and guiding it to the destination based on the traveler's current location information, and means for linking with the autonomous vehicle to suggest tourist spots and restaurants, provide route guidance, and make reservations in real time. This enables travelers to manage transportation, tourist information, and reservation procedures in an integrated manner within a single system.

[1575] "Tourist" refers to a person who visits a tourist spot or destination.

[1576] "Interest" refers to a traveler's interest in a particular activity or place.

[1577] "Interest" refers to a focus on specific genres or themes that interest travelers.

[1578] "Budget" refers to the amount of money a traveler decides to spend on their trip.

[1579] "Location Information" refers to a traveler's real-time geographic location obtained through GPS or location-based services.

[1580] "Check-in" refers to the act of a traveler notifying the system that they have arrived at a particular location.

[1581] "Real-time suggestions" refers to providing instant information about tourist spots and restaurants based on the traveler's current location and registration information.

[1582] "Re-proposal" refers to making a new proposal if the traveler is not satisfied with the initial proposal.

[1583] A "destination" refers to a specific place or facility that a traveler ultimately wants to reach.

[1584] "Route Guidance" refers to providing detailed directions for a traveler to travel from their current location to their destination.

[1585] "Ticket reservation" refers to the process of reserving tickets for transportation or tourist attractions in advance.

[1586] "Restaurant reservations" refers to the process of making advance reservations for restaurants, shops, and other establishments.

[1587] "Coupon information from affiliated stores" refers to discount and special offer information provided by affiliated stores and facilities.

[1588] A "review" refers to a traveler's evaluation or impressions of the places or facilities they visited after their trip.

[1589] "Points" refers to rewards given to travelers for actions such as writing reviews and sharing photos after a trip.

[1590] "Behavioral history" refers to records of places a traveler has visited and services they have used in the past.

[1591] An "autonomous vehicle" is a vehicle that has the ability to travel automatically to a destination without a human driver.

[1592] "Navigation" refers to providing guidance on the route to a destination.

[1593] "Real-time" refers to the instantaneous provision of information and services.

[1594] The system includes a traveler (user) device, a central server, and a database and API that provide various travel-related services. The server stores user registration information, makes real-time suggestions, and collects reviews. The device provides an interface for users to plan trips and accept suggestions through the app.

[1595] First, users launch the app on their device and enter their interests and budget. This information is sent from the device to the server, which stores it in a database. When the user arrives at a destination and presses the check-in button, the device acquires their current location information and sends it to the server. The server receives this information and makes real-time recommendations about tourist spots, restaurants, and souvenirs based on the user's current location and registered information.

[1596] The server also has the ability to make a second suggestion if the user is not satisfied with the suggestion. When the user selects a suggestion that satisfies them, the destination is determined and the device sends this information to the server. The server then provides detailed route guidance, necessary ticket information, and store reservation procedures, and also obtains coupon information from affiliated companies. This information is then sent to the device and displayed to the user.

[1597] When using an autonomous vehicle, the system will call the vehicle based on the user's current location and guide them to their destination. The autonomous vehicle will then integrate and manage real-time suggestions for tourist spots and restaurants, route guidance, and reservation procedures.

[1598] After a trip, users can share reviews and photos on their devices and send them to the server. The server stores this information in a database and awards points to the user. The server also learns from the user's behavioral history and reviews, and generates a new list of recommendations for the next trip.

[1599] The main hardware used is a smartphone, and the software is an HTTP request library (requests) that handles communication between the user device and the server. User input and location information are sent to the server, which then retrieves data from multiple APIs and makes suggestions tailored to the user's interests and budget.

[1600] As a concrete example, suppose a user starts the app, registers their interest in "history" and "food," and sets their travel budget to "5,000 yen." If the user arrives at the center of a large city as their destination, the server will suggest nearby historical buildings and famous restaurants. If the user selects a historical building and a well-known restaurant in Asakusa, detailed route guidance and reservation information will be displayed on the smartphone. Then, the autonomous vehicle will safely guide the user to their destination.

[1601] An example prompt for a generative AI model is:

[1602] "What is the specification for an application that, after a user arrives in the center of a large city, recommends tourist spots and restaurants based on his interests and budget?"

[1603] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1604] Step 1:

[1605] User Registration

[1606] The user launches the application on their smartphone and enters their interests and budget. This inputs the user's personal information and travel preferences into the application. The device then sends this information to the server, which stores it in a database. The output is that the user's information is recorded in a database stored on the server.

[1607] Step 2:

[1608] Arrival and check-in

[1609] When the user arrives at their destination, they press the check-in button on the device. The device uses GPS to obtain the user's current location and sends that location data to the server. The server uses the user's current location information as input, and records the current location information in real time on the server side as output.

[1610] Step 3:

[1611] Real-time suggestions

[1612] The server generates a list of recommendations for tourist spots, restaurants, and souvenirs based on the user's current location and pre-registered interests and budget. The server then calls the relevant APIs to retrieve the necessary data and filters the information that matches the user's criteria. The output is a recommendation list that is sent to the user's device.

[1613] Step 4:

[1614] Re-proposal

[1615] If the user is not satisfied with the proposal list, they request a re-proposal. The device sends this request to the server, and the server generates a new proposal list and sends it back to the user device. The input is the user's re-proposal request, and the output is the new proposal list.

[1616] Step 5:

[1617] Destination confirmation, navigation and reservations

[1618] When a user selects a destination from the list of suggestions, the device sends the selection information to the server, which then generates detailed route guidance and uses partner APIs to handle ticket information and reservation procedures. The output is obtained by sending route guidance, ticket information, and store reservation information to the user's device.

[1619] Step 6:

[1620] Autonomous vehicle collaboration

[1621] Based on the user's current location information, an autonomous vehicle is called and navigation to the destination is provided. The device sends the current location information to the server, and the server calls the autonomous vehicle's API to dispatch a vehicle and send navigation information to the user's device. The input is the user's current location information, and the output is vehicle dispatch and navigation information.

[1622] Step 7:

[1623] Post-trip reviews and points

[1624] Users review their experiences at the places they visit and upload images. The device sends this information to the server, which stores it in a database. The server then awards points to the user and sends a notification to the device. The input is the review information and images, and the output is the saved database and a notification that points have been awarded.

[1625] Step 8:

[1626] Plan your next trip

[1627] The next time the user launches the app, the server generates a new list of suggestions based on their past travel history and reviews, providing them with an up-to-date travel plan tailored to their preferences. The input is their past travel history and reviews, and the output is a new list of suggestions.

[1628] As a concrete example, consider the case where a user launches the app, registers their interest in "history" and "gourmet food," and sets a travel budget of "5,000 yen." When the user arrives at the center of a large city as their destination, the server suggests nearby historical buildings and famous restaurants. After the user selects a historical building and a well-known restaurant in Asakusa, detailed route guidance and reservation information are displayed on the smartphone, and the autonomous vehicle safely guides the user to their destination.

[1629] An example prompt for a generative AI model is:

[1630] "What is the specification for an application that, after a user arrives in the center of a large city, recommends tourist spots and restaurants based on his interests and budget?"

[1631] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1632] System Configuration

[1633] To implement this invention, the following system configuration is required. The system is primarily comprised of interactions between the server, the terminal, and the user. In addition, the emotion engine has the function of recognizing the user's emotional state and adjusting the content of suggestions based on that. Since questions about each processing step will be asked later, we will now provide an overview of the processing steps and explain the overall system flow using concrete examples.

[1634] System Configuration and Functions

[1635] The system includes a traveler (user) device, a central server, a database and APIs that provide various travel-related services, and an emotion engine. The server stores user registration information and is responsible for real-time suggestions, reservations, and review collection. The emotion engine recognizes emotions from the user's facial expressions and voice and sends the data to the server.

[1636] Program processing overview

[1637] User Registration

[1638] The user installs the app on their device and launches it for the first time.

[1639] The device displays a form for the user to enter their interests and budget.

[1640] The user fills out the form with their interests, concerns, and budget and clicks the submit button.

[1641] The terminal sends the entered information to the server, which stores it in a database.

[1642] Arrival and check-in

[1643] When the user arrives at the location and presses the check-in button, the device obtains the user's current location information.

[1644] The device sends its current location information to the server, which then searches for information on nearby tourist attractions, restaurants, and souvenirs in real time.

[1645] Emotion Recognition and Real-Time Suggestions

[1646] The server generates a proposal list and sends it to the terminal.

[1647] The emotion engine analyzes the user's facial expressions and voice to recognize their emotional state.

[1648] The device also sends emotional data to the server, which then adjusts the suggestion list based on the user's emotional state.

[1649] Users can tap on an item of interest from the list of suggestions to view more information.

[1650] If the proposal is not satisfactory, a re-proposal request is sent to the server, which makes a new proposal.

[1651] Destination confirmation, navigation and reservations

[1652] Once the user selects a destination, the device sends that information to the server.

[1653] The server provides detailed route guidance, necessary ticket information, and store reservation procedures, and obtains coupon information from affiliated companies.

[1654] The server sends all this information to the terminal, which displays it to the user.

[1655] Review and earn points after your visit

[1656] Once users have completed their experience at a destination, they can post reviews and photos on their device.

[1657] The terminal sends the review information to the server, which stores it in a database.

[1658] The server awards points to the user and sends a point notification to the terminal.

[1659] Plan your next trip

[1660] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews.

[1661] The server sends the new proposal list to the terminal, which displays it to the user.

[1662] Specific examples

[1663] Example 1: Sightseeing in Tokyo

[1664] The user (Mr. Tanaka) launches the app and registers his interests as "history" and "food" and his budget as "5,000 yen a day."

[1665] Tanaka arrives at Tokyo Station and checks in.

[1666] The server generates a list of suggestions for historical buildings and restaurants around Tokyo Station and sends it to Tanaka's device.

[1667] The emotion engine analyzes Tanaka's facial expression and recognizes that she is relaxed.

[1668] Based on this emotional data, the server will include relaxing cafes and quiet tourist spots in its suggestion list.

[1669] Tanaka selects the suggested Sensoji Temple and a famous Japanese restaurant and checks the details.

[1670] The server provides route guidance and handles reservation procedures, and all information is displayed on Tanaka's device.

[1671] After visiting, Tanaka posts a review and photos and earns points.

[1672] In this way, the system allows travelers to be flexible in their travels and enjoy experiences tailored to their interests and emotional state in real time, while enabling travel companies to use detailed data to improve their marketing and services.

[1673] The processing flow will be explained below.

[1674] User Registration

[1675] Step 1:

[1676] The user installs the app on their device and launches it for the first time.

[1677] Step 2:

[1678] The device displays a form for the user to enter their interests and budget.

[1679] Step 3:

[1680] The user fills out the form with their interests, concerns, and budget and clicks the submit button.

[1681] Step 4:

[1682] The terminal transmits the input information to the server.

[1683] Step 5:

[1684] The server stores the received information in a database and sends a registration confirmation response to the terminal.

[1685] Step 6:

[1686] The device will display "Registration complete" to the user.

[1687] Arrival and check-in

[1688] Step 1:

[1689] The user arrives at the location and opens the app.

[1690] Step 2:

[1691] The device obtains GPS data and determines its current location.

[1692] Step 3:

[1693] The user clicks the check-in button.

[1694] Step 4:

[1695] The device sends its current location and user ID to the server.

[1696] Step 5:

[1697] The server searches for information on tourist spots, restaurants, and souvenirs around the current location and generates a list of suggestions.

[1698] Step 6:

[1699] The server sends the generated list to the terminal.

[1700] Step 7:

[1701] The device displays a list of suggestions to the user.

[1702] Emotion Recognition and Real-Time Suggestions

[1703] Step 1:

[1704] The emotion engine analyzes the user's facial expressions and voice to recognize their emotional state.

[1705] Step 2:

[1706] The device transmits the emotion data to the server.

[1707] Step 3:

[1708] The server adjusts the suggestion list based on the user's emotional state.

[1709] Step 4:

[1710] The user taps on an item of interest from the list of suggestions.

[1711] Step 5:

[1712] The device displays a detailed information screen for the selected item.

[1713] Step 6:

[1714] The user checks for more information.

[1715] Step 7:

[1716] If the user is not satisfied with the suggestion, he or she clicks the Re-suggest button.

[1717] Step 8:

[1718] The terminal sends a re-proposal request to the server.

[1719] Step 9:

[1720] The server generates a list of alternative suggestions and sends it to the terminal.

[1721] Step 10:

[1722] The device will display the new suggestions list to the user.

[1723] Destination confirmation, navigation and reservations

[1724] Step 1:

[1725] The user selects the proposal that satisfies them and confirms their destination.

[1726] Step 2:

[1727] The terminal transmits destination confirmation information to the server.

[1728] Step 3:

[1729] The server generates detailed route directions to the destination.

[1730] Step 4:

[1731] The server handles the necessary ticket information and restaurant reservation procedures.

[1732] Step 5:

[1733] The server acquires coupon information from the partner.

[1734] Step 6:

[1735] The server sends all the information to the terminal.

[1736] Step 7:

[1737] The device displays route guidance, ticket information, reservation confirmation, and coupon information to the user.

[1738] Review and earn points after your visit

[1739] Step 1:

[1740] The user opens the app after visiting a location.

[1741] Step 2:

[1742] The user is directed to the review submission screen.

[1743] Step 3:

[1744] The device will display a review input form.

[1745] Step 4:

[1746] The user enters a review and image and clicks the submit button.

[1747] Step 5:

[1748] The device sends the review and image data to the server.

[1749] Step 6:

[1750] The server stores the data in a database.

[1751] Step 7:

[1752] The server awards points to the user and sends a point notification to the terminal.

[1753] Step 8:

[1754] The terminal will display a message to the user saying that points have been added.

[1755] Plan your next trip

[1756] Step 1:

[1757] The user restarts the app the next time they travel.

[1758] Step 2:

[1759] The device sends the user ID to the server.

[1760] Step 3:

[1761] The server generates a new list of suggestions based on past travel data and reviews.

[1762] Step 4:

[1763] The server sends the new proposal list to the terminal.

[1764] Step 5:

[1765] The device displays a list of suggestions to the user.

[1766] Specific examples

[1767] Example 1: Sightseeing in Tokyo

[1768] Step 1:

[1769] The user (Mr. Tanaka) launches the app and registers his interests as "history" and "food" and his budget as "5,000 yen a day."

[1770] Step 2:

[1771] Tanaka arrives at Tokyo Station and checks in.

[1772] Step 3:

[1773] The server generates a list of suggestions for historical buildings and restaurants around Tokyo Station and sends it to Tanaka's device.

[1774] Step 4:

[1775] The emotion engine analyzes Tanaka's facial expression and recognizes that she is relaxed.

[1776] Step 5:

[1777] Based on this emotional data, the server will include relaxing cafes and quiet tourist spots in its suggestion list.

[1778] Step 6:

[1779] Tanaka selects the suggested Sensoji Temple and a famous Japanese restaurant and checks the details.

[1780] Step 7:

[1781] The server provides route guidance and handles reservation procedures, and all information is displayed on Tanaka's device.

[1782] Step 8:

[1783] After visiting, Tanaka posts a review and photos and earns points.

[1784] In this way, the system allows travelers to be flexible in their travels and enjoy experiences tailored to their interests and emotional state in real time, while enabling travel companies to use detailed data to improve their marketing and services.

[1785] Example 2

[1786] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1787] While traditional travel planning systems can register travelers' interests, preferences, and budgets, the proposed content often does not adapt to the traveler's real-time emotional state, resulting in low satisfaction. While they offer on-site check-in and sightseeing information, they are unable to respond appropriately when travelers need further suggestions. Furthermore, there are limitations to their ability to support multiple languages ​​and utilize detailed traveler data for marketing and service improvement, making it difficult for travel-related businesses to increase their customer attraction.

[1788] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1789] In this invention, the server includes: a means for registering a traveler's interests, preferences, and budget; a means for the traveler to check in at a destination; a means for suggesting tourist spots, restaurants, and souvenirs in real time based on the check-in information; a means for making re-suggestions if the suggestion results in low satisfaction; a means for recognizing the user's emotional state and adjusting the suggestion content based on the user's emotional state; a means for providing route guidance, ticket reservations, restaurant reservations, and partner coupon information once the destination is decided; a means for sharing reviews and images after the trip and earning points; a means for learning the traveler's behavioral history and reviews to suggest the next destination; and a means for transmitting and receiving data between the terminal and the server. This allows travelers to be flexible in their activities and receive optimal suggestions based on their real-time emotional state. Furthermore, re-suggestions are made even if the suggestion is dissatisfied, thereby improving traveler satisfaction. Furthermore, multilingual support and detailed traveler data can be used to increase the customer attraction and marketing capabilities of travel-related businesses.

[1790] "Means for registering traveler interests, preferences, and budget" refers to devices or functions that allow travelers to input and save their areas of interest, specific concerns, and the budget they intend to use for their trip.

[1791] "Means for travelers to check in at a destination" refers to the devices and functionality that allow travelers to confirm their arrival at a destination and register their arrival information in the system using a terminal or mobile application.

[1792] "Means for suggesting information on tourist attractions, restaurants, and souvenirs in real time based on check-in information" refers to devices and functions that use travelers' check-in information to search for information on local tourist attractions, restaurants, souvenir shops, etc. in real time and suggest it to travelers.

[1793] "Means for making a new proposal if the traveler is not satisfied with the proposal" refers to a device or function for generating a new proposal and presenting it to the traveler again if the initial proposal is not satisfactory to the traveler.

[1794] "Means for recognizing the user's emotional state and adjusting the content of suggestions based on that" refers to devices or functions that analyze the user's facial expressions and voice to recognize their emotional state, and change or adapt the content of suggestions in real time based on that data.

[1795] "Means of providing route guidance, ticket reservations, restaurant reservations, and partner coupon information once a destination has been decided" refers to devices and functions that, once a traveler has decided on a destination, provide guidance on how to get to that location, reserve necessary tickets, make reservations at restaurants, etc., and provide partner coupon information.

[1796] "Means for sharing reviews and images after a trip and earning points" refers to devices and functions that allow travelers to post reviews and images about their experiences at their travel destinations, and for the system to award points for those posts.

[1797] "Means of learning from travelers' behavioral history and reviews to suggest their next destination" refers to devices or functions that analyze travelers' past behavioral history and posted reviews and suggest their next travel plans based on that information.

[1798] "Means for transmitting and receiving data between a terminal and a server" refers to devices and functions for exchanging data bidirectionally between a user's terminal and a central server.

[1799] System Configuration and Hardware / Software Usage

[1800] This invention is a system that includes a traveler (user) terminal, a central server, and an emotion engine. This system includes a user interface for registering the user's interests and budget, a database and API for suggesting tourist destination information in real time, an emotion engine that recognizes the user's emotional state, and a communication module for bidirectional data exchange. Specific implementation methods for each element are described below.

[1801] User Registration

[1802] A user installs and launches a travel application. On first launch, the device displays a form for the traveler to enter their interests, preferences, and budget. The information entered by the user is sent from the device to a server, which stores it in a database (e.g., MySQL).

[1803] Arrival and check-in

[1804] When the user arrives at a destination, they press the check-in button. The device uses GPS (e.g., Google Maps API) to obtain their current location and sends that information to the server. Based on the current location, the server obtains real-time information about tourist spots, restaurants, etc. from an API (e.g., Google Places API) and sends it to the device as a list of suggestions.

[1805] Emotion Recognition and Real-Time Suggestions

[1806] The server generates a list of suggestions and sends it to the device. An emotion engine (e.g., OpenCV, TensorFlow) analyzes the user's facial expressions and voice to recognize their emotional state. The device sends the emotion data to the server, which then adjusts the suggestions based on that data. For example, if the user is in a relaxed state, quiet tourist spots and cafes will be added to the suggestion list.

[1807] Destination confirmation, navigation and reservations

[1808] Once the user selects their destination, that information is sent from the device to the server, which then uses the Google Maps API and other tools to provide detailed route guidance, book tickets, and make store reservations, and obtain coupon information from partner companies and send it to the device.

[1809] Review and earn points after your visit

[1810] When a user finishes their experience at a destination, they post their review and photos from their device to the server. The server stores these in a database and awards points to the user. The device then displays a notification to the user that they have received points.

[1811] Plan your next trip

[1812] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews, and sends the list to the device, which then displays it to the user.

[1813] Specific examples

[1814] Example 1: Sightseeing in Tokyo

[1815] 1. The user launches the application and registers "History," "Gourmet," and a budget of "5,000 yen per day." The device sends this information to the server, which then stores it in a database.

[1816] 2. When a user arrives at Tokyo Station, they press the check-in button. The device retrieves their current location from GPS and sends it to the server. The server then uses the Google Places API to retrieve information about tourist spots and restaurants and generates a list of suggestions.

[1817] 3. The emotion engine analyzes the user's facial expressions and voice and recognizes that they are in a relaxed state. The device sends the emotion data to the server, which then adds relaxing cafes and quiet tourist spots to a list of suggestions.

[1818] 4. For example, a user selects Sensoji Temple and a famous Japanese restaurant and checks the details. The server uses the Google Maps API to provide route guidance and make reservations, and sends the information to the device.

[1819] 5. After your visit, launch the app and post a review and photos. The device sends this information to the server, which stores it in a database and awards points.

[1820] The system allows travelers to be flexible on-site and receive optimal recommendations based on their real-time emotional state, while also enabling travel-related businesses to improve their customer attraction and marketing.

[1821] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1822] Step 1:

[1823] The user installs the travel app and launches it for the first time.

[1824] When the device is first started, it displays a form for travelers to enter their interests, preferences, and budget.

[1825] The user fills in the form and clicks the submit button.

[1826] The input here is text data such as interests, concerns, budget, etc.

[1827] The device sends the entered information to the server, which receives the data and stores it in a database such as MySQL.

[1828] During this process, user profile information such as interests, preferences, and budget are registered in a database.

[1829] Step 2:

[1830] The user arrives at the location and presses the check-in button within the app.

[1831] The input here is check-in operation and GPS information.

[1832] The device uses the GPS function to obtain current location information and sends that information to the server.

[1833] The server receives the current location information and searches for nearby tourist spots, restaurants, and souvenir information using the Google Places API, etc. The search results data is aggregated on the server.

[1834] The server generates data as a proposal list and transmits it to the terminal.

[1835] In this step, tourist spots and restaurant information are suggested to the user in real time based on the check-in information.

[1836] Step 3:

[1837] The server sends the generated proposal list to the terminal.

[1838] The input here is the data for the suggestion list.

[1839] The emotion engine collects the user's facial expressions and voice through the camera and microphone and converts them into emotion data. The emotion engine uses OpenCV and TensorFlow to analyze the user's emotional state.

[1840] Output data from the emotion engine is sent to the terminal.

[1841] The device receives the emotion data and transmits it to the server.

[1842] The server adjusts the suggestion list based on the user's emotional data. If a new suggestion is needed, it generates a new suggestion and sends it to the device as data.

[1843] In this step, the suggestions are adjusted based on the results of emotion recognition.

[1844] Step 4:

[1845] Users can select the offers that interest them and view more information in the app.

[1846] The input here is the information of the selected proposal.

[1847] The terminal transmits the selected information to the server.

[1848] The server retrieves the necessary details from the Google Maps API, etc., and then coordinates and retrieves route guidance, ticket reservations, store reservations, and coupon information.

[1849] The server transmits this data to the terminal.

[1850] This step provides specific actionable guidance based on the plan the user has chosen.

[1851] Step 5:

[1852] After users arrive at their destination and complete their experience, they post reviews and photos on the app.

[1853] The input here is the text data and image data of the review.

[1854] The terminal transmits the posted review information to the server.

[1855] The server registers the review information and image data in a database.

[1856] Once registration is complete, the server will grant points to the user and send a notification of point acquisition to the terminal.

[1857] In this step, the user's experience review is saved in the database and points are awarded.

[1858] Step 6:

[1859] The user launches the app again to plan their next trip.

[1860] The server retrieves past behavioral history and reviews from the database and generates a new list of suggestions.

[1861] The server sends the proposal list to the terminal.

[1862] The device will present the new list of suggestions to the user.

[1863] In this step, new travel plans are suggested based on past data.

[1864] (Application example 2)

[1865] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1866] Modern travelers often want to receive specific information and suggestions based on their interests, preferences, and budget in real time while visiting their destination. However, current systems are unable to provide suggestions that take into account the traveler's emotional state, which can lead to low traveler satisfaction. Additionally, changing plans or making new suggestions while visiting a destination can be time-consuming, resulting in inflexible travel planning. Furthermore, reviews and point systems are not being fully utilized, which presents an issue of not being able to fully utilize the information when planning their next trip.

[1867] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for registering the traveler's interests, concerns, and budget; means for the traveler to check in at a destination; means for suggesting tourist spots, restaurants, and souvenirs in real time based on the check-in information; means for making re-suggestions if the suggestion is unsatisfactory; means for providing route guidance, ticket reservations, restaurant reservations, and partner coupon information once the destination is decided; means for sharing reviews and images after the trip and earning points; means for recognizing the traveler's emotional state from facial expressions or voice and adjusting the suggestion content based on that emotional state; and means for learning the traveler's behavior history and reviews to suggest the next destination. This allows travelers to flexibly plan their activities on site and receive suggestions tailored to their emotional state. Furthermore, utilizing reviews and point systems can further enhance their next travel plans.

[1868] "Tourist" refers to an individual or group traveling with the intention of visiting a place.

[1869] "Interests" refer to the themes or activities that a traveler is particularly interested in.

[1870] "Interest" refers to the things that tourists pay particular attention to or information that attracts their attention.

[1871] "Budget" refers to the range of amounts a traveler is willing to spend on a travel activity.

[1872] "Checking in" is the act of a traveler registering their presence at a destination in the system upon arrival.

[1873] "Real-time" refers to data being updated and processed almost instantly.

[1874] "Tourist destination" means a historical, cultural or natural attraction that is intended for visits by tourists.

[1875] "Restaurant" means an establishment that serves food and beverages.

[1876] "Souvenir information" refers to information about souvenirs and local specialties that can be purchased at the destination.

[1877] "Recommendation" means the act of providing a traveler with recommendations for places to visit, activities, or services.

[1878] "Route guidance" is information that shows the optimal route to reach a destination.

[1879] "Ticket reservation" refers to the process of securing admission tickets to a facility or event in advance.

[1880] "Emotional state" refers to the traveler's current psychological and emotional state.

[1881] "Facial expressions" refers to visual expressions used to read a traveler's emotions.

[1882] "Voice" refers to vocal expressions used to read the traveler's emotions.

[1883] A "review" is when a traveler shares their rating or opinion about a destination or service.

[1884] "Points" refers to points in a reward system awarded for reviews and actions.

[1885] "Behavioral history" refers to a record of a traveler's past activities and visits.

[1886] "Partners" refers to businesses and service providers that are affiliated with the system.

[1887] System Configuration

[1888] To implement this invention, the following system configuration is required: The system is composed of a traveler's terminal, a central server, a database, an API that provides various travel-related services, and an emotion engine.

[1889] Program processing overview

[1890] The main operations of the system are as follows.

[1891] Hardware and Software

[1892] Server: A central computer for processing large amounts of data and making real-time recommendations.

[1893] Device: A user's mobile device, such as a smartphone or tablet.

[1894] Emotion Engine: Dedicated software to analyze the user's facial expressions and voice to detect their emotional state.

[1895] GPS module: A location information acquisition device installed on a terminal.

[1896] Network: A communications infrastructure that connects various devices and transmits and receives data.

[1897] Data Processing

[1898] User registration: The device sends the user's entered interests, preferences, and budget information to the server, which stores the information in a database.

[1899] Emotion Recognition: The emotion engine uses the device's camera and microphone to analyze the user's facial expressions and voice, and sends the results to the server.

[1900] Suggestion generation: Based on the user's location information and emotional state, the server searches the database for relevant tourist spots, restaurants, and souvenir information in real time and generates a suggestion list.

[1901] Re-proposal: If the user is not satisfied with the proposal, the device sends a re-proposal request to the server, and the server generates a new proposal list and sends it to the device.

[1902] Navigation and reservations: Once the user selects a destination, the server provides route guidance, ticket reservations, and store reservations information and sends this information to the device.

[1903] Reviews and point awarding: When a user writes a review after a visit, the device sends the information to the server, which stores it in a database and awards points.

[1904] Specific examples

[1905] User registration: When a "user" launches the app for the first time, they register their interests as "history" and "food" and their budget as "5,000 yen per day."

[1906] Emotion recognition: The "emotion engine" analyzes the "user's" facial expressions and recognizes that they are relaxed.

[1907] Suggestion generation: The "server" searches for tourist attractions and restaurants around Tokyo Station in real time and generates a list of suggestions including relaxing cafes and quiet tourist spots.

[1908] Navigation and Reservations: Once the "user" selects Sensoji Temple, the "server" sends route directions to the device and makes any necessary ticket reservations.

[1909] Prompt Sentence Examples

[1910] "Name is Tanaka, interests are history and food, budget is 5000 yen, emotional state is relaxed."

[1911] The system allows travelers to plan their activities more flexibly while on-site, provides suggestions based on their emotional state, and provides a more satisfying travel experience. It also allows travelers to make more fulfilling plans for their next trip by utilizing reviews and a points system.

[1912] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1913] Step 1: User Registration

[1914] When a user installs and launches the app for the first time, the device displays a form asking the user to enter their interests, preferences, and budget. After the user enters the information and clicks the submit button, the device sends this information to the server, which receives it and stores it in a database.

[1915] Input: User interests, concerns, budget

[1916] Data processing: Send input information to the server and save it

[1917] Output: The information is saved to the database

[1918] Step 2: Arrival and check-in

[1919] When the user arrives at their destination, they press the check-in button. The device uses a GPS module to obtain their current location and sends that information to the server. The server then uses that location information to search for nearby tourist attractions, restaurants, and souvenir information.

[1920] Input: User's current location

[1921] Data processing: Search for information based on current location information

[1922] Output: Generate a list of suggestions

[1923] Step 3: Emotion Recognition

[1924] The emotion engine uses the device's camera and microphone to analyze the user's facial expressions and voice, and sends the results to the server, which receives the user's emotional state and adjusts the suggestions it makes to the user.

[1925] Input: User's facial expressions and voice

[1926] Data processing: Emotional state analysis and proposal adjustment

[1927] Output: A list of suggestions based on emotional state

[1928] Step 4: Propose and Re-Propose

[1929] The server generates a list of suggestions, such as tourist spots, restaurants, and souvenirs, based on the user's current location and emotional state, and sends it to the device. If the user is not satisfied with the items in the suggestion list, a re-suggestion request is sent from the device to the server. The server then generates a new suggestion list and sends it again to the device.

[1930] Input: current location, emotional state, re-suggestion request

[1931] Data processing: Proposal list generation and refinement

[1932] Output: Refined proposal list

[1933] Step 5: Confirm destination, navigate and make reservations

[1934] The user selects a destination they wish to visit from the list of suggestions. The device sends this information to the server. The server then provides detailed route guidance, book tickets, and store reservations, and obtains coupon information from partner companies, and sends all of this information to the device. The device then displays this to the user.

[1935] Input: User's destination selection information

[1936] Data processing: route guidance and reservation procedures

[1937] Output: Route guidance, ticket information, coupon information

[1938] Step 6: Review after visit and earn points

[1939] After a user has completed their experience at a destination, they can post reviews and photos on their device. Once the user has entered and submitted their review, the device sends this information to the server, which then stores the review information in a database and awards points to the user.

[1940] Input: Review information, image

[1941] Data processing: Saving review information and awarding points

[1942] Output: Saved review information, awarded points

[1943] Step 7: Plan your next trip

[1944] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews, and sends the list to the device, which then displays it to the user.

[1945] Input: User behavior history, review information

[1946] Data processing: Generate a proposal list based on past data

[1947] Output: Suggestion list

[1948] In this way, users can flexibly plan their activities while on-site, receive suggestions based on their emotional state, and utilize reviews and a points system to enhance their next travel plans.

[1949] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1950] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1951] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1952] [Fourth embodiment]

[1953] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1954] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1955] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1956] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1957] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1958] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1959] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1960] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1961] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1962] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1963] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1964] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1965] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1966] To implement this invention, the following system configuration and program processing are required. The system is primarily comprised of interactions between three parties: a server, a terminal, and a user. Because questions about each processing step will be asked later, we will not go into detail about the processing steps here, but will explain the overall flow and provide specific examples.

[1967] System Configuration

[1968] The system includes a traveler (user) device, a central server, and a database and APIs that provide various travel-related services. The server stores user registration information and handles real-time suggestions, reservations, and review collection. The device provides an interface for users to plan trips and accept suggestions through the app.

[1969] Program processing overview

[1970] User Registration

[1971] Users launch the app on their device and enter their interests and budget.

[1972] The terminal sends this information to the server, which stores it in a database.

[1973] Arrival and check-in

[1974] When the user arrives at the location and presses the check-in button, the device obtains the user's current location information.

[1975] The device sends its current location information to the server, which then searches for information on nearby tourist attractions, restaurants, and souvenirs in real time.

[1976] Real-time suggestions

[1977] The server generates a list of suggestions based on the user's current location and registered information (interests, concerns, budget) and sends it to the device.

[1978] The user can review the list of suggestions on their device and make a selection.

[1979] If the proposal is not satisfactory, a re-proposal request is sent to the server, which makes a new proposal.

[1980] Destination confirmation, navigation and reservations

[1981] Once the user selects a destination, the device sends that information to the server.

[1982] The server provides detailed route guidance, necessary ticket information, and store reservation procedures, and obtains coupon information from affiliated companies.

[1983] The server sends all this information to the terminal, which displays it to the user.

[1984] Review and earn points after your visit

[1985] Once users have completed their experience at a destination, they can post reviews and photos on their device.

[1986] The terminal sends the review information to the server, which stores it in a database.

[1987] The server awards points to the user and sends a point notification to the terminal.

[1988] Plan your next trip

[1989] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews.

[1990] The server sends the new proposal list to the terminal, which displays it to the user.

[1991] Specific examples

[1992] Example 1: Sightseeing in Tokyo

[1993] The user (Mr. Tanaka) launches the app and registers his interests as "history" and "food" and his budget as "5,000 yen a day."

[1994] Tanaka arrives at Tokyo Station and checks in.

[1995] The server generates a list of suggestions for historical buildings and restaurants around Tokyo Station and sends it to Tanaka's device.

[1996] Tanaka selects the suggested Sensoji Temple and a famous udon restaurant and checks the details.

[1997] The server provides route guidance and handles reservation procedures, and all information is displayed on Tanaka's device.

[1998] After visiting, Tanaka posts a review and photos and earns points.

[1999] In this way, the system gives travelers flexibility in their travels and allows them to enjoy experiences that are tailored to their interests in real time, while enabling travel companies to use detailed data to improve their marketing and services.

[2000] The processing flow will be explained below.

[2001] User Registration

[2002] Step 1:

[2003] The user installs the app on their device and launches it for the first time.

[2004] Step 2:

[2005] The device displays a form for the user to enter their interests and budget.

[2006] Step 3:

[2007] The user fills out the form with their interests, concerns, and budget and clicks the submit button.

[2008] Step 4:

[2009] The terminal transmits the input information to the server.

[2010] Step 5:

[2011] The server stores the received information in a database and sends a registration confirmation response to the terminal.

[2012] Step 6:

[2013] The device will display "Registration complete" to the user.

[2014] Arrival and check-in

[2015] Step 1:

[2016] The user arrives at the location and opens the app.

[2017] Step 2:

[2018] The device obtains GPS data and determines its current location.

[2019] Step 3:

[2020] The user clicks the check-in button.

[2021] Step 4:

[2022] The device sends its current location and user ID to the server.

[2023] Step 5:

[2024] The server searches for information on tourist spots, restaurants, and souvenirs around the current location and generates a list of suggestions.

[2025] Step 6:

[2026] The server sends the generated list to the terminal.

[2027] Step 7:

[2028] The device displays a list of suggestions to the user.

[2029] Real-time suggestions

[2030] Step 1:

[2031] The user taps on an item of interest from the list of suggestions.

[2032] Step 2:

[2033] The device displays a detailed information screen for the selected item.

[2034] Step 3:

[2035] The user checks for more information.

[2036] Step 4:

[2037] If the user is not satisfied with the suggestion, he or she clicks the Re-suggest button.

[2038] Step 5:

[2039] The terminal sends a re-proposal request to the server.

[2040] Step 6:

[2041] The server generates a list of alternative suggestions and sends it to the terminal.

[2042] Step 7:

[2043] The device will display the new suggestions list to the user.

[2044] Destination confirmation, navigation and reservations

[2045] Step 1:

[2046] The user selects the proposal that satisfies them and confirms their destination.

[2047] Step 2:

[2048] The terminal transmits destination confirmation information to the server.

[2049] Step 3:

[2050] The server generates detailed route directions to the destination.

[2051] Step 4:

[2052] The server handles the necessary ticket information and restaurant reservation procedures.

[2053] Step 5:

[2054] The server acquires coupon information from the partner.

[2055] Step 6:

[2056] The server sends all the information to the terminal.

[2057] Step 7:

[2058] The device displays route guidance, ticket information, reservation confirmation, and coupon information to the user.

[2059] Review and earn points after your visit

[2060] Step 1:

[2061] The user opens the app after visiting a location.

[2062] Step 2:

[2063] The user is directed to the review submission screen.

[2064] Step 3:

[2065] The device will display a review input form.

[2066] Step 4:

[2067] The user enters a review and image and clicks the submit button.

[2068] Step 5:

[2069] The device sends the review and image data to the server.

[2070] Step 6:

[2071] The server stores the data in a database.

[2072] Step 7:

[2073] The server awards points to the user and sends a point notification to the terminal.

[2074] Step 8:

[2075] The terminal will display a message to the user saying that points have been added.

[2076] Plan your next trip

[2077] Step 1:

[2078] The user restarts the app the next time they travel.

[2079] Step 2:

[2080] The device sends the user ID to the server.

[2081] Step 3:

[2082] The server generates a new list of suggestions based on past travel data and reviews.

[2083] Step 4:

[2084] The server sends the new proposal list to the terminal.

[2085] Step 5:

[2086] The device displays a list of suggestions to the user.

[2087] Through these detailed processing steps, the system provides travelers with real-time personalized information to optimize their travel experience, while enabling travel-related companies to improve their services by providing detailed data analysis.

[2088] Example 1

[2089] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2090] Today's travelers are required to plan trips that meet their diverse needs and interests. However, existing travel support systems face challenges in that they are unable to respond flexibly in real time or provide optimal suggestions for individual travelers. In particular, there is a demand for technology that can efficiently and centrally handle a series of processes, including on-site information gathering, updating of suggestions, reservation procedures, and point awarding.

[2091] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2092] In this invention, the server includes means for registering a traveler's interests, concerns, and budget, means for the traveler to check in at a destination, means for suggesting tourist spots, restaurants, and souvenir information in real time based on check-in information, means for making re-suggestions if satisfaction with the suggestions is low, means for providing route guidance, ticket reservations, store reservations, and affiliated coupon information when the destination is decided, means for sharing reviews and images after the trip and earning points, means for learning the traveler's behavioral history and reviews to suggest the next destination, means for generating a suggestion list based on the traveler's current location and registration information using a generative AI model, means for sending the suggestion list to a terminal and making new suggestions based on a re-suggestion request, means for saving review information after the visit in a database and awarding points, means for obtaining surrounding information in real time using an affiliated tourist information providing API, means for the terminal to obtain current location information using GPS, and means for providing detailed route guidance, ticket information, and store reservation procedures using an external API.

[2093] This will enable us to respond to the diverse needs of travelers, provide optimal travel plans for each individual traveler in real time, and ensure an efficient travel experience.

[2094] "Tourist" refers to an individual or group traveling for the purpose of travel.

[2095] "Interest" refers to a traveler's interest or motivation in a particular topic or activity.

[2096] "Interests" refers to the interest a traveler has in a particular place, culture, activity, etc.

[2097] "Budget" refers to the amount of money a traveler can spend on a trip.

[2098] "Terminal" refers to an electronic device used by a user, such as a smartphone or tablet.

[2099] A "server" refers to a computer system that communicates with terminals via a network and processes and stores data.

[2100] A "database" refers to a system that stores information in an organized manner and enables it to be searched and manipulated.

[2101] "GPS" refers to the Global Positioning System, a system for determining locations on Earth.

[2102] "Check-in" refers to the act of a traveler reporting their arrival at a particular location via a terminal.

[2103] "Suggestion list" refers to a list of recommended tourist spots, restaurants, etc. generated by the server based on the traveler's interests, preferences, budget, and current location information.

[2104] "Re-proposal" refers to the process of making a new proposal if the initial proposal is dissatisfied.

[2105] "Destination" refers to the place a traveler chooses to visit.

[2106] "Route guidance" refers to guidance information that provides travelers with the optimal route to reach their destination.

[2107] "Ticket reservation" refers to the process of securing tickets in advance for transportation, events, etc.

[2108] "Coupon Information" refers to information regarding discounts and benefits offered by our partners.

[2109] A "review" refers to a traveler's act of writing an evaluation or opinion about their experience at a destination.

[2110] "Points" refers to rewards travelers earn through reviews and other activities.

[2111] "Behavioral history" refers to a record of a traveler's past trips and places visited.

[2112] A "generative AI model" refers to an algorithmic model that uses machine learning to make optimal suggestions and predictions from data.

[2113] "API" refers to an application programming interface that enables communication with other software systems.

[2114] To implement this invention, a system configuration is required that includes a traveler (user) terminal, a central server, and a database and APIs that provide various travel-related services. The system is primarily comprised of interactions between the server, terminal, and user.

[2115] System Configuration

[2116] The system consists of a user's device (such as a smartphone or tablet), a central server, and partnered external tourism information APIs (e.g., Google Places API and Google Maps API). The server stores user registration information and provides real-time suggestions, reservations, and reviews. The device provides an interface for users to accept travel plans and suggestions through the app.

[2117] Program processing overview

[2118] The program works as follows:

[2119] 1. User Registration

[2120] The user launches the app and enters their interests and budget, and the device sends this information to the server.

[2121] The server stores the received information in a database.

[2122] Examples:

[2123] A user registers their interests as "history" and "food" and a budget of "5,000 yen per day."

[2124] Example prompt: "What are your hobbies at your travel destination? For example, history, food, shopping, etc."

[2125] 2. Arrival and check-in

[2126] When the user arrives at the location and presses the check-in button, the device uses GPS to obtain their current location information.

[2127] The device sends its current location information to the server, and the server then calls an affiliated tourist information provider API to obtain information about the surrounding area.

[2128] Examples:

[2129] The user arrives at Tokyo Station and checks in.

[2130] Example prompt: "Send me tourist information about my current location. Generate a list of nearby attractions."

[2131] 3. Real-time suggestions

[2132] The server uses a generative AI model based on the user's current location and registration information to generate a list of suggestions and sends it to the device.

[2133] The user can view and select from a list of suggestions on their device. If they are not satisfied with the suggestions, a re-suggestion request is sent to the server, and a new suggestion is made.

[2134] Examples:

[2135] Users can select Sensoji Temple or a famous udon restaurant and check detailed information.

[2136] Example prompt: "Create a new list of suggestions based on the user's interests and location."

[2137] 4. Destination confirmation, navigation and reservations

[2138] Once the user selects their destination, the device sends that information to the server, which then provides detailed route guidance, necessary ticket information, store reservations, and obtains coupon information from affiliated companies.

[2139] All this information is sent to the terminal and displayed to the user.

[2140] Examples:

[2141] The server provides route guidance and handles reservation procedures, and all information is displayed on the user's device.

[2142] Example prompt: "Suggest route directions, ticket information, and booking procedures."

[2143] 5. Review after your visit and earn points

[2144] After the user has finished their experience at a destination, they can post a review and photos on their device, which then sends the review information to the server, which then stores it in a database.

[2145] The server awards points and sends a point notification to the terminal.

[2146] Examples:

[2147] Users post reviews and photos and earn points.

[2148] Example prompt: "Receive user ratings and photo submissions and generate point award notifications."

[2149] 6. Planning your next trip

[2150] The next time the user launches the app, the server generates a new list of suggestions based on past behavioral history and reviews and sends it to the device.

[2151] The device displays a list of suggestions to the user.

[2152] Examples:

[2153] The server analyzes past behavioral history and reviews to create a new list of suggestions.

[2154] Example prompt: "Create a new list of suggestions based on your past behavioral history and reviews."

[2155] The system allows users to enjoy flexible travel plans tailored to their interests in real time, while travel-related companies can use the detailed data to improve their marketing and services.

[2156] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2157] Program processing flow

[2158] Step 1: User Registration

[2159] The user launches the app.

[2160] The user inputs their interests and budget. The input data is interests (e.g., "history," "food"), interests (e.g., "activity," "shopping"), and budget (e.g., "5,000 yen per day").

[2161] The terminal converts the input data into JSON format and sends it to the server.

[2162] The server stores the received information in a database, using a database such as MySQL, and performs transaction processing to maintain data consistency.

[2163] Input: User interests, preferences, and budget data

[2164] Data processing: Convert to JSON format

[2165] Output: User data sent to the server

[2166] Step 2: Arrival and check-in

[2167] The user arrives at the location and presses the check-in button on the app.

[2168] The device uses GPS to obtain the current location information.

[2169] The device converts the current location information into JSON format and sends it to the server.

[2170] The server calls an affiliated tourist information provider API (e.g., Google Places API) based on the current location information, formats the data obtained from the API, and saves it.

[2171] Input: Current location information (GPS data)

[2172] Data processing: Convert to JSON format, call tourist information API

[2173] Output: Current location data and tourist information sent to the server

[2174] Step 3: Real-time proposals

[2175] The server uses a generative AI model to generate a list of suggestions based on the user's current location and registration information.

[2176] The generative AI model takes inputs such as interests, preferences, budget, and current location, and suggests travel plans suitable for the user in real time.

[2177] The server converts the generated proposal list into JSON format and sends it to the device.

[2178] The device displays a list of suggestions to the user.

[2179] Input: User location, interests, preferences, and budget data

[2180] Data processing: Generate a proposal list using a generative AI model and convert it into JSON format

[2181] Output: Suggestion list

[2182] Step 4: Confirm destination, navigate and book

[2183] The user selects a destination from a list of suggestions.

[2184] The terminal converts the selected data into JSON format and sends it to the server.

[2185] Based on the selection information, the server calls an external API (e.g., Google Maps API, API for a reservation site) to provide route guidance, ticket information, and store reservation procedures.

[2186] The server acquires coupon information from the partner.

[2187] The server converts this information into JSON format and sends it to the terminal.

[2188] The device displays the information it receives to the user.

[2189] Input: Destination selection information

[2190] Data processing: Convert to JSON format, call external API, get coupon information

[2191] Output: Route directions, ticket information, reservation information

[2192] Step 5: Review after your visit and earn points

[2193] After visiting, users post reviews and photos within the app.

[2194] The device converts reviews and images into JSON format and sends them to the server.

[2195] The server stores the review information in a database, where it is analyzed by a rating algorithm.

[2196] The server awards points, converts the point notification into JSON format, and sends it to the terminal.

[2197] The terminal displays a point award notification to the user.

[2198] Input: Review information and images

[2199] Data processing: Convert to JSON format and analyze using evaluation algorithms

[2200] Output: Save to database, point allocation notification

[2201] Step 6: Plan your next trip

[2202] The next time the user launches the app.

[2203] The server uses a generative AI model to create a new list of suggestions based on past behavioral history and reviews.

[2204] The server converts the generated new proposal list into JSON format and sends it to the device.

[2205] The device displays a list of suggestions to the user.

[2206] Input: Past activity history and reviews

[2207] Data processing: Generate a new proposal list using a generative AI model and convert it into JSON format

[2208] Output: New proposal list

[2209] In this way, detailed data processing and calculations are carried out at each step, and the system provides optimal travel plans in real time. This process allows users to plan their trips flexibly, and travel-related companies can make more efficient marketing efforts.

[2210] (Application example 1)

[2211] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2212] Conventional travel support systems suggest tourist spots and restaurants based on travelers' interests and budgets, but provide transportation options individually and lack a centralized means for managing real-time suggestions and reservation procedures. As a result, travelers often spend time and effort traveling to their destinations and completing various reservation procedures. To achieve greater efficiency and improve user experience, a system is needed that can summon an autonomous vehicle based on the traveler's current location and provide real-time suggestions for tourist spots and restaurants, route guidance, and reservation procedures in an integrated manner.

[2213] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2214] In this invention, the server includes means for registering a traveler's interests, preferences, and budget, means for the traveler to check in at a destination, means for suggesting tourist spots, restaurants, and souvenirs in real time based on the check-in information, means for making re-suggestions if the suggestion is not satisfactory, means for providing route guidance, ticket reservations, restaurant reservations, and partner coupon information when the destination is decided, means for sharing reviews and images after the trip and earning points, means for learning the traveler's behavioral history and reviews to suggest the next destination, means for calling an autonomous vehicle and guiding it to the destination based on the traveler's current location information, and means for linking with the autonomous vehicle to suggest tourist spots and restaurants, provide route guidance, and make reservations in real time. This enables travelers to manage transportation, tourist information, and reservation procedures in an integrated manner within a single system.

[2215] "Tourist" refers to a person who visits a tourist spot or destination.

[2216] "Interest" refers to a traveler's interest in a particular activity or place.

[2217] "Interest" refers to a focus on specific genres or themes that interest travelers.

[2218] "Budget" refers to the amount of money a traveler decides to spend on their trip.

[2219] "Location Information" refers to a traveler's real-time geographic location obtained through GPS or location-based services.

[2220] "Check-in" refers to the act of a traveler notifying the system that they have arrived at a particular location.

[2221] "Real-time suggestions" refers to providing instant information about tourist spots and restaurants based on the traveler's current location and registration information.

[2222] "Re-proposal" refers to making a new proposal if the traveler is not satisfied with the initial proposal.

[2223] A "destination" refers to a specific place or facility that a traveler ultimately wants to reach.

[2224] "Route Guidance" refers to providing detailed directions for a traveler to travel from their current location to their destination.

[2225] "Ticket reservation" refers to the process of reserving tickets for transportation or tourist attractions in advance.

[2226] "Restaurant reservations" refers to the process of making advance reservations for restaurants, shops, and other establishments.

[2227] "Coupon information from affiliated stores" refers to discount and special offer information provided by affiliated stores and facilities.

[2228] A "review" refers to a traveler's evaluation or impressions of the places or facilities they visited after their trip.

[2229] "Points" refers to rewards given to travelers for actions such as writing reviews and sharing photos after a trip.

[2230] "Behavioral history" refers to records of places a traveler has visited and services they have used in the past.

[2231] An "autonomous vehicle" is a vehicle that has the ability to travel automatically to a destination without a human driver.

[2232] "Navigation" refers to providing guidance on the route to a destination.

[2233] "Real-time" refers to the instantaneous provision of information and services.

[2234] The system includes a traveler (user) device, a central server, and a database and API that provide various travel-related services. The server stores user registration information, makes real-time suggestions, and collects reviews. The device provides an interface for users to plan trips and accept suggestions through the app.

[2235] First, users launch the app on their device and enter their interests and budget. This information is sent from the device to the server, which stores it in a database. When the user arrives at a destination and presses the check-in button, the device acquires their current location information and sends it to the server. The server receives this information and makes real-time recommendations about tourist spots, restaurants, and souvenirs based on the user's current location and registered information.

[2236] The server also has the ability to make a second suggestion if the user is not satisfied with the suggestion. When the user selects a suggestion that satisfies them, the destination is determined and the device sends this information to the server. The server then provides detailed route guidance, necessary ticket information, and store reservation procedures, and also obtains coupon information from affiliated companies. This information is then sent to the device and displayed to the user.

[2237] When using an autonomous vehicle, the system will call the vehicle based on the user's current location and guide them to their destination. The autonomous vehicle will then integrate and manage real-time suggestions for tourist spots and restaurants, route guidance, and reservation procedures.

[2238] After a trip, users can share reviews and photos on their devices and send them to the server. The server stores this information in a database and awards points to the user. The server also learns from the user's behavioral history and reviews, and generates a new list of recommendations for the next trip.

[2239] The main hardware used is a smartphone, and the software is an HTTP request library (requests) that handles communication between the user device and the server. User input and location information are sent to the server, which then retrieves data from multiple APIs and makes suggestions tailored to the user's interests and budget.

[2240] As a concrete example, suppose a user starts the app, registers their interest in "history" and "food," and sets their travel budget to "5,000 yen." If the user arrives at the center of a large city as their destination, the server will suggest nearby historical buildings and famous restaurants. If the user selects a historical building and a well-known restaurant in Asakusa, detailed route guidance and reservation information will be displayed on the smartphone. Then, the autonomous vehicle will safely guide the user to their destination.

[2241] An example prompt for a generative AI model is:

[2242] "What is the specification for an application that, after a user arrives in the center of a large city, recommends tourist spots and restaurants based on his interests and budget?"

[2243] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2244] Step 1:

[2245] User Registration

[2246] The user launches the application on their smartphone and enters their interests and budget. This inputs the user's personal information and travel preferences into the application. The device then sends this information to the server, which stores it in a database. The output is that the user's information is recorded in a database stored on the server.

[2247] Step 2:

[2248] Arrival and check-in

[2249] When the user arrives at their destination, they press the check-in button on the device. The device uses GPS to obtain the user's current location and sends that location data to the server. The server uses the user's current location information as input, and records the current location information in real time on the server side as output.

[2250] Step 3:

[2251] Real-time suggestions

[2252] The server generates a list of recommendations for tourist spots, restaurants, and souvenirs based on the user's current location and pre-registered interests and budget. The server then calls the relevant APIs to retrieve the necessary data and filters the information that matches the user's criteria. The output is a recommendation list that is sent to the user's device.

[2253] Step 4:

[2254] Re-proposal

[2255] If the user is not satisfied with the proposal list, they request a re-proposal. The device sends this request to the server, and the server generates a new proposal list and sends it back to the user device. The input is the user's re-proposal request, and the output is the new proposal list.

[2256] Step 5:

[2257] Destination confirmation, navigation and reservations

[2258] When a user selects a destination from the list of suggestions, the device sends the selection information to the server, which then generates detailed route guidance and uses partner APIs to handle ticket information and reservation procedures. The output is obtained by sending route guidance, ticket information, and store reservation information to the user's device.

[2259] Step 6:

[2260] Autonomous vehicle collaboration

[2261] Based on the user's current location information, an autonomous vehicle is called and navigation to the destination is provided. The device sends the current location information to the server, and the server calls the autonomous vehicle's API to dispatch a vehicle and send navigation information to the user's device. The input is the user's current location information, and the output is vehicle dispatch and navigation information.

[2262] Step 7:

[2263] Post-trip reviews and points

[2264] Users review their experiences at the places they visit and upload images. The device sends this information to the server, which stores it in a database. The server then awards points to the user and sends a notification to the device. The input is the review information and images, and the output is the saved database and a notification that points have been awarded.

[2265] Step 8:

[2266] Plan your next trip

[2267] The next time the user launches the app, the server generates a new list of suggestions based on their past travel history and reviews, providing them with an up-to-date travel plan tailored to their preferences. The input is their past travel history and reviews, and the output is a new list of suggestions.

[2268] As a concrete example, consider the case where a user launches the app, registers their interest in "history" and "gourmet food," and sets a travel budget of "5,000 yen." When the user arrives at the center of a large city as their destination, the server suggests nearby historical buildings and famous restaurants. After the user selects a historical building and a well-known restaurant in Asakusa, detailed route guidance and reservation information are displayed on the smartphone, and the autonomous vehicle safely guides the user to their destination.

[2269] An example prompt for a generative AI model is:

[2270] "What is the specification for an application that, after a user arrives in the center of a large city, recommends tourist spots and restaurants based on his interests and budget?"

[2271] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2272] System Configuration

[2273] To implement this invention, the following system configuration is required. The system is primarily comprised of interactions between the server, the terminal, and the user. In addition, the emotion engine has the function of recognizing the user's emotional state and adjusting the content of suggestions based on that. Since questions about each processing step will be asked later, we will now provide an overview of the processing steps and explain the overall system flow using concrete examples.

[2274] System Configuration and Functions

[2275] The system includes a traveler (user) device, a central server, a database and APIs that provide various travel-related services, and an emotion engine. The server stores user registration information and is responsible for real-time suggestions, reservations, and review collection. The emotion engine recognizes emotions from the user's facial expressions and voice and sends the data to the server.

[2276] Program processing overview

[2277] User Registration

[2278] The user installs the app on their device and launches it for the first time.

[2279] The device displays a form for the user to enter their interests and budget.

[2280] The user fills out the form with their interests, concerns, and budget and clicks the submit button.

[2281] The terminal sends the entered information to the server, which stores it in a database.

[2282] Arrival and check-in

[2283] When the user arrives at the location and presses the check-in button, the device obtains the user's current location information.

[2284] The device sends its current location information to the server, which then searches for information on nearby tourist attractions, restaurants, and souvenirs in real time.

[2285] Emotion Recognition and Real-Time Suggestions

[2286] The server generates a proposal list and sends it to the terminal.

[2287] The emotion engine analyzes the user's facial expressions and voice to recognize their emotional state.

[2288] The device also sends emotional data to the server, which then adjusts the suggestion list based on the user's emotional state.

[2289] Users can tap on an item of interest from the list of suggestions to view more information.

[2290] If the proposal is not satisfactory, a re-proposal request is sent to the server, which makes a new proposal.

[2291] Destination confirmation, navigation and reservations

[2292] Once the user selects a destination, the device sends that information to the server.

[2293] The server provides detailed route guidance, necessary ticket information, and store reservation procedures, and obtains coupon information from affiliated companies.

[2294] The server sends all this information to the terminal, which displays it to the user.

[2295] Review and earn points after your visit

[2296] Once users have completed their experience at a destination, they can post reviews and photos on their device.

[2297] The terminal sends the review information to the server, which stores it in a database.

[2298] The server awards points to the user and sends a point notification to the terminal.

[2299] Plan your next trip

[2300] The next time the user launches the app, the server generates a new list of suggestions based on their past behavior and reviews.

[2301] The server sends the new proposal list to the terminal, which displays it to the user.

[2302] Specific examples

[2303] Example 1: Sightseeing in Tokyo

[2304] The user (Mr. Tanaka) launches the app and registers his interests as "history" and "food" and his budget as "5,000 yen a day."

[2305] Tanaka arrives at Tokyo Station and checks in.

[2306] The server generates a list of suggestions for historical buildings and restaurants around Tokyo Station and sends it to Tanaka's device.

[2307] The emotion engine analyzes Tanaka's facial expression and recognizes that she is relaxed.

[2308] Based on this emotional data, the server will include relaxing cafes and quiet tourist spots in its suggestion list.

[2309] Tanaka selects the suggested Sensoji Temple and a famous Japanese restaurant and checks the details.

[2310] The server provides route guidance and handles reservation procedures, and all information is displayed on Tanaka's device.

[2311] After visiting, Tanaka posts a review and photos and earns points.

[2312] In this way, the system allows travelers to be flexible in their travels and enjoy experiences tailored to their interests and emotional state in real time, while enabling travel companies to use detailed data to improve their marketing and services.

[2313] The processing flow will be explained below.

[2314] User Registration

[2315] Step 1:

[2316] The user installs the app on their device and launches it for the first time.

[2317] Step 2:

[2318] The device displays a form for the user to enter their interests and budget.

[2319] Step 3:

[2320] The user fills out the form with their interests, concerns, and budget and clicks the submit button.

[2321] Step 4:

[2322] The terminal transmits the input information to the server.

[2323] Step 5:

[2324] The server stores the received information in a database and sends a registration confirmation response to the terminal.

[2325] Step 6:

[2326] The device will display "Registration complete" to the user.

[2327] Arrival and check-in

[2328] Step 1:

[2329] The user arrives at the location and opens the app.

[2330] Step 2:

[2331] The device obtains GPS data and determines its current location.

[2332] Step 3:

[2333] The user clicks the check-in button.

[2334] Step 4:

[2335] The device sends its current location and user ID to the server.

[2336] Step 5:

[2337] The server searches for information on tourist spots, restaurants, and souvenirs around the current location and generates a list of suggestions.

[2338] Step 6:

[2339] The server sends the generated list to the terminal.

[2340] Step 7:

[2341] The device displays a list of suggestions to the user.

[2342] Emotion Recognition and Real-Time Suggestions

[2343] Step 1:

[2344] The emotion engine analyzes the user's facial expressions and voice to recognize their emotional state.

[2345] Step 2:

[2346] The device transmits the emotion data to the server.

[2347] Step 3:

[2348] The server adjusts the suggestion list based on the user's emotional state.

[2349] Step 4:

[2350] The user taps on an item of interest from the list of suggestions.

[2351] Step 5:

[2352] The device displays a detailed information screen for the selected item.

[2353] Step 6:

[2354] The user checks for more information.

[2355] Step 7:

[2356] If the user is not satisfied with the suggestion, he or she clicks the Re-suggest button.

[2357] Step 8:

[2358] The terminal sends a re-proposal request to the server.

[2359] Step 9:

[2360] The server generates a list of alternative suggestions and sends it to the terminal.

[2361] Step 10:

[2362] The device will display the new suggestions list to the user.

[2363] Destination confirmation, navigation and reservations

[2364] Step 1:

[2365] The user selects the proposal that satisfies them and confirms their destination.

[2366] Step 2:

[2367] The terminal transmits destination confirmation information to the server.

[2368] Step 3:

[2369] The server generates detailed route directions to the destination.

[2370] Step 4:

[2371] The server handles the necessary ticket information and restaurant reservation procedures.

[2372] Step 5:

[2373] The server acquires coupon information from the partner.

[2374] Step 6:

[2375] The server sends all the information to the terminal.

[2376] Step 7:

[2377] The device displays route guidance, ticket information, reservation confirmation, and coupon information to the user.

[2378] Review and earn points after your visit

[2379] Step 1:

[2380] The user opens the app after visiting a location.

[2381] Step 2:

[2382] The user is directed to the review submission screen.

[2383] Step 3:

[2384] The device will display a review input form.

[2385] Step 4:

[2386] The user enters a review and image and clicks the submit button.

[2387] Step 5:

[2388] The device sends the review and image data to the server.

[2389] Step 6:

[2390] The server stores the data in a database.

[2391] Step 7:

[2392] The server awards points to the user and sends a point notification to the terminal.

[2393] Step 8:

[2394] The terminal will display a message to the user saying that points have been added.

[2395] Plan your next trip

[2396] Step 1:

[2397] The user restarts the app the next time they travel.

[2398] Step 2:

[2399] The device sends the user ID to the server.

[2400] Step 3:

[2401] The server generates a new list of suggestions based on past travel data and reviews.

[2402] Step 4:

[2403] The server sends the new proposal list to the terminal.

[2404] Step 5:

[2405] The device displays a list of suggestions to the user.

[2406] Specific examples

[2407] Example 1: Sightseeing in Tokyo

[2408] Step 1:

[2409] The user (Mr. Tanaka) launches the app and registers his interests as "history" and "food" and his budget as "5,000 yen a day."

[2410] Step 2:

[2411] Tanaka arrives at Tokyo Station and checks in.

[2412] Step 3:

[2413] The server generates a list of suggestions for historical buildings and restaurants around Tokyo Station and sends it to Tanaka's device.

[2414] Step 4:

[2415] The emotion engine analyzes Tanaka's facial expression and recognizes that she is relaxed.

[2416] Step 5:

[2417] Based on this emotional data, the server will include relaxing cafes and quiet tourist spots in its suggestion list.

[2418] Step 6:

[2419] Tanaka selects the suggested Sensoji Temple and a famous Japanese restaurant and checks the details.

[2420] Step 7:

[2421] The server provides route guidance and handles reservation procedures, and all information is displayed on Tanaka's device.

[2422] Step 8:

[2423] After visiting, Tanaka posts a review and photos and earns points.

[2424] In this way, the system allows travelers to be flexible in their travels and enjoy experiences tailored to their interests and emotional state in real time, while enabling travel companies to use detailed data to improve their marketing and services.

[2425] Example 2

[2426] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2427] While traditional travel planning systems can register travelers' interests, preferences, and budgets, the proposed content often does not adapt to the traveler's real-time emotional state, resulting in low satisfaction. While they offer on-site check-in and sightseeing information, they are unable to respond appropriately when travelers need further suggestions. Furthermore, there are limitations to their ability to support multiple languages ​​and utilize detailed traveler data for marketing and service improvement, making it difficult for travel-related businesses to increase their customer attraction.

[2428] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2429] In this invention, the server includes: a means for registering a traveler's interests, preferences, and budget; a means for the traveler to check in at a destination; a means for suggesting tourist spots, restaurants, and souvenirs in real time based on the check-in information; a means for making re-suggestions if the suggestion results in low satisfaction; a means for recognizing the user's emotional state and adjusting the suggestion content based on the user's emotional state; a means for providing route guidance, ticket reservations, restaurant reservations, and partner coupon information once the destination is decided; a means for sharing reviews and images after the trip and earning points; a means for learning the traveler's behavioral history and reviews to suggest the next destination; and a means for transmitting and receiving data between the terminal and the server. This allows travelers to be flexible in their activities and receive optimal suggestions based on their real-time emotional state. Furthermore, re-suggestions are made even if the suggestion is dissatisfied, thereby improving traveler satisfaction. Furthermore, multilingual support and detailed traveler data can be used to increase the customer attraction and marketing capabilities of travel-related businesses.

[2430] "Means for registering traveler interests, preferences, and budget" refers to devices or functions that allow travelers to input and save their areas of interest, specific concerns, and the budget they intend to use for their trip.

[2431] "Means for travelers to check in at a destination" refers to the devices and functionality that allow travelers to confirm their arrival at a destination and register their arrival information in the system using a terminal or mobile application.

[2432] "Means for suggesting information on tourist attractions, restaurants, and souvenirs in real time based on check-in information" refers to devices and functions that use travelers' check-in information to search for information on local tourist attractions, restaurants, souvenir shops, etc. in real time and suggest it to travelers.

[2433] "Means for making a new proposal if the traveler is not satisfied with the proposal" refers to a device or function for generating a new proposal and presenting it to the traveler again if the initial proposal is not satisfactory to the traveler.

[2434] "Means for recognizing the user's emotional state and adjusting the content of suggestions based on that" refers to devices or functions that analyze the user's facial expressions and voice to recognize their emotional state, and change or adapt the content of suggestions in real time based on that data.

[2435] "Means of providing route guidance, ticket reservations, restaurant...

Claims

1. a means of registering travellers' interests, preferences and budgets; A means for travelers to check in at their destination; A means to suggest tourist spots, restaurants, and souvenir information in real time based on check-in information, A means to make a re-proposal if the customer is not satisfied with the proposal; Once the destination is decided, a means to provide route guidance, ticket reservations, store reservations, and partner coupon information; A way to share reviews and photos after your trip and earn points, A system that includes a means of learning from a traveler's behavioral history and reviews to suggest their next destination.

2. The system according to claim 1, which is multilingual and allows small stores and local governments to provide services over a wide area.

3. The system according to claim 1, which utilizes detailed traveler data to improve marketing and services, thereby strengthening the ability of affiliated companies to attract customers.

Images