System

Abstract

A system is provided.SOLUTION: A system comprising: means for inputting an origin and a destination when a user travels; means for collecting information related to tourist spots, restaurants, events, and activities on the way and at the destination based on the input origin and destination; means for filtering the collected information based on usage and attributes and generating a proposed plan; means for transmitting the generated proposed plan to a terminal of the user; and means for receiving location information of the user in real time and updating the proposed plan according to circumstances.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Traditional driving, cycling, and walking involves users deciding on a destination in advance, searching for a route using a navigation or map app, and then following the route suggested. This poses the problem of missing out on unknown information, such as tourist spots, restaurants, events, and activities along the way or around the destination. Furthermore, there is a lack of ways to provide optimal plans tailored to the purpose and attributes of travel or leisure, often limiting the user's experience. There is a need to proactively propose these "unknown worlds" and further enrich travel and leisure experiences. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems with a system that includes: a means for a user to input a departure point and destination when traveling; a means for collecting information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input departure point and destination; a means for filtering the collected information based on the purpose and attributes and generating a proposed plan; a means for transmitting the generated proposed plan to the user's terminal; and a means for receiving the user's location information in real time and updating the proposed plan according to the situation. The system also includes a means for selecting and suggesting specific tourist attractions, restaurants, events, and activities based on the user's attributes, and a means for dynamically updating the proposed plan based on the user's location information and current traffic and weather information, thereby making the user's travel and leisure experience even richer and more enjoyable.

[0006] A "user" is a person who uses the system and plans to travel, such as by driving, cycling, or walking.

[0007] "Device" means an electronic device used by a user to input information and view suggestions from the system, including a smartphone, tablet, or PC.

[0008] "Start point" is the point where the user begins their journey.

[0009] A "destination" is the location the user ultimately wants to reach.

[0010] A "route" refers to a path from a departure point to a destination, including directions provided by navigation.

[0011] "Purpose" refers to the purpose of the user's travel or trip, including dates, solo trips, family trips, girls' trips, etc.

[0012] "Attributes" refer to the user's travel or leisure situation and conditions, including age group, whether they are accompanied by someone, and specific hobbies and preferences.

[0013] "Tourist attractions" are places worth visiting for users, including historical buildings, natural landscapes, etc.

[0014] A "restaurant" is a food and beverage establishment where users stop by to consume food and drinks.

[0015] "Event" means an occasion taking place at a specific date, time and location that users can attend, including festivals, exhibitions, etc.

[0016] "Activities" are experiences or activities that users can enjoy during travel or leisure activities, including hiking and sports.

[0017] "Means of collecting information" refers to the functions and processes that obtain the necessary data from the Internet or internal databases.

[0018] "Filtering" is the process of selecting necessary information from collected information and removing unnecessary information.

[0019] A "suggested plan" is a list of tourist attractions, restaurants, events, activities, etc. selected based on the user's attributes and purpose, and is a recommended action plan for the user.

[0020] "Real-time reception" refers to the process of instantly obtaining and continuously updating a user's current location and status.

[0021] "Means to update proposal plans" means the functionality or process of modifying or adding to existing proposal plans based on the user's current situation and location. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2]1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0023] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0024] First, the terms used in the following description will be explained.

[0025] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0026] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0027] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0028] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0030] [First embodiment]

[0031] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0032] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0033] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0034] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0035] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0036] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0037] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0038] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0039] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0040] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0041] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0042] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0043] System Overview

[0044] The present invention is a system that includes a means for inputting a departure point and destination when a user travels, and a means for collecting information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, filtering the collected information based on purpose and attributes to generate a proposed plan, sending the generated proposed plan to the user's terminal, and receiving the user's location information in real time to update the proposed plan according to the situation.

[0045] Program processing

[0046] 1. User Input

[0047] Users input the departure point, destination, route, and purpose of the trip (date, solo trip, family trip, etc.) through an app or web interface on their device (smartphone, tablet, PC). For example, a user might input, "I plan to drive from Shibuya to Kamakura, and the purpose is a date."

[0048] 2. Transmission of User Information

[0049] The device sends the entered information (starting point, destination, route, purpose) to the server. The device sends the data "starting point: Shibuya," "destination: Kamakura," and "purpose: date" to the server.

[0050] 3. Receiving data and preparing for analysis

[0051] The server performs an initial analysis of the received data and determines the required data collection range. The server analyzes the route information for "Shibuya - Kamakura" and determines the destination and the range for collecting information on tourist spots, restaurants, and events along the way.

[0052] 4. Data Collection

[0053] The server runs a generative AI model and collects data on tourist spots, restaurants, events, activities, etc. within a specified area. The server collects information on "romantic sunset spots," "quiet cafes," "seafood restaurants," "art galleries," etc. between Shibuya and Kamakura from the internet and its internal database.

[0054] 5. Data filtering and proposal generation

[0055] Based on the collected information, the server generates suggestions for sightseeing spots and activities suitable for the user's purpose (date), such as "sunset spots in Enoshima," "quiet and cozy cafes in Kita-Kamakura," and "art galleries in Kamakura."

[0056] 6. Submit your proposal

[0057] The server sends the generated proposed plan to the device. The server sends the plan, which includes "Sunset Spots in Enoshima," "Cafes in Kita-Kamakura," and "Art Gallery in Kamakura," to the device.

[0058] 7. View your plan

[0059] The terminal displays the received proposed plan to the user. The terminal displays the proposed plan on a map or in list format, and provides navigation information to the user.

[0060] 8. Real-time location information transmission

[0061] When the user starts moving, the device periodically sends the user's current location information to the server. The device sends the user's current location to the server every 10 minutes.

[0062] 9. Real-time data analysis and proposal updates

[0063] The server receives real-time location information and updates suggestions based on new information and changing conditions (e.g., traffic congestion, weather). If the user is delayed or bad weather is forecast, the server will suggest alternative rest spots, dining spots, and indoor activities.

[0064] 10. Submitting a Resubmission

[0065] The server sends the updated suggestions to the device. The server also sends newly generated information such as "indoor cafes" and "stylish bookstores" to the device.

[0066] 11. Displaying real-time suggestions

[0067] The device will display new suggestions to the user in real time, such as "new cafes" or "places to shelter from bad weather," via pop-ups and notifications.

[0068] Specific examples

[0069] For example, when a couple plans a date drive from Shibuya to Kamakura, the following suggestions are made:

[0070] Departure point: Shibuya

[0071] Destination: Kamakura

[0072] Use: Date

[0073] The server collects tourist spots and restaurants between Shibuya and Kamakura and suggests romantic spots and cafes suitable for dates. Along the way, the server suggests spots such as sunset spots in Enoshima, quiet cafes in Kita-Kamakura, and art galleries in Kamakura. New suggestions are also made based on real-time location information and conditions during travel. For example, in the event of bad weather, alternatives such as indoor cafes or stylish bookstores are suggested.

[0074] In this way, users can enjoy a richer experience while traveling or on the move.

[0075] The processing flow will be explained below.

[0076] Step 1:

[0077] A user inputs the starting point, destination, route, and purpose (date, solo trip, family trip, etc.) via an application on the device or a web interface. For example, a user plans a "drive from Shibuya to Kamakura" and inputs the purpose as "date."

[0078] Step 2:

[0079] The device sends the entered information about the departure point, destination, route, and purpose to the server, along with the user's basic information and attributes (age group, interests, etc.).

[0080] Step 3:

[0081] The server performs an initial analysis of the received data and determines the range of information to be collected. For example, based on the route information "Shibuya - Kamakura," it sets the range to include the destination and tourist spots, restaurants, and event information along the way.

[0082] Step 4:

[0083] The server runs a generative AI model, collecting data on tourist spots, restaurants, events, and activities within a specified area from the internet and an internal database, such as romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[0084] Step 5:

[0085] The server filters the collected information and generates a plan suitable for the purpose and the user's attributes. For example, it might select "sunset spots in Enoshima," "cafes in Kita-Kamakura," and "art galleries in Kamakura" that are suitable for a date.

[0086] Step 6:

[0087] The server then sends the generated proposed plan to the terminal, which includes detailed information about each spot and a navigation guide.

[0088] Step 7:

[0089] The terminal displays the proposed plan to the user on a map or in list format, designed to be intuitive and convenient for the user.

[0090] Step 8:

[0091] When a user starts moving, the device periodically sends the user's current location information to the server. For example, by sending GPS information every 10 minutes, the device can grasp the user's location in real time.

[0092] Step 9:

[0093] The server analyzes the location information sent in real time and updates the proposed plan based on new information and changes in conditions (such as crowding and weather information). If crowding is expected or the weather worsens, the server will suggest alternative tourist spots and indoor activities.

[0094] Step 10:

[0095] The server then sends the updated plan proposal to the device, which includes newly selected locations such as an indoor cafe and a stylish bookstore.

[0096] Step 11:

[0097] The device will display updated proposals to the user in real time, with new proposals and changes indicated to the user through pop-up notifications and changes to map markers.

[0098] This series of processes allows users to enjoy a rich experience while traveling or commuting.

[0099] Example 1

[0100] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0101] Conventional travel planning systems allow users to input information about their departure and destination points, but they lack the ability to dynamically propose plans that respond to real-time changes in circumstances. They also struggle to automatically filter and suggest the best tourist spots and activities for specific purposes and attributes. This leaves users unable to respond to unexpected events or changes in the weather during their trip, resulting in an inadequate travel experience.

[0102] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0103] In this invention, the server includes means for inputting a departure point and destination for a user's trip, means for using an artificial intelligence model to generate and collect information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on purpose and attributes and generating a proposed plan, means for transmitting the generated proposed plan to the user's terminal, and means for receiving the user's location information in real time and updating the proposed plan in response to changes in the situation. This allows the user to receive a dynamic plan that responds to real-time changes in the situation during their trip, enabling them to flexibly respond to unexpected events and changes in the weather.

[0104] definition statement

[0105] The "starting point" is the point where the user begins their journey.

[0106] A "destination" is the point where the user intends to end their journey.

[0107] "Input means" is an interface through which a user provides the origin and destination to the system.

[0108] The "artificial intelligence model that generates information" is an algorithm that analyzes collected data and generates information related to tourist attractions, restaurants, events, and activities.

[0109] A "filtering means" is a method for selecting appropriate information from collected information based on specific conditions.

[0110] The "means for generating a proposed plan" is a method for creating a plan that combines optimal tourist spots and activities based on the user's purpose and attributes.

[0111] The "means for transmitting the proposed plan" refers to a communication protocol and data format for transmitting the generated proposed plan to the user's terminal.

[0112] "Means for receiving location information in real time" means technology for continuously transmitting and receiving a user's current geographical location to a server.

[0113] The "means for updating the proposed plan in response to changes in the situation" refers to a method for reevaluating the proposed plan based on real-time location information and changes in the environment, and generating new proposals as necessary.

[0114] This invention relates to a system that suggests tourist spots, restaurants, events, and activities in response to real-time changes in the user's situation while they are traveling. A specific embodiment of this system is described below.

[0115] User Input

[0116] Users can input the origin, destination, route, and purpose of the trip (e.g., date, solo trip, family trip, etc.) through an app or web interface on their device (smartphone, tablet, PC). For example, a user might input, "I'm planning a drive from Shibuya to Kamakura, and the purpose is a date."

[0117] Sending input information

[0118] The information entered by the user is sent from the device to the server. Specifically, the device compiles the data "Departure: Shibuya," "Destination: Kamakura," and "Purpose: Date" and sends it to the server using the HTTPS protocol.

[0119] Receiving data and preparing for analysis

[0120] The server analyzes the received data and determines the required data collection range. The server analyzes the route information for "Shibuya - Kamakura" and determines the range for collecting information on the destination, tourist spots along the way, restaurants, events, etc.

[0121] Data collection and use of generative AI models

[0122] The server uses the generative AI model to collect data on tourist spots, restaurants, events, activities, etc. within a specified range. For example, between Shibuya and Kamakura, information such as "romantic sunset spots," "quiet cafes," "seafood restaurants," and "art galleries" is collected from the internet and an internal database. An example of a prompt to be input to the generative AI model is "Please suggest the best places for a date between Shibuya and Kamakura."

[0123] Filtering data and generating proposed plans

[0124] The collected information is filtered by the server to select sightseeing spots and activities that best suit the user's needs and attributes. For example, suggestions such as "sunset spots in Enoshima," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura" are generated.

[0125] Submitting and viewing proposals

[0126] The generated proposed plan is sent from the server to the terminal, which displays the received proposed plan on a map or in list format and provides navigation information to the user.

[0127] Real-time location and plan updates

[0128] Once the user begins moving, the device periodically sends the user's current location information to the server. For example, the device obtains the user's current location every 10 minutes and sends it to the server using the HTTPS protocol. The server dynamically updates the proposed plan based on real-time location information and current traffic and weather information. By using the generative AI model again, it can suggest "alternative rest spots" or "indoor activities" in cases such as "when the route is delayed compared to planned" or "when bad weather is forecast." An example of a prompt used in this case is "Please suggest the best rest spot for the current situation."

[0129] Submit and view new proposals

[0130] The updated proposal plan is then sent back to the device from the server, and the device displays the new proposals to the user in real time, such as pop-ups and notifications about new cafes and bad weather shelters.

[0131] In this way, the system of the present invention allows users to receive appropriate suggestions in real time while traveling or moving, enabling them to make comfortable and flexible travel plans.

[0132] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0133] Step 1:

[0134] The user uses the terminal to input the origin, destination, route, and purpose of the trip.

[0135] Specific operation: The user opens the app, enters "Shibuya" as the departure point, "Kamakura" as the destination, and "date" as the purpose, and presses the "Start" button.

[0136] Input: Information entered by the user (origin, destination, purpose, etc.).

[0137] Output: The application validates the information entered and proceeds to the next step.

[0138] Step 2:

[0139] The terminal transmits the input information to the server.

[0140] Specific operation: The device sends the input information to the server using the HTTPS protocol as "Departure: Shibuya," "Destination: Kamakura," and "Purpose: Date." After the transmission is complete, the user is shown the message "Sending."

[0141] Input: Information entered by the user.

[0142] Output: The input information is sent to the server.

[0143] Step 3:

[0144] The server performs an initial analysis of the received data and determines the scope of data collection.

[0145] Specific operation: The server retrieves the distance and route information between "Shibuya and Kamakura" from the database and determines the range of data collection required based on the purpose of the "date."

[0146] Input: Origin, destination, and purpose information sent from the device.

[0147] Output: Identification of data collection area and list of required tourist attractions, places to eat, and event information.

[0148] Step 4:

[0149] The server uses a generative AI model to collect data within a specified range.

[0150] Specific operation: The server collects information on "romantic sunset spots," "quiet cafes," "seafood restaurants," "art galleries," etc. from the Internet and an internal database between "Shibuya and Kamakura." The generative AI model uses the prompt sentence, "Please suggest the best places for a date between Shibuya and Kamakura."

[0151] Input: Data collection scope and collection prompt statement.

[0152] Output: A list of collected tourist attractions, places to eat, events, and activities.

[0153] Step 5:

[0154] The server filters the information and generates a proposed plan.

[0155] How it works: The server selects date spots from the collected data, such as "sunset spots on Enoshima Island," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura City," and prioritizes highly rated data using a scoring algorithm.

[0156] Input: A list of collected tourist attractions, places to eat, events, and activities.

[0157] Output: Optimized proposed plan.

[0158] Step 6:

[0159] The server transmits the generated proposed plan to the terminal.

[0160] Specific operation: The server converts the proposed plan into JSON format and sends it to the terminal via HTTPS. After the transmission is complete, a transmission log is recorded on the server.

[0161] Input: Optimized proposal plan.

[0162] Output: The proposed plan sent to the device.

[0163] Step 7:

[0164] The terminal displays the received proposed plan to the user.

[0165] What it does: The device parses the JSON data, displays the proposed plans on a map or in a list format, and provides navigation information to the user.

[0166] Input: Proposed plan sent by the server.

[0167] Output: The proposed plan that is displayed to the user.

[0168] Step 8:

[0169] When the user starts moving, the terminal periodically transmits the user's current location information to the server.

[0170] How it works: The device uses the GPS sensor to obtain the user's current location every 10 minutes and sends it to the server using the HTTPS protocol. The device's status bar displays the progress of the transfer.

[0171] Input: User's current location.

[0172] Output: Location data sent to the server.

[0173] Step 9:

[0174] The server dynamically updates the proposed plan based on real-time location information, current traffic conditions, and weather information.

[0175] How it works: The server receives real-time location information and the latest weather and congestion data to generate new suggestions. The generative AI model uses a new prompt: "Please suggest the best rest spot for the current situation."

[0176] Input: Real-time location, traffic, and weather information.

[0177] Output: Updated proposed plan.

[0178] Step 10:

[0179] The server sends the updated proposed plan to the terminal.

[0180] Specific operation: The server converts the updated proposal into JSON format and sends it to the device via HTTPS. After sending is complete, the new proposal is recorded in the server history.

[0181] Input: Updated proposed plan.

[0182] Output: The updated proposed plan sent to the device.

[0183] Step 11:

[0184] The terminal displays new suggestions to the user in real time.

[0185] What it does: Your device will notify you of new suggestions via pop-up notifications or in the notification bar, such as "New Cafes" or "Shelter in Bad Weather."

[0186] Input: The updated proposed plan sent from the server.

[0187] Output: Updated suggestions shown to the user in real time.

[0188] (Application example 1)

[0189] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0190] Conventional travel plan generation systems can only provide static suggestions based on predefined tourist destinations and restaurants, and lack the flexibility to adapt to the user's location information or real-time changes in the situation. Furthermore, they do not provide optimal suggestions based on the user's purpose or attributes, so they are unable to fully meet individual needs. Furthermore, in the case of food delivery, the provision of restaurant information based on the user's location information and real-time tracking of delivery status are insufficient, making it difficult to provide optimal suggestions. There is a need to solve these issues.

[0191] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0192] In this invention, the server includes: a means for inputting a user's departure and destination; a means for collecting information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input departure and destination; a means for filtering the collected information based on the user's purpose and attributes and generating a proposed plan; a means for transmitting the generated proposed plan to the user's device; a means for receiving the user's location information in real time and updating the proposed plan according to the situation; and a means for collecting information on nearby restaurants based on the user's location information and providing suggestions based on delivery status. This allows users to receive suggestions for optimal tourist attractions and restaurants even while traveling, enabling flexible planning that responds to real-time changes in the situation. In addition, for food delivery, the server can obtain optimal restaurant information and delivery information based on the user's current location.

[0193] "User" refers to a person or organization that uses the service, and is the person to whom the system makes suggestions based on their location information and input information.

[0194] The "origin" refers to the point where the user begins their journey, and is important information for the system to generate route and destination information.

[0195] The "destination" refers to the point where the user completes their journey and serves as the basis for the system to make suggestions along the way and after arrival.

[0196] "Tourist destinations" refer to places that users should visit based on their interests, including historical buildings and natural landscapes.

[0197] "Food and beverage establishments" refers to establishments that serve food and beverages, including restaurants and cafes.

[0198] "Event" means an activity or event in which users can participate, including concerts and festivals.

[0199] "Activities" refers to experiences and activities that users can undertake, including outdoor sports and workshops.

[0200] "Purpose" refers to the purpose of the user's travel or trip, and can be categorized as a date, family trip, work, etc.

[0201] "Attributes" refer to a user's individual characteristics and preferences, including age, interests, special requests, etc.

[0202] "Proposed Plan" means a trip or travel plan provided to a User by the System, including details of places to visit and activities.

[0203] "Means of collection" refers to the method by which the specified information is obtained from the Internet or internal databases.

[0204] "Filtering means" refers to methods for sorting collected information based on the user's purpose and attributes.

[0205] "Means of receiving in real time" refers to a method for instantly obtaining the user's current location information and situation.

[0206] "Means of updating" refers to methods for modifying the proposed plan based on the user's location information or changes in the situation.

[0207] "Delivery status" refers to the location of the delivery person and the progress of the order in food delivery.

[0208] The system of the present invention allows a user to input their starting point and destination when traveling, collects information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input, filters the collected information based on purpose and attributes, and generates a proposed plan.The system also sends the generated proposed plan to the user's device, receives the user's location information in real time, and updates the proposed plan according to the situation.Furthermore, it collects information on nearby restaurants based on the user's location information and provides suggestions based on delivery status.

[0209] Program processing

[0210] Hardware and software used

[0211] Hardware: Smartphone (iOS, Android, etc.), server PC.

[0212] Software: Python, Requests library, Web API, generative AI models.

[0213] Data processing and calculation

[0214] 1. User input:

[0215] Users input their departure point, destination, and purpose of travel through a smartphone application, such as "Current location: Shinjuku," "Destination: Kyoto," and "Purpose: Sightseeing trip."

[0216] 2. Data Collection:

[0217] The server uses Web APIs, such as the Google Places API and Yelp API, to collect information on tourist attractions, restaurants, events, and activities related to the specified route and destination.

[0218] 3. Information filtering and generation of proposed plans:

[0219] The server uses a generative AI model to filter the collected information based on purpose and attributes to generate optimal proposals, such as prioritizing kid-friendly tourist spots and family restaurants for a family trip.

[0220] 4. Receive real-time location information and update your proposed plan:

[0221] While the user is moving, their device periodically sends their current location information to the server, which receives this information in real time and dynamically updates the proposed plan based on weather, traffic conditions, and other information using the OpenWeatherMap API and Google Maps Traffic API.

[0222] 5. Food delivery suggestions:

[0223] Based on the user's location, the app collects information about nearby restaurants, tracks the delivery person's current location and delivery status in real time, and suggests the most suitable restaurant and menu. Delivery status is updated in real time using a GPS tracking system.

[0224] Specific examples

[0225] For example, if a user plans a sightseeing trip from Shinjuku to Kyoto, the system will collect information on tourist spots such as Shinjuku Station, Kyoto Tower, and the bamboo forests of Arashiyama, as well as Japanese restaurants in Kyoto City and local souvenir shops, and provide the optimal plan. Based on real-time location information during travel, the system will also make new suggestions based on changes in congestion and weather.

[0226] Prompt Sentence Examples

[0227] A user is planning a sightseeing trip from Shinjuku to Kyoto. Suggest attractions, restaurants, events, and activities along the way and at the destination. Also includes new suggestions based on real-time updates.

[0228] In this way, users can find the best tourist spots and restaurants while traveling, and even for food delivery, they can track delivery status in real time and get information on recommended restaurants.

[0229] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0230] Step 1:

[0231] The user inputs the departure point, destination, and purpose into the terminal, which then transmits this information to the server.

[0232] Input: Departure point, destination, purpose (e.g., "Current location: Shinjuku", "Destination: Kyoto", "Purpose: Sightseeing trip")

[0233] Output: User information sent to the server

[0234] Step 2:

[0235] The server receives the departure and destination information sent by the user and collects information related to tourist attractions, restaurants, events, and activities within the specified range.

[0236] Input: User information sent (origin, destination, purpose)

[0237] Data processing: Collect information using Web APIs (e.g., Google Places API, Yelp API)

[0238] Output: Collected information on tourist spots, restaurants, events, and activities

[0239] Step 3:

[0240] The server filters the collected information based on the user's purpose and attributes, and uses a generative AI model to generate the optimal proposed plan.

[0241] Input: Collected tourist destination, restaurant, event, activity information, user purpose and attributes

[0242] Data processing: Filtering process using generative AI models

[0243] Output: Optimal proposed plan

[0244] Step 4:

[0245] The server transmits the generated proposed plan to the user's terminal, which receives the proposed plan and displays it to the user.

[0246] Input: Proposed plan

[0247] Output: Proposed plan sent to user device

[0248] Step 5:

[0249] When the user starts moving, the terminal periodically collects current location information and transmits it to the server.

[0250] Input: Real-time location of the user

[0251] Output: Location information sent to the server

[0252] Step 6:

[0253] The server receives the user's location information in real time, compares it with weather information, traffic conditions, etc., and updates the proposed plan.

[0254] Input: Real-time user location, weather, and traffic information

[0255] Data processing: Analyzing real-time data and updating proposal plans

[0256] Output: Updated proposed plan

[0257] Step 7:

[0258] The server then sends the updated proposal plan to the user's terminal again, and the terminal receives the new proposal plan and notifies the user.

[0259] Input: Updated Proposal Plan

[0260] Output: Updated proposed plan sent to user device

[0261] Step 8:

[0262] Based on the user's location information, the server collects information on nearby restaurants, tracks delivery status in real time, and provides the user with the most suitable restaurant information.

[0263] Input: User's location information, delivery person's current location information

[0264] Output: Information on the best restaurants and delivery status sent to the user's device

[0265] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0266] System Overview

[0267] The present invention is a system including means for inputting a departure point and destination when a user travels, means for collecting information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on purpose and attributes to generate a proposed plan, means for transmitting the generated proposed plan to the user's terminal, means for receiving the user's location information in real time to update the proposed plan according to the situation, and means for recognizing the user's emotions by combining an emotion engine and adjusting the proposed plan based on the recognized emotions.

[0268] Program processing

[0269] 1. User Input

[0270] Users input the departure point, destination, route, and purpose of the trip (date, solo trip, family trip, etc.) through an app or web interface on their device (smartphone, tablet, PC). For example, a user might input, "I plan to drive from Shibuya to Kamakura, and the purpose is a date."

[0271] 2. Transmission of User Information

[0272] The device sends the input information (starting point, destination, route, and purpose) to the server, along with the user's basic information and attributes (age group, interests, etc.).

[0273] 3. Receiving data and preparing for analysis

[0274] The server performs an initial analysis of the received data and determines the range of information to be collected. Based on the route information for "Shibuya - Kamakura," the server sets the range to include the destination and tourist spots, restaurants, and event information along the way.

[0275] 4. Data Collection

[0276] The server runs a generative AI model, collecting data on tourist spots, restaurants, events, and activities within a specified area from the internet and an internal database, such as romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[0277] 5. Data filtering and proposal generation

[0278] The server filters the collected information and generates a plan suitable for the purpose and the user's attributes. For example, it might select a sunset spot in Enoshima, a quiet and pleasant cafe in Kita-Kamakura, or an art gallery in Kamakura that are suitable for a date.

[0279] 6. Submit your proposal

[0280] The server then sends the generated proposed plan to the device, which includes detailed information about each spot and a navigation guide.

[0281] 7. View your plan

[0282] The terminal displays the proposed plan to the user on a map or in list format, designed to be intuitive and convenient for the user.

[0283] 8. Real-time location information transmission

[0284] When a user starts moving, the device periodically sends the user's current location information to the server. For example, by sending GPS information every 10 minutes, the device can grasp the user's location in real time.

[0285] 9. Real-time data analysis and proposal updates

[0286] The server analyzes the location information sent in real time and updates the proposed plan based on new information and changes in conditions (such as crowding and weather information). If crowding is expected or the weather worsens, the server will suggest alternative tourist spots and indoor activities.

[0287] 10. Submitting a Resubmission

[0288] The server then sends the updated plan proposal to the device, which includes newly selected locations such as an indoor cafe and a stylish bookstore.

[0289] 11. Displaying real-time suggestions

[0290] The device will display updated proposals to the user in real time, with new proposals and changes indicated to the user through pop-up notifications and changes to map markers.

[0291] Use of emotion engine

[0292] 1. Collecting Emotional Data

[0293] The device collects emotional data using methods such as voice input, facial expression recognition, and text analysis. For example, it analyzes emotions from facial expressions and voice when a user takes a selfie.

[0294] 2. Sending Emotional Data

[0295] The device sends the collected emotional data to a server, which includes the user's emotional state, such as joy, sadness, anger, and stress.

[0296] 3. Analyzing emotional data and adjusting the proposal plan

[0297] The server analyzes the received emotional data and adjusts the proposed plan based on the user's current emotional state. For example, if the user is feeling stressed, it will increase relaxation spots and entertainment.

[0298] 4. Recommendations based on emotional state

[0299] The server generates suggestions based on the user's emotional state and sends them to the device. For example, if the user is having fun, the server will suggest additional spots to help maintain that emotion.

[0300] Specific examples

[0301] For example, when a couple plans a date drive from Shibuya to Kamakura, the following suggestions are made:

[0302] Departure point: Shibuya

[0303] Destination: Kamakura

[0304] Use: Date

[0305] The server collects tourist spots and restaurants between Shibuya and Kamakura and suggests romantic spots and cafes suitable for dates. Along the way, the server suggests spots such as sunset spots in Enoshima, quiet cafes in Kita-Kamakura, and art galleries in Kamakura. New suggestions are also made based on real-time location information and conditions during travel. For example, in the event of bad weather, alternatives such as indoor cafes or stylish bookstores are suggested.

[0306] Furthermore, the emotion engine recognizes the user's emotions and suggests places to relax if the user is feeling stressed, or suggests additional spots to maintain that emotion if the user is having fun. In this way, users can enjoy a rich experience while traveling.

[0307] The processing flow will be explained below.

[0308] Step 1:

[0309] A user inputs the starting point, destination, route, and purpose (date, solo trip, family trip, etc.) via an application on the device or a web interface. For example, a user plans a "drive from Shibuya to Kamakura" and inputs the purpose as "date."

[0310] Step 2:

[0311] The device sends the entered information about the departure point, destination, route, and purpose to the server, along with the user's basic information and attributes (age group, interests, etc.).

[0312] Step 3:

[0313] The server performs an initial analysis of the received data and determines the range of information to be collected. For example, based on the route information "Shibuya - Kamakura," it sets the range to include the destination and tourist spots, restaurants, and event information along the way.

[0314] Step 4:

[0315] The server runs a generative AI model, collecting data on tourist spots, restaurants, events, and activities within a specified area from the internet and an internal database, such as romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[0316] Step 5:

[0317] The server filters the collected information and generates a plan suitable for the purpose and the user's attributes. For example, it might select a sunset spot in Enoshima, a quiet and pleasant cafe in Kita-Kamakura, or an art gallery in Kamakura that are suitable for a date.

[0318] Step 6:

[0319] The server then sends the generated proposed plan to the terminal, which includes detailed information about each spot and a navigation guide.

[0320] Step 7:

[0321] The terminal displays the received proposed plan to the user in a map or list format, designed to be intuitive for the user.

[0322] Step 8:

[0323] When a user starts moving, the device periodically sends the user's current location information to the server. For example, by sending GPS information every 10 minutes, the device can grasp the user's location in real time.

[0324] Step 9:

[0325] The server analyzes the location information sent in real time and updates the proposed plan based on new information and changes in conditions (such as crowding and weather information). For example, if crowding is expected or the weather worsens, it will suggest alternative tourist spots or indoor activities.

[0326] Step 10:

[0327] The server then sends the updated proposed plan to the terminal, which includes the newly selected "indoor cafe" and "stylish bookstore."

[0328] Step 11:

[0329] The device will display updated proposals to the user in real time, with new proposals and changes indicated to the user through pop-up notifications and changes to map markers.

[0330] Use of emotion engine

[0331] Step 12:

[0332] The device collects emotional data using methods such as voice input, facial expression recognition, and text analysis. For example, it analyzes emotions from facial expressions and voice when a user takes a selfie.

[0333] Step 13:

[0334] The device sends the collected emotional data to a server, which includes the user's emotional state, such as joy, sadness, anger, and stress.

[0335] Step 14:

[0336] The server analyzes the received emotional data and adjusts the proposed plan based on the user's current emotional state. For example, if the user is feeling stressed, it will increase relaxation spots and entertainment.

[0337] Step 15:

[0338] The server generates suggestions based on the user's emotional state and sends them to the device. For example, if the user is having fun, the server will suggest additional spots to help maintain that emotion.

[0339] Step 16:

[0340] The device displays updated proposed plans to the user in real time, and new proposals and changes based on emotional state are indicated to the user through pop-up notifications and changes to map markers.

[0341] In this way, users can enjoy a richer experience while traveling or on the move.

[0342] Example 2

[0343] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0344] In modern travel and mobility, users need to efficiently create plans, including routes and stopovers from their origin to their destination, and dynamically update them according to the situation. They also need to suggest optimal plans based on the user's emotional state and real-time circumstances. However, existing systems are insufficient in suggesting plans tailored to the user's interests and emotional state, and their ability to update suggestions in real time is limited. This makes it difficult for users to have a satisfying travel experience.

[0345] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0346] In this invention, the server includes means for inputting a departure point and destination when a user travels, means for collecting information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on purpose and attributes and generating a proposed plan, means for transmitting the generated proposed plan to the user's terminal, means for receiving the user's location information in real time and updating the proposed plan according to the situation, and means for analyzing the user's emotional state and adjusting the proposed plan based on the emotion. This makes it possible to provide an optimal plan based on the user's interests and real-time situation and emotional state.

[0347] "User" means an individual or entity that uses the System to input origin and destination and receive proposed itineraries.

[0348] "Origin" refers to the location where the user begins their journey.

[0349] "Destination" means the location where a User intends to complete a Trip.

[0350] "Terminal" refers to a device (smartphone, tablet, PC, etc.) that a user uses to input data and receive proposed plans.

[0351] A "server" is a computer system that collects and analyzes information sent by users and generates proposed plans.

[0352] "Means of collecting information" refers to the process of collecting data about tourist attractions, restaurants, events, and activities via the internet and internal databases.

[0353] "Means for filtering information" refers to the process of converting collected data into appropriate proposed plans based on usage and user attributes.

[0354] "Proposed Plan" means a plan including information on tourist attractions, restaurants, events, and activities provided to Users.

[0355] "Means for receiving in real time" refers to the process of periodically obtaining the user's current location information and sending it to the server.

[0356] The "means for updating the proposed plan" is a process for dynamically changing the proposed plan based on the user's location information and changes in conditions (such as congestion or weather changes).

[0357] "Means for analyzing emotional state" refers to the process of determining the user's current emotional state through the user's voice input, facial expression recognition, text analysis, etc.

[0358] The "means for adjusting the proposal plan based on emotions" is a process for modifying and optimizing the proposal plan according to the user's emotional state.

[0359] The present invention is a system that allows a user to input a departure point and destination when traveling. Based on the departure point and destination, the system collects information related to tourist attractions, restaurants, events, and activities along the way and at the destination, filters the information based on purpose and attributes, generates a proposed plan, and sends it to the user's device. The system also has the function of receiving the user's location information in real time and updating the proposed plan according to the situation. Furthermore, by combining it with an emotion engine, the system includes a means for recognizing the user's emotional state and adjusting the proposed plan based on the recognized emotion.

[0360] The system uses the following hardware and software:

[0361] 1. Device (smartphone, tablet, PC, etc.)

[0362] Users input their origin, destination, route, and purpose of the trip through the device, either via an app or web interface.

[0363] 2. Server

[0364] The server receives the information sent by the user (origin, destination, route, and purpose) and performs an initial analysis. Using a generative AI model, the server collects data on tourist spots, restaurants, events, and activities within the specified area from the internet and internal databases. For example, information on romantic spots, cafes, and restaurants between Shibuya and Kamakura is collected.

[0365] 3. Generative AI Models

[0366] The generative AI model filters the collected data and generates a plan proposal suited to the purpose and user attributes. Specifically, it selects suitable date spots such as "sunset spots in Enoshima," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura."

[0367] 4. Submitting and displaying the proposed plan

[0368] The server sends the generated proposed plan to the user's device, which displays it on a map or in a list format. Spots are indicated on the map with markers, and summary information about the spots is provided in the list.

[0369] 5. Real-time location information transmission

[0370] Once the user starts moving, the device will send GPS data to the server every 10 minutes, updating the user's location in real time.

[0371] 6. Real-time data analysis and proposal updates

[0372] The server analyzes real-time location information, traffic conditions, weather information, etc., and updates the proposed plan as needed, for example, suggesting quiet cafes or indoor facilities instead of crowded spots.

[0373] 7. Emotion Engine

[0374] The emotion engine collects emotional data from users through voice input, facial expression recognition, and text analysis, and sends it to the server. The server then analyzes the data and adjusts the recommendation plan based on the user's emotional state. For example, if the user is feeling stressed, the plan will include more relaxation spots.

[0375] Specific examples

[0376] For example, when a couple plans a date drive from Shibuya to Kamakura, the following suggestions are made:

[0377] Departure point: Shibuya

[0378] Destination: Kamakura

[0379] Use: Date

[0380] The server collects tourist spots and restaurants between Shibuya and Kamakura and suggests romantic spots and cafes for dates. Along the way, the server suggests spots like sunset spots in Enoshima, quiet cafes in Kita-Kamakura, and art galleries in Kamakura. New suggestions are also made based on real-time location information and conditions during travel. For example, in the event of bad weather, alternatives like indoor cafes or stylish bookstores are suggested.

[0381] Prompt Sentence Examples

[0382] "Please create a plan for a date drive from Shibuya to Kamakura. Suggest sightseeing spots and places to eat along the way."

[0383] "User is stressed. Can you suggest a spot where they can relax?"

[0384] In this way, users can enjoy their trip while always receiving the best possible suggested plans while on the move.

[0385] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0386] Step 1:

[0387] A user uses a device to input the origin, destination, route, and purpose of the trip. The user provides the input through an app or web interface. For example, the user might input, "I'm planning a drive from Shibuya to Kamakura, and the purpose is a date."

[0388] Input: origin, destination, route, purpose of trip

[0389] Output: Input information is kept in the terminal

[0390] Step 2:

[0391] The device sends the entered information (origin, destination, route, and purpose) to the server, along with basic attribute data such as the user's age group and interests.

[0392] Input: origin, destination, route, purpose of trip, user attribute data

[0393] Output: Input information and attribute data sent to the server

[0394] Step 3:

[0395] The server receives the data and performs an initial analysis. Based on the input information, the server determines the range in which to collect information related to tourist spots, restaurants, events, and activities. For example, it sets the target range based on the route information for "Shibuya - Kamakura."

[0396] Input: Transmitted data (origin, destination, route, purpose of trip, attribute data)

[0397] Output: Identifying the scope of information collection

[0398] Step 4:

[0399] The server runs the generative AI model and collects information within the specified area. Specifically, it collects data on tourist spots, restaurants, events, and activities from the internet and internal databases. For example, it collects information on romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[0400] Input: Identified scope of information collection

[0401] Output: Collected information data

[0402] Step 5:

[0403] The server filters the collected data and generates a proposal plan suited to the purpose and user attributes, for example, selecting "sunset spots in Enoshima," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura."

[0404] Input: Collected information data, user usage, and attribute data

[0405] Output: Proposed plan

[0406] Step 6:

[0407] The server then sends the generated proposed plan to the device, which includes detailed information about each spot and a navigation guide.

[0408] Input: Generated proposal plan

[0409] Output: Proposed plan sent to the device

[0410] Step 7:

[0411] The terminal displays the received proposed plan to the user in a map or list format, designed to be intuitive and easy for the user to understand.

[0412] Input: Proposed plan

[0413] Output: Display proposed plan

[0414] Step 8:

[0415] When the user actually starts moving, the device acquires the user's location information at regular intervals and sends it to the server. For example, it acquires and sends GPS data every 10 minutes.

[0416] Input: User begins moving

[0417] Output: Real-time location information sent to the server

[0418] Step 9:

[0419] The server analyzes real-time location information and dynamically updates the proposed plan, taking into account current congestion and weather conditions, for example, suggesting quiet cafes or indoor facilities instead of crowded spots.

[0420] Input: Real-time location information, current traffic and weather information

[0421] Output: Updated proposed plan

[0422] Step 10:

[0423] The server then sends the updated plan back to the device, including the latest information on things like "indoor cafes" and "stylish bookstores."

[0424] Input: Updated Proposal Plan

[0425] Output: Renewal plan sent to device

[0426] Step 11:

[0427] The device displays updated proposals to the user in real time, and new proposals and changes are instantly communicated to the user through pop-up notifications and changes to the map markers.

[0428] Input: Updated Proposal Plan

[0429] Output: Real-time notification and display

[0430] Step 12:

[0431] The device collects emotional data through the user's voice input, facial expression recognition, text analysis, etc., and sends it to a server. For example, emotions can be analyzed from the user's facial expressions and voice using a camera.

[0432] Input: User voice input, facial expression recognition, text analysis

[0433] Output: Emotion data sent to the server

[0434] Step 13:

[0435] The server analyzes the emotional data and adjusts the proposed plan based on the user's current emotional state: if the user is feeling stressed, it suggests relaxation spots.

[0436] Input: Emotion data

[0437] Output: Suggested plan depending on emotional state

[0438] Step 14:

[0439] The server sends a suggested plan based on the user's emotional state to the device, which then displays it to the user. For example, if the user is having fun, the server suggests additional spots to maintain that emotion.

[0440] Input: Suggested plan based on emotional state

[0441] Output: Proposed plan sent to the terminal and its display

[0442] (Application example 2)

[0443] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0444] In today's world, users need information that will allow them to enjoy a richer experience while traveling. However, conventional systems only provide simple tourist information based on the user's departure and destination, and do not adequately provide suggestions tailored to the user's attributes or real-time situation. They also lack personalized suggestions that take into account the user's emotions. This prevents users from receiving the optimal tourist experience, and further improvements in satisfaction are needed.

[0445] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0446] In this invention, the server includes means for inputting a departure point and destination when a user travels, means for collecting information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on the purpose and attributes and generating a proposed plan, means for transmitting the generated proposed plan to the user's terminal, means for receiving the user's location information in real time and updating the proposed plan according to the situation, and means for recognizing the user's emotions and adjusting the proposed plan based on the user's emotional state. This makes it possible to provide a personalized proposed plan based on the user's attributes, real-time location information, and emotions.

[0447] The "starting point" is the point where the user begins their journey.

[0448] A "destination" is a point that a user sets as the final purpose of their journey.

[0449] A "tourist destination" is a spot where visitors go for sightseeing purposes.

[0450] A "restaurant" is a place where meals are served.

[0451] An "event" is an event or occasion that takes place on a specific date and time.

[0452] "Activities" refers to experiential activities and programs.

[0453] "Means of collecting information" refers to the methods and functions for obtaining the necessary data using the Internet or databases.

[0454] "Means for filtering information" refers to the methods and functions for selecting and organizing collected information based on its purpose and attributes.

[0455] A "proposed plan" is a plan of destinations and activities that are optimal for the user's travel and sightseeing.

[0456] The "transmitting means" refers to a method and function for transmitting the generated proposed plan to the user's terminal.

[0457] "Location information" is data that indicates a user's current location using technologies such as GPS.

[0458] "Means for receiving in real time" refers to the method and function for obtaining user location information without time delay.

[0459] A "means for updating a proposed plan" is a method and function for modifying an existing proposed plan in response to new information or changing circumstances.

[0460] "Means for recognizing emotions" refers to methods and functions that use voice analysis and facial expression analysis to identify the user's emotional state.

[0461] The "means for adjusting the proposed plan based on the emotional state" refers to a method and function for modifying the content of the proposed plan according to the emotion recognition result.

[0462] This invention is a system that allows users to input their departure and destination points when traveling and specify the purpose of the trip (e.g., date, solo trip, family trip, etc.), and provides information about tourist spots, restaurants, events, and activities along the route and at the destination. This system is realized using the following hardware and software.

[0463] Hardware and software used

[0464] 1. Hardware

[0465] On-board computer: A computer installed in a self-driving vehicle.

[0466] GPS sensor: Obtains user location information.

[0467] Camera and microphone: Captures data to recognize user emotions.

[0468] 2. Software

[0469] To collect data, we use Python programs and web scraping libraries such as BeautifulSoup and Scrapy.

[0470] For emotion recognition, use emotion recognition APIs such as Google Cloud Vision API and Microsoft Azure Face API.

[0471] For data analysis, we use Pandas and NumPy.

[0472] The generative AI model is OpenAI's GPT-4.

[0473] System configuration

[0474] 1. User Input

[0475] Users input their origin, destination and purpose of the trip via the in-car display or smartphone app, and this information is sent to the vehicle's computer.

[0476] 2. Data Collection

[0477] The onboard computer uses the internet and internal databases to gather information about tourist spots, restaurants, events, and activities around the designated route and destinations. This data collection is done using a web scraping library.

[0478] 3. Proposal plan generation

[0479] Based on the collected data, a proposed plan is generated that is suited to the user's purpose and attributes. This proposal is made taking into account the user's profile data (age, interests, etc.). OpenAI's GPT-4 is used as the generative AI model, and the following example prompt sentence is used as input to create the proposed plan.

[0480] Prompt Sentence Examples

[0481] User profile: A young couple planning a romantic date drive from Shibuya to Kamakura. They enjoy scenic views and quiet cafes.

[0482] Data: List of tourist spots, cafes, and activities along the route from Shibuya to Kamakura.

[0483] Task: Generate a travel plan suitable for a romantic date drive, ensuring to include scenic spots and quiet cafes.

[0484] 4. Send proposals and update them in real time

[0485] The server sends the generated proposed plan to the user's device. Once the user starts moving, the onboard computer periodically sends location information to the server using the GPS sensor. The server updates the proposed plan as needed based on this location information and real-time traffic and weather information, and resends it to the user's device.

[0486] 5. Emotion recognition and proposal plan adjustment

[0487] The system recognizes the user's emotions using the vehicle's camera and microphone. Using an emotion recognition API, the system analyzes the user's emotional data and adjusts the proposed plan based on their emotional state. For example, if the user is feeling stressed, it will suggest places to relax, and if the user is having fun, it will add spots to maintain that emotion.

[0488] In this way, it is possible to provide personalized proposals based on user attributes, real-time location information, and emotions.

[0489] As a concrete example, if a couple plans a date drive from Shibuya to Kamakura, the system will collect tourist attractions and restaurants between Shibuya and Kamakura and suggest places like sunset spots on Enoshima or quiet cafes in Kita-Kamakura. New suggestions will be made as needed based on real-time location information and conditions during the trip, and if the weather worsens, alternatives such as indoor cafes or stylish bookstores will be suggested.

[0490] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0491] Step 1:

[0492] The user inputs the departure point and destination via the in-car display or smartphone app, as well as the purpose of the trip (e.g., date, solo trip, family trip, etc.). The input information is sent from the device to the server in the form of departure point, destination, and purpose of the trip.

[0493] Step 2:

[0494] The server collects data on tourist spots, restaurants, events, and activities around the specified route and destination based on the received departure and destination information. Web scraping libraries (BeautifulSoup and Scrapy) are used to collect this data. The input is the departure and destination information, and the output is a list of tourist spots, restaurants, events, and activities.

[0495] Step 3:

[0496] The server filters the collected information based on the purpose and user attributes, generating a suggested itinerary that is optimal for the user. A generative AI model (OpenAI GPT-4) is used to create a travel plan based on the collected data and user profile (age, interests, etc.). The input is the collected tourist destination information and user profile, and the output is a filtered suggested itinerary.

[0497] Step 4:

[0498] The server sends the generated proposed plan to the terminal. The user can check the sent proposed plan on the in-car display or smartphone. The input is the proposed plan, and the output is the plan displayed on the user terminal.

[0499] Step 5:

[0500] When a user starts moving, the device periodically transmits location information to the server using the GPS sensor. The input is real-time location information, and the output is the transmission of location information to the server.

[0501] Step 6:

[0502] The server dynamically updates the proposed itinerary based on real-time location information, taking into account current traffic and weather conditions. This includes, for example, suggesting alternative routes when congestion is expected, or indoor activities when the weather worsens. The input is location information and real-time traffic and weather data, and the output is an updated proposed itinerary.

[0503] Step 7:

[0504] The terminal receives the updated proposed plan and displays it to the user in real time. The user can continue their journey based on the new proposals and changes. The input is the updated proposed plan and the output is the updated plan displayed on the user terminal.

[0505] Step 8:

[0506] Using the on-board camera and microphone, the device collects the user's emotional data, including voice input and facial expression detection. The input is the emotional data from the camera and microphone, and the output is the transmission of the emotional data to the server.

[0507] Step 9:

[0508] Using the emotion recognition API, the server analyzes the user's emotional data. Based on the analysis results, the proposed plan is adjusted to match the user's emotional state. For example, if the user is feeling stressed, the server will suggest a place where they can relax. The input is emotional data, and the output is a proposed plan adjusted based on the emotion.

[0509] Step 10:

[0510] The server retransmits the adjusted proposed plan to the terminal, which displays it to the user. The user can adjust their behavior based on the new proposal. The input is the adjusted proposed plan, and the output is the adjusted plan displayed on the user terminal.

[0511] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0512] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0513] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0514] [Second embodiment]

[0515] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0516] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0517] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0518] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0519] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0520] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0521] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0522] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0523] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0524] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0525] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0526] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0527] System Overview

[0528] The present invention is a system that includes a means for inputting a departure point and destination when a user travels, and a means for collecting information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, filtering the collected information based on purpose and attributes to generate a proposed plan, sending the generated proposed plan to the user's terminal, and receiving the user's location information in real time to update the proposed plan according to the situation.

[0529] Program processing

[0530] 1. User Input

[0531] Users input the departure point, destination, route, and purpose of the trip (date, solo trip, family trip, etc.) through an app or web interface on their device (smartphone, tablet, PC). For example, a user might input, "I plan to drive from Shibuya to Kamakura, and the purpose is a date."

[0532] 2. Transmission of User Information

[0533] The device sends the entered information (starting point, destination, route, purpose) to the server. The device sends the data "starting point: Shibuya," "destination: Kamakura," and "purpose: date" to the server.

[0534] 3. Receiving data and preparing for analysis

[0535] The server performs an initial analysis of the received data and determines the required data collection range. The server analyzes the route information for "Shibuya - Kamakura" and determines the destination and the range for collecting information on tourist spots, restaurants, and events along the way.

[0536] 4. Data Collection

[0537] The server runs a generative AI model and collects data on tourist spots, restaurants, events, activities, etc. within a specified area. The server collects information on "romantic sunset spots," "quiet cafes," "seafood restaurants," "art galleries," etc. between Shibuya and Kamakura from the internet and its internal database.

[0538] 5. Data filtering and proposal generation

[0539] Based on the collected information, the server generates suggestions for sightseeing spots and activities suitable for the user's purpose (date), such as "sunset spots in Enoshima," "quiet and cozy cafes in Kita-Kamakura," and "art galleries in Kamakura."

[0540] 6. Submit your proposal

[0541] The server sends the generated proposed plan to the device. The server sends the plan, which includes "Sunset Spots in Enoshima," "Cafes in Kita-Kamakura," and "Art Gallery in Kamakura," to the device.

[0542] 7. View your plan

[0543] The terminal displays the received proposed plan to the user. The terminal displays the proposed plan on a map or in list format, and provides navigation information to the user.

[0544] 8. Real-time location information transmission

[0545] When the user starts moving, the device periodically sends the user's current location information to the server. The device sends the user's current location to the server every 10 minutes.

[0546] 9. Real-time data analysis and proposal updates

[0547] The server receives real-time location information and updates suggestions based on new information and changing conditions (e.g., traffic congestion, weather). If the user is delayed or bad weather is forecast, the server will suggest alternative rest spots, dining spots, and indoor activities.

[0548] 10. Submitting a Resubmission

[0549] The server sends the updated suggestions to the device. The server also sends newly generated information such as "indoor cafes" and "stylish bookstores" to the device.

[0550] 11. Displaying real-time suggestions

[0551] The device will display new suggestions to the user in real time, such as "new cafes" or "places to shelter from bad weather," via pop-ups and notifications.

[0552] Specific examples

[0553] For example, when a couple plans a date drive from Shibuya to Kamakura, the following suggestions are made:

[0554] Departure point: Shibuya

[0555] Destination: Kamakura

[0556] Use: Date

[0557] The server collects tourist spots and restaurants between Shibuya and Kamakura and suggests romantic spots and cafes suitable for dates. Along the way, the server suggests spots such as sunset spots in Enoshima, quiet cafes in Kita-Kamakura, and art galleries in Kamakura. New suggestions are also made based on real-time location information and conditions during travel. For example, in the event of bad weather, alternatives such as indoor cafes or stylish bookstores are suggested.

[0558] In this way, users can enjoy a richer experience while traveling or on the move.

[0559] The processing flow will be explained below.

[0560] Step 1:

[0561] A user inputs the starting point, destination, route, and purpose (date, solo trip, family trip, etc.) via an application on the device or a web interface. For example, a user plans a "drive from Shibuya to Kamakura" and inputs the purpose as "date."

[0562] Step 2:

[0563] The device sends the entered information about the departure point, destination, route, and purpose to the server, along with the user's basic information and attributes (age group, interests, etc.).

[0564] Step 3:

[0565] The server performs an initial analysis of the received data and determines the range of information to be collected. For example, based on the route information "Shibuya - Kamakura," it sets the range to include the destination and tourist spots, restaurants, and event information along the way.

[0566] Step 4:

[0567] The server runs a generative AI model, collecting data on tourist spots, restaurants, events, and activities within a specified area from the internet and an internal database, such as romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[0568] Step 5:

[0569] The server filters the collected information and generates a plan suitable for the purpose and the user's attributes. For example, it might select "sunset spots in Enoshima," "cafes in Kita-Kamakura," and "art galleries in Kamakura" that are suitable for a date.

[0570] Step 6:

[0571] The server then sends the generated proposed plan to the terminal, which includes detailed information about each spot and a navigation guide.

[0572] Step 7:

[0573] The terminal displays the proposed plan to the user on a map or in list format, designed to be intuitive and convenient for the user.

[0574] Step 8:

[0575] When a user starts moving, the device periodically sends the user's current location information to the server. For example, by sending GPS information every 10 minutes, the device can grasp the user's location in real time.

[0576] Step 9:

[0577] The server analyzes the location information sent in real time and updates the proposed plan based on new information and changes in conditions (such as crowding and weather information). If crowding is expected or the weather worsens, the server will suggest alternative tourist spots and indoor activities.

[0578] Step 10:

[0579] The server then sends the updated plan proposal to the device, which includes newly selected locations such as an indoor cafe and a stylish bookstore.

[0580] Step 11:

[0581] The device will display updated proposals to the user in real time, with new proposals and changes indicated to the user through pop-up notifications and changes to map markers.

[0582] This series of processes allows users to enjoy a rich experience while traveling or commuting.

[0583] Example 1

[0584] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0585] Conventional travel planning systems allow users to input information about their departure and destination points, but they lack the ability to dynamically propose plans that respond to real-time changes in circumstances. They also struggle to automatically filter and suggest the best tourist spots and activities for specific purposes and attributes. This leaves users unable to respond to unexpected events or changes in the weather during their trip, resulting in an inadequate travel experience.

[0586] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0587] In this invention, the server includes means for inputting a departure point and destination for a user's trip, means for using an artificial intelligence model to generate and collect information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on purpose and attributes and generating a proposed plan, means for transmitting the generated proposed plan to the user's terminal, and means for receiving the user's location information in real time and updating the proposed plan in response to changes in the situation. This allows the user to receive a dynamic plan that responds to real-time changes in the situation during their trip, enabling them to flexibly respond to unexpected events and changes in the weather.

[0588] definition statement

[0589] The "starting point" is the point where the user begins their journey.

[0590] A "destination" is the point where the user intends to end their journey.

[0591] "Input means" is an interface through which a user provides the origin and destination to the system.

[0592] The "artificial intelligence model that generates information" is an algorithm that analyzes collected data and generates information related to tourist attractions, restaurants, events, and activities.

[0593] A "filtering means" is a method for selecting appropriate information from collected information based on specific conditions.

[0594] The "means for generating a proposed plan" is a method for creating a plan that combines optimal tourist spots and activities based on the user's purpose and attributes.

[0595] The "means for transmitting the proposed plan" refers to a communication protocol and data format for transmitting the generated proposed plan to the user's terminal.

[0596] "Means for receiving location information in real time" means technology for continuously transmitting and receiving a user's current geographical location to a server.

[0597] The "means for updating the proposed plan in response to changes in the situation" refers to a method for reevaluating the proposed plan based on real-time location information and changes in the environment, and generating new proposals as necessary.

[0598] This invention relates to a system that suggests tourist spots, restaurants, events, and activities in response to real-time changes in the user's situation while they are traveling. A specific embodiment of this system is described below.

[0599] User Input

[0600] Users can input the origin, destination, route, and purpose of the trip (e.g., date, solo trip, family trip, etc.) through an app or web interface on their device (smartphone, tablet, PC). For example, a user might input, "I'm planning a drive from Shibuya to Kamakura, and the purpose is a date."

[0601] Sending input information

[0602] The information entered by the user is sent from the device to the server. Specifically, the device compiles the data "Departure: Shibuya," "Destination: Kamakura," and "Purpose: Date" and sends it to the server using the HTTPS protocol.

[0603] Receiving data and preparing for analysis

[0604] The server analyzes the received data and determines the required data collection range. The server analyzes the route information for "Shibuya - Kamakura" and determines the range for collecting information on the destination, tourist spots along the way, restaurants, events, etc.

[0605] Data collection and use of generative AI models

[0606] The server uses the generative AI model to collect data on tourist spots, restaurants, events, activities, etc. within a specified range. For example, between Shibuya and Kamakura, information such as "romantic sunset spots," "quiet cafes," "seafood restaurants," and "art galleries" is collected from the internet and an internal database. An example of a prompt to be input to the generative AI model is "Please suggest the best places for a date between Shibuya and Kamakura."

[0607] Filtering data and generating proposed plans

[0608] The collected information is filtered by the server to select sightseeing spots and activities that best suit the user's needs and attributes. For example, suggestions such as "sunset spots in Enoshima," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura" are generated.

[0609] Submitting and viewing proposals

[0610] The generated proposed plan is sent from the server to the terminal, which displays the received proposed plan on a map or in list format and provides navigation information to the user.

[0611] Real-time location and plan updates

[0612] Once the user begins moving, the device periodically sends the user's current location information to the server. For example, the device obtains the user's current location every 10 minutes and sends it to the server using the HTTPS protocol. The server dynamically updates the proposed plan based on real-time location information and current traffic and weather information. By using the generative AI model again, it can suggest "alternative rest spots" or "indoor activities" in cases such as "when the route is delayed compared to planned" or "when bad weather is forecast." An example of a prompt used in this case is "Please suggest the best rest spot for the current situation."

[0613] Submit and view new proposals

[0614] The updated proposal plan is then sent back to the device from the server, and the device displays the new proposals to the user in real time, such as pop-ups and notifications about new cafes and bad weather shelters.

[0615] In this way, the system of the present invention allows users to receive appropriate suggestions in real time while traveling or moving, enabling them to make comfortable and flexible travel plans.

[0616] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0617] Step 1:

[0618] The user uses the terminal to input the origin, destination, route, and purpose of the trip.

[0619] Specific operation: The user opens the app, enters "Shibuya" as the departure point, "Kamakura" as the destination, and "date" as the purpose, and presses the "Start" button.

[0620] Input: Information entered by the user (origin, destination, purpose, etc.).

[0621] Output: The application validates the information entered and proceeds to the next step.

[0622] Step 2:

[0623] The terminal transmits the input information to the server.

[0624] Specific operation: The device sends the input information to the server using the HTTPS protocol as "Departure: Shibuya," "Destination: Kamakura," and "Purpose: Date." After the transmission is complete, the user is shown the message "Sending."

[0625] Input: Information entered by the user.

[0626] Output: The input information is sent to the server.

[0627] Step 3:

[0628] The server performs an initial analysis of the received data and determines the scope of data collection.

[0629] Specific operation: The server retrieves the distance and route information between "Shibuya and Kamakura" from the database and determines the range of data collection required based on the purpose of the "date."

[0630] Input: Origin, destination, and purpose information sent from the device.

[0631] Output: Identification of data collection area and list of required tourist attractions, places to eat, and event information.

[0632] Step 4:

[0633] The server uses a generative AI model to collect data within a specified range.

[0634] Specific operation: The server collects information on "romantic sunset spots," "quiet cafes," "seafood restaurants," "art galleries," etc. from the Internet and an internal database between "Shibuya and Kamakura." The generative AI model uses the prompt sentence, "Please suggest the best places for a date between Shibuya and Kamakura."

[0635] Input: Data collection scope and collection prompt statement.

[0636] Output: A list of collected tourist attractions, places to eat, events, and activities.

[0637] Step 5:

[0638] The server filters the information and generates a proposed plan.

[0639] How it works: The server selects date spots from the collected data, such as "sunset spots on Enoshima Island," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura City," and prioritizes highly rated data using a scoring algorithm.

[0640] Input: A list of collected tourist attractions, places to eat, events, and activities.

[0641] Output: Optimized proposed plan.

[0642] Step 6:

[0643] The server transmits the generated proposed plan to the terminal.

[0644] Specific operation: The server converts the proposed plan into JSON format and sends it to the terminal via HTTPS. After the transmission is complete, a transmission log is recorded on the server.

[0645] Input: Optimized proposal plan.

[0646] Output: The proposed plan sent to the device.

[0647] Step 7:

[0648] The terminal displays the received proposed plan to the user.

[0649] What it does: The device parses the JSON data, displays the proposed plans on a map or in a list format, and provides navigation information to the user.

[0650] Input: Proposed plan sent by the server.

[0651] Output: The proposed plan that is displayed to the user.

[0652] Step 8:

[0653] When the user starts moving, the terminal periodically transmits the user's current location information to the server.

[0654] How it works: The device uses the GPS sensor to obtain the user's current location every 10 minutes and sends it to the server using the HTTPS protocol. The device's status bar displays the progress of the transfer.

[0655] Input: User's current location.

[0656] Output: Location data sent to the server.

[0657] Step 9:

[0658] The server dynamically updates the proposed plan based on real-time location information, current traffic conditions, and weather information.

[0659] How it works: The server receives real-time location information and the latest weather and congestion data to generate new suggestions. The generative AI model uses a new prompt: "Please suggest the best rest spot for the current situation."

[0660] Input: Real-time location, traffic, and weather information.

[0661] Output: Updated proposed plan.

[0662] Step 10:

[0663] The server sends the updated proposed plan to the terminal.

[0664] Specific operation: The server converts the updated proposal into JSON format and sends it to the device via HTTPS. After sending is complete, the new proposal is recorded in the server history.

[0665] Input: Updated proposed plan.

[0666] Output: The updated proposed plan sent to the device.

[0667] Step 11:

[0668] The terminal displays new suggestions to the user in real time.

[0669] What it does: Your device will notify you of new suggestions via pop-up notifications or in the notification bar, such as "New Cafes" or "Shelter in Bad Weather."

[0670] Input: The updated proposed plan sent from the server.

[0671] Output: Updated suggestions shown to the user in real time.

[0672] (Application example 1)

[0673] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0674] Conventional travel plan generation systems can only provide static suggestions based on predefined tourist destinations and restaurants, and lack the flexibility to adapt to the user's location information or real-time changes in the situation. Furthermore, they do not provide optimal suggestions based on the user's purpose or attributes, so they are unable to fully meet individual needs. Furthermore, in the case of food delivery, the provision of restaurant information based on the user's location information and real-time tracking of delivery status are insufficient, making it difficult to provide optimal suggestions. There is a need to solve these issues.

[0675] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0676] In this invention, the server includes: a means for inputting a user's departure and destination; a means for collecting information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input departure and destination; a means for filtering the collected information based on the user's purpose and attributes and generating a proposed plan; a means for transmitting the generated proposed plan to the user's device; a means for receiving the user's location information in real time and updating the proposed plan according to the situation; and a means for collecting information on nearby restaurants based on the user's location information and providing suggestions based on delivery status. This allows users to receive suggestions for optimal tourist attractions and restaurants even while traveling, enabling flexible planning that responds to real-time changes in the situation. In addition, for food delivery, the server can obtain optimal restaurant information and delivery information based on the user's current location.

[0677] "User" refers to a person or organization that uses the service, and is the person to whom the system makes suggestions based on their location information and input information.

[0678] The "origin" refers to the point where the user begins their journey, and is important information for the system to generate route and destination information.

[0679] The "destination" refers to the point where the user completes their journey and serves as the basis for the system to make suggestions along the way and after arrival.

[0680] "Tourist destinations" refer to places that users should visit based on their interests, including historical buildings and natural landscapes.

[0681] "Food and beverage establishments" refers to establishments that serve food and beverages, including restaurants and cafes.

[0682] "Event" means an activity or event in which users can participate, including concerts and festivals.

[0683] "Activities" refers to experiences and activities that users can undertake, including outdoor sports and workshops.

[0684] "Purpose" refers to the purpose of the user's travel or trip, and can be categorized as a date, family trip, work, etc.

[0685] "Attributes" refer to a user's individual characteristics and preferences, including age, interests, special requests, etc.

[0686] "Proposed Plan" means a trip or travel plan provided to a User by the System, including details of places to visit and activities.

[0687] "Means of collection" refers to the method by which the specified information is obtained from the Internet or internal databases.

[0688] "Filtering means" refers to methods for sorting collected information based on the user's purpose and attributes.

[0689] "Means of receiving in real time" refers to a method for instantly obtaining the user's current location information and situation.

[0690] "Means of updating" refers to methods for modifying the proposed plan based on the user's location information or changes in the situation.

[0691] "Delivery status" refers to the location of the delivery person and the progress of the order in food delivery.

[0692] The system of the present invention allows a user to input their starting point and destination when traveling, collects information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input, filters the collected information based on purpose and attributes, and generates a proposed plan.The system also sends the generated proposed plan to the user's device, receives the user's location information in real time, and updates the proposed plan according to the situation.Furthermore, it collects information on nearby restaurants based on the user's location information and provides suggestions based on delivery status.

[0693] Program processing

[0694] Hardware and software used

[0695] Hardware: Smartphone (iOS, Android, etc.), server PC.

[0696] Software: Python, Requests library, Web API, generative AI models.

[0697] Data processing and calculation

[0698] 1. User input:

[0699] Users input their departure point, destination, and purpose of travel through a smartphone application, such as "Current location: Shinjuku," "Destination: Kyoto," and "Purpose: Sightseeing trip."

[0700] 2. Data Collection:

[0701] The server uses Web APIs, such as the Google Places API and Yelp API, to collect information on tourist attractions, restaurants, events, and activities related to the specified route and destination.

[0702] 3. Information filtering and generation of proposed plans:

[0703] The server uses a generative AI model to filter the collected information based on purpose and attributes to generate optimal proposals, such as prioritizing kid-friendly tourist spots and family restaurants for a family trip.

[0704] 4. Receive real-time location information and update your proposed plan:

[0705] While the user is moving, their device periodically sends their current location information to the server, which receives this information in real time and dynamically updates the proposed plan based on weather, traffic conditions, and other information using the OpenWeatherMap API and Google Maps Traffic API.

[0706] 5. Food delivery suggestions:

[0707] Based on the user's location, the app collects information about nearby restaurants, tracks the delivery person's current location and delivery status in real time, and suggests the most suitable restaurant and menu. Delivery status is updated in real time using a GPS tracking system.

[0708] Specific examples

[0709] For example, if a user plans a sightseeing trip from Shinjuku to Kyoto, the system will collect information on tourist spots such as Shinjuku Station, Kyoto Tower, and the bamboo forests of Arashiyama, as well as Japanese restaurants in Kyoto City and local souvenir shops, and provide the optimal plan. Based on real-time location information during travel, the system will also make new suggestions based on changes in congestion and weather.

[0710] Prompt Sentence Examples

[0711] A user is planning a sightseeing trip from Shinjuku to Kyoto. Suggest attractions, restaurants, events, and activities along the way and at the destination. Also includes new suggestions based on real-time updates.

[0712] In this way, users can find the best tourist spots and restaurants while traveling, and even for food delivery, they can track delivery status in real time and get information on recommended restaurants.

[0713] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0714] Step 1:

[0715] The user inputs the departure point, destination, and purpose into the terminal, which then transmits this information to the server.

[0716] Input: Departure point, destination, purpose (e.g., "Current location: Shinjuku", "Destination: Kyoto", "Purpose: Sightseeing trip")

[0717] Output: User information sent to the server

[0718] Step 2:

[0719] The server receives the departure and destination information sent by the user and collects information related to tourist attractions, restaurants, events, and activities within the specified range.

[0720] Input: User information sent (origin, destination, purpose)

[0721] Data processing: Collect information using Web APIs (e.g., Google Places API, Yelp API)

[0722] Output: Collected information on tourist spots, restaurants, events, and activities

[0723] Step 3:

[0724] The server filters the collected information based on the user's purpose and attributes, and uses a generative AI model to generate the optimal proposed plan.

[0725] Input: Collected tourist destination, restaurant, event, activity information, user purpose and attributes

[0726] Data processing: Filtering process using generative AI models

[0727] Output: Optimal proposed plan

[0728] Step 4:

[0729] The server transmits the generated proposed plan to the user's terminal, which receives the proposed plan and displays it to the user.

[0730] Input: Proposed plan

[0731] Output: Proposed plan sent to user device

[0732] Step 5:

[0733] When the user starts moving, the terminal periodically collects current location information and transmits it to the server.

[0734] Input: Real-time location of the user

[0735] Output: Location information sent to the server

[0736] Step 6:

[0737] The server receives the user's location information in real time, compares it with weather information, traffic conditions, etc., and updates the proposed plan.

[0738] Input: Real-time user location, weather, and traffic information

[0739] Data processing: Analyzing real-time data and updating proposal plans

[0740] Output: Updated proposed plan

[0741] Step 7:

[0742] The server then sends the updated proposal plan to the user's terminal again, and the terminal receives the new proposal plan and notifies the user.

[0743] Input: Updated Proposal Plan

[0744] Output: Updated proposed plan sent to user device

[0745] Step 8:

[0746] Based on the user's location information, the server collects information on nearby restaurants, tracks delivery status in real time, and provides the user with the most suitable restaurant information.

[0747] Input: User's location information, delivery person's current location information

[0748] Output: Information on the best restaurants and delivery status sent to the user's device

[0749] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0750] System Overview

[0751] The present invention is a system including means for inputting a departure point and destination when a user travels, means for collecting information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on purpose and attributes to generate a proposed plan, means for transmitting the generated proposed plan to the user's terminal, means for receiving the user's location information in real time to update the proposed plan according to the situation, and means for recognizing the user's emotions by combining an emotion engine and adjusting the proposed plan based on the recognized emotions.

[0752] Program processing

[0753] 1. User Input

[0754] Users input the departure point, destination, route, and purpose of the trip (date, solo trip, family trip, etc.) through an app or web interface on their device (smartphone, tablet, PC). For example, a user might input, "I plan to drive from Shibuya to Kamakura, and the purpose is a date."

[0755] 2. Transmission of User Information

[0756] The device sends the input information (starting point, destination, route, and purpose) to the server, along with the user's basic information and attributes (age group, interests, etc.).

[0757] 3. Receiving data and preparing for analysis

[0758] The server performs an initial analysis of the received data and determines the range of information to be collected. Based on the route information for "Shibuya - Kamakura," the server sets the range to include the destination and tourist spots, restaurants, and event information along the way.

[0759] 4. Data Collection

[0760] The server runs a generative AI model, collecting data on tourist spots, restaurants, events, and activities within a specified area from the internet and an internal database, such as romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[0761] 5. Data filtering and proposal generation

[0762] The server filters the collected information and generates a plan suitable for the purpose and the user's attributes. For example, it might select a sunset spot in Enoshima, a quiet and pleasant cafe in Kita-Kamakura, or an art gallery in Kamakura that are suitable for a date.

[0763] 6. Submit your proposal

[0764] The server then sends the generated proposed plan to the device, which includes detailed information about each spot and a navigation guide.

[0765] 7. View your plan

[0766] The terminal displays the proposed plan to the user on a map or in list format, designed to be intuitive and convenient for the user.

[0767] 8. Real-time location information transmission

[0768] When a user starts moving, the device periodically sends the user's current location information to the server. For example, by sending GPS information every 10 minutes, the device can grasp the user's location in real time.

[0769] 9. Real-time data analysis and proposal updates

[0770] The server analyzes the location information sent in real time and updates the proposed plan based on new information and changes in conditions (such as crowding and weather information). If crowding is expected or the weather worsens, the server will suggest alternative tourist spots and indoor activities.

[0771] 10. Submitting a Resubmission

[0772] The server then sends the updated plan proposal to the device, which includes newly selected locations such as an indoor cafe and a stylish bookstore.

[0773] 11. Displaying real-time suggestions

[0774] The device will display updated proposals to the user in real time, with new proposals and changes indicated to the user through pop-up notifications and changes to map markers.

[0775] Use of emotion engine

[0776] 1. Collecting Emotional Data

[0777] The device collects emotional data using methods such as voice input, facial expression recognition, and text analysis. For example, it analyzes emotions from facial expressions and voice when a user takes a selfie.

[0778] 2. Sending Emotional Data

[0779] The device sends the collected emotional data to a server, which includes the user's emotional state, such as joy, sadness, anger, and stress.

[0780] 3. Analyzing emotional data and adjusting the proposal plan

[0781] The server analyzes the received emotional data and adjusts the proposed plan based on the user's current emotional state. For example, if the user is feeling stressed, it will increase relaxation spots and entertainment.

[0782] 4. Recommendations based on emotional state

[0783] The server generates suggestions based on the user's emotional state and sends them to the device. For example, if the user is having fun, the server will suggest additional spots to help maintain that emotion.

[0784] Specific examples

[0785] For example, when a couple plans a date drive from Shibuya to Kamakura, the following suggestions are made:

[0786] Departure point: Shibuya

[0787] Destination: Kamakura

[0788] Use: Date

[0789] The server collects tourist spots and restaurants between Shibuya and Kamakura and suggests romantic spots and cafes suitable for dates. Along the way, the server suggests spots such as sunset spots in Enoshima, quiet cafes in Kita-Kamakura, and art galleries in Kamakura. New suggestions are also made based on real-time location information and conditions during travel. For example, in the event of bad weather, alternatives such as indoor cafes or stylish bookstores are suggested.

[0790] Furthermore, the emotion engine recognizes the user's emotions and suggests places to relax if the user is feeling stressed, or suggests additional spots to maintain that emotion if the user is having fun. In this way, users can enjoy a rich experience while traveling.

[0791] The processing flow will be explained below.

[0792] Step 1:

[0793] A user inputs the starting point, destination, route, and purpose (date, solo trip, family trip, etc.) via an application on the device or a web interface. For example, a user plans a "drive from Shibuya to Kamakura" and inputs the purpose as "date."

[0794] Step 2:

[0795] The device sends the entered information about the departure point, destination, route, and purpose to the server, along with the user's basic information and attributes (age group, interests, etc.).

[0796] Step 3:

[0797] The server performs an initial analysis of the received data and determines the range of information to be collected. For example, based on the route information "Shibuya - Kamakura," it sets the range to include the destination and tourist spots, restaurants, and event information along the way.

[0798] Step 4:

[0799] The server runs a generative AI model, collecting data on tourist spots, restaurants, events, and activities within a specified area from the internet and an internal database, such as romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[0800] Step 5:

[0801] The server filters the collected information and generates a plan suitable for the purpose and the user's attributes. For example, it might select a sunset spot in Enoshima, a quiet and pleasant cafe in Kita-Kamakura, or an art gallery in Kamakura that are suitable for a date.

[0802] Step 6:

[0803] The server then sends the generated proposed plan to the terminal, which includes detailed information about each spot and a navigation guide.

[0804] Step 7:

[0805] The terminal displays the received proposed plan to the user in a map or list format, designed to be intuitive for the user.

[0806] Step 8:

[0807] When a user starts moving, the device periodically sends the user's current location information to the server. For example, by sending GPS information every 10 minutes, the device can grasp the user's location in real time.

[0808] Step 9:

[0809] The server analyzes the location information sent in real time and updates the proposed plan based on new information and changes in conditions (such as crowding and weather information). For example, if crowding is expected or the weather worsens, it will suggest alternative tourist spots or indoor activities.

[0810] Step 10:

[0811] The server then sends the updated proposed plan to the terminal, which includes the newly selected "indoor cafe" and "stylish bookstore."

[0812] Step 11:

[0813] The device will display updated proposals to the user in real time, with new proposals and changes indicated to the user through pop-up notifications and changes to map markers.

[0814] Use of emotion engine

[0815] Step 12:

[0816] The device collects emotional data using methods such as voice input, facial expression recognition, and text analysis. For example, it analyzes emotions from facial expressions and voice when a user takes a selfie.

[0817] Step 13:

[0818] The device sends the collected emotional data to a server, which includes the user's emotional state, such as joy, sadness, anger, and stress.

[0819] Step 14:

[0820] The server analyzes the received emotional data and adjusts the proposed plan based on the user's current emotional state. For example, if the user is feeling stressed, it will increase relaxation spots and entertainment.

[0821] Step 15:

[0822] The server generates suggestions based on the user's emotional state and sends them to the device. For example, if the user is having fun, the server will suggest additional spots to help maintain that emotion.

[0823] Step 16:

[0824] The device displays updated proposed plans to the user in real time, and new proposals and changes based on emotional state are indicated to the user through pop-up notifications and changes to map markers.

[0825] In this way, users can enjoy a richer experience while traveling or on the move.

[0826] Example 2

[0827] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0828] In modern travel and mobility, users need to efficiently create plans, including routes and stopovers from their origin to their destination, and dynamically update them according to the situation. They also need to suggest optimal plans based on the user's emotional state and real-time circumstances. However, existing systems are insufficient in suggesting plans tailored to the user's interests and emotional state, and their ability to update suggestions in real time is limited. This makes it difficult for users to have a satisfying travel experience.

[0829] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0830] In this invention, the server includes means for inputting a departure point and destination when a user travels, means for collecting information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on purpose and attributes and generating a proposed plan, means for transmitting the generated proposed plan to the user's terminal, means for receiving the user's location information in real time and updating the proposed plan according to the situation, and means for analyzing the user's emotional state and adjusting the proposed plan based on the emotion. This makes it possible to provide an optimal plan based on the user's interests and real-time situation and emotional state.

[0831] "User" means an individual or entity that uses the System to input origin and destination and receive proposed itineraries.

[0832] "Origin" refers to the location where the user begins their journey.

[0833] "Destination" means the location where a User intends to complete a Trip.

[0834] "Terminal" refers to a device (smartphone, tablet, PC, etc.) that a user uses to input data and receive proposed plans.

[0835] A "server" is a computer system that collects and analyzes information sent by users and generates proposed plans.

[0836] "Means of collecting information" refers to the process of collecting data about tourist attractions, restaurants, events, and activities via the internet and internal databases.

[0837] "Means for filtering information" refers to the process of converting collected data into appropriate proposed plans based on usage and user attributes.

[0838] "Proposed Plan" means a plan including information on tourist attractions, restaurants, events, and activities provided to Users.

[0839] "Means for receiving in real time" refers to the process of periodically obtaining the user's current location information and sending it to the server.

[0840] The "means for updating the proposed plan" is a process for dynamically changing the proposed plan based on the user's location information and changes in conditions (such as congestion or weather changes).

[0841] "Means for analyzing emotional state" refers to the process of determining the user's current emotional state through the user's voice input, facial expression recognition, text analysis, etc.

[0842] The "means for adjusting the proposal plan based on emotions" is a process for modifying and optimizing the proposal plan according to the user's emotional state.

[0843] The present invention is a system that allows a user to input a departure point and destination when traveling. Based on the departure point and destination, the system collects information related to tourist attractions, restaurants, events, and activities along the way and at the destination, filters the information based on purpose and attributes, generates a proposed plan, and sends it to the user's device. The system also has the function of receiving the user's location information in real time and updating the proposed plan according to the situation. Furthermore, by combining it with an emotion engine, the system includes a means for recognizing the user's emotional state and adjusting the proposed plan based on the recognized emotion.

[0844] The system uses the following hardware and software:

[0845] 1. Device (smartphone, tablet, PC, etc.)

[0846] Users input their origin, destination, route, and purpose of the trip through the device, either via an app or web interface.

[0847] 2. Server

[0848] The server receives the information sent by the user (origin, destination, route, and purpose) and performs an initial analysis. Using a generative AI model, the server collects data on tourist spots, restaurants, events, and activities within the specified area from the internet and internal databases. For example, information on romantic spots, cafes, and restaurants between Shibuya and Kamakura is collected.

[0849] 3. Generative AI Models

[0850] The generative AI model filters the collected data and generates a plan proposal suited to the purpose and user attributes. Specifically, it selects suitable date spots such as "sunset spots in Enoshima," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura."

[0851] 4. Submitting and displaying the proposed plan

[0852] The server sends the generated proposed plan to the user's device, which displays it on a map or in a list format. Spots are indicated on the map with markers, and summary information about the spots is provided in the list.

[0853] 5. Real-time location information transmission

[0854] Once the user starts moving, the device will send GPS data to the server every 10 minutes, updating the user's location in real time.

[0855] 6. Real-time data analysis and proposal updates

[0856] The server analyzes real-time location information, traffic conditions, weather information, etc., and updates the proposed plan as needed, for example, suggesting quiet cafes or indoor facilities instead of crowded spots.

[0857] 7. Emotion Engine

[0858] The emotion engine collects emotional data from users through voice input, facial expression recognition, and text analysis, and sends it to the server. The server then analyzes the data and adjusts the recommendation plan based on the user's emotional state. For example, if the user is feeling stressed, the plan will include more relaxation spots.

[0859] Specific examples

[0860] For example, when a couple plans a date drive from Shibuya to Kamakura, the following suggestions are made:

[0861] Departure point: Shibuya

[0862] Destination: Kamakura

[0863] Use: Date

[0864] The server collects tourist spots and restaurants between Shibuya and Kamakura and suggests romantic spots and cafes for dates. Along the way, the server suggests spots like sunset spots in Enoshima, quiet cafes in Kita-Kamakura, and art galleries in Kamakura. New suggestions are also made based on real-time location information and conditions during travel. For example, in the event of bad weather, alternatives like indoor cafes or stylish bookstores are suggested.

[0865] Prompt Sentence Examples

[0866] "Please create a plan for a date drive from Shibuya to Kamakura. Suggest sightseeing spots and places to eat along the way."

[0867] "User is stressed. Can you suggest a spot where they can relax?"

[0868] In this way, users can enjoy their trip while always receiving the best possible suggested plans while on the move.

[0869] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0870] Step 1:

[0871] A user uses a device to input the origin, destination, route, and purpose of the trip. The user provides the input through an app or web interface. For example, the user might input, "I'm planning a drive from Shibuya to Kamakura, and the purpose is a date."

[0872] Input: origin, destination, route, purpose of trip

[0873] Output: Input information is kept in the terminal

[0874] Step 2:

[0875] The device sends the entered information (origin, destination, route, and purpose) to the server, along with basic attribute data such as the user's age group and interests.

[0876] Input: origin, destination, route, purpose of trip, user attribute data

[0877] Output: Input information and attribute data sent to the server

[0878] Step 3:

[0879] The server receives the data and performs an initial analysis. Based on the input information, the server determines the range in which to collect information related to tourist spots, restaurants, events, and activities. For example, it sets the target range based on the route information for "Shibuya - Kamakura."

[0880] Input: Transmitted data (origin, destination, route, purpose of trip, attribute data)

[0881] Output: Identifying the scope of information collection

[0882] Step 4:

[0883] The server runs the generative AI model and collects information within the specified area. Specifically, it collects data on tourist spots, restaurants, events, and activities from the internet and internal databases. For example, it collects information on romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[0884] Input: Identified scope of information collection

[0885] Output: Collected information data

[0886] Step 5:

[0887] The server filters the collected data and generates a proposal plan suited to the purpose and user attributes, for example, selecting "sunset spots in Enoshima," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura."

[0888] Input: Collected information data, user usage, and attribute data

[0889] Output: Proposed plan

[0890] Step 6:

[0891] The server then sends the generated proposed plan to the device, which includes detailed information about each spot and a navigation guide.

[0892] Input: Generated proposal plan

[0893] Output: Proposed plan sent to the device

[0894] Step 7:

[0895] The terminal displays the received proposed plan to the user in a map or list format, designed to be intuitive and easy for the user to understand.

[0896] Input: Proposed plan

[0897] Output: Display proposed plan

[0898] Step 8:

[0899] When the user actually starts moving, the device acquires the user's location information at regular intervals and sends it to the server. For example, it acquires and sends GPS data every 10 minutes.

[0900] Input: User begins moving

[0901] Output: Real-time location information sent to the server

[0902] Step 9:

[0903] The server analyzes real-time location information and dynamically updates the proposed plan, taking into account current congestion and weather conditions, for example, suggesting quiet cafes or indoor facilities instead of crowded spots.

[0904] Input: Real-time location information, current traffic and weather information

[0905] Output: Updated proposed plan

[0906] Step 10:

[0907] The server then sends the updated plan back to the device, including the latest information on things like "indoor cafes" and "stylish bookstores."

[0908] Input: Updated Proposal Plan

[0909] Output: Renewal plan sent to device

[0910] Step 11:

[0911] The device displays updated proposals to the user in real time, and new proposals and changes are instantly communicated to the user through pop-up notifications and changes to the map markers.

[0912] Input: Updated Proposal Plan

[0913] Output: Real-time notification and display

[0914] Step 12:

[0915] The device collects emotional data through the user's voice input, facial expression recognition, text analysis, etc., and sends it to a server. For example, emotions can be analyzed from the user's facial expressions and voice using a camera.

[0916] Input: User voice input, facial expression recognition, text analysis

[0917] Output: Emotion data sent to the server

[0918] Step 13:

[0919] The server analyzes the emotional data and adjusts the proposed plan based on the user's current emotional state: if the user is feeling stressed, it suggests relaxation spots.

[0920] Input: Emotion data

[0921] Output: Suggested plan depending on emotional state

[0922] Step 14:

[0923] The server sends a suggested plan based on the user's emotional state to the device, which then displays it to the user. For example, if the user is having fun, the server suggests additional spots to maintain that emotion.

[0924] Input: Suggested plan based on emotional state

[0925] Output: Proposed plan sent to the terminal and its display

[0926] (Application example 2)

[0927] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0928] In today's world, users need information that will allow them to enjoy a richer experience while traveling. However, conventional systems only provide simple tourist information based on the user's departure and destination, and do not adequately provide suggestions tailored to the user's attributes or real-time situation. They also lack personalized suggestions that take into account the user's emotions. This prevents users from receiving the optimal tourist experience, and further improvements in satisfaction are needed.

[0929] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0930] In this invention, the server includes means for inputting a departure point and destination when a user travels, means for collecting information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on the purpose and attributes and generating a proposed plan, means for transmitting the generated proposed plan to the user's terminal, means for receiving the user's location information in real time and updating the proposed plan according to the situation, and means for recognizing the user's emotions and adjusting the proposed plan based on the user's emotional state. This makes it possible to provide a personalized proposed plan based on the user's attributes, real-time location information, and emotions.

[0931] The "starting point" is the point where the user begins their journey.

[0932] A "destination" is a point that a user sets as the final purpose of their journey.

[0933] A "tourist destination" is a spot where visitors go for sightseeing purposes.

[0934] A "restaurant" is a place where meals are served.

[0935] An "event" is an event or occasion that takes place on a specific date and time.

[0936] "Activities" refers to experiential activities and programs.

[0937] "Means of collecting information" refers to the methods and functions for obtaining the necessary data using the Internet or databases.

[0938] "Means for filtering information" refers to the methods and functions for selecting and organizing collected information based on its purpose and attributes.

[0939] A "proposed plan" is a plan of destinations and activities that are optimal for the user's travel and sightseeing.

[0940] The "transmitting means" refers to a method and function for transmitting the generated proposed plan to the user's terminal.

[0941] "Location information" is data that indicates a user's current location using technologies such as GPS.

[0942] "Means for receiving in real time" refers to the method and function for obtaining user location information without time delay.

[0943] A "means for updating a proposed plan" is a method and function for modifying an existing proposed plan in response to new information or changing circumstances.

[0944] "Means for recognizing emotions" refers to methods and functions that use voice analysis and facial expression analysis to identify the user's emotional state.

[0945] The "means for adjusting the proposed plan based on the emotional state" refers to a method and function for modifying the content of the proposed plan according to the emotion recognition result.

[0946] This invention is a system that allows users to input their departure and destination points when traveling and specify the purpose of the trip (e.g., date, solo trip, family trip, etc.), and provides information about tourist spots, restaurants, events, and activities along the route and at the destination. This system is realized using the following hardware and software.

[0947] Hardware and software used

[0948] 1. Hardware

[0949] On-board computer: A computer installed in a self-driving vehicle.

[0950] GPS sensor: Obtains user location information.

[0951] Camera and microphone: Captures data to recognize user emotions.

[0952] 2. Software

[0953] To collect data, we use Python programs and web scraping libraries such as BeautifulSoup and Scrapy.

[0954] For emotion recognition, use emotion recognition APIs such as Google Cloud Vision API and Microsoft Azure Face API.

[0955] For data analysis, we use Pandas and NumPy.

[0956] The generative AI model is OpenAI's GPT-4.

[0957] System configuration

[0958] 1. User Input

[0959] Users input their origin, destination and purpose of the trip via the in-car display or smartphone app, and this information is sent to the vehicle's computer.

[0960] 2. Data Collection

[0961] The onboard computer uses the internet and internal databases to gather information about tourist spots, restaurants, events, and activities around the designated route and destinations. This data collection is done using a web scraping library.

[0962] 3. Proposal plan generation

[0963] Based on the collected data, a proposed plan is generated that is suited to the user's purpose and attributes. This proposal is made taking into account the user's profile data (age, interests, etc.). OpenAI's GPT-4 is used as the generative AI model, and the following example prompt sentence is used as input to create the proposed plan.

[0964] Prompt Sentence Examples

[0965] User profile: A young couple planning a romantic date drive from Shibuya to Kamakura. They enjoy scenic views and quiet cafes.

[0966] Data: List of tourist spots, cafes, and activities along the route from Shibuya to Kamakura.

[0967] Task: Generate a travel plan suitable for a romantic date drive, ensuring to include scenic spots and quiet cafes.

[0968] 4. Send proposals and update them in real time

[0969] The server sends the generated proposed plan to the user's device. Once the user starts moving, the onboard computer periodically sends location information to the server using the GPS sensor. The server updates the proposed plan as needed based on this location information and real-time traffic and weather information, and resends it to the user's device.

[0970] 5. Emotion recognition and proposal plan adjustment

[0971] The system recognizes the user's emotions using the vehicle's camera and microphone. Using an emotion recognition API, the system analyzes the user's emotional data and adjusts the proposed plan based on their emotional state. For example, if the user is feeling stressed, it will suggest places to relax, and if the user is having fun, it will add spots to maintain that emotion.

[0972] In this way, it is possible to provide personalized proposals based on user attributes, real-time location information, and emotions.

[0973] As a concrete example, if a couple plans a date drive from Shibuya to Kamakura, the system will collect tourist attractions and restaurants between Shibuya and Kamakura and suggest places like sunset spots on Enoshima or quiet cafes in Kita-Kamakura. New suggestions will be made as needed based on real-time location information and conditions during the trip, and if the weather worsens, alternatives such as indoor cafes or stylish bookstores will be suggested.

[0974] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0975] Step 1:

[0976] The user inputs the departure point and destination via the in-car display or smartphone app, as well as the purpose of the trip (e.g., date, solo trip, family trip, etc.). The input information is sent from the device to the server in the form of departure point, destination, and purpose of the trip.

[0977] Step 2:

[0978] The server collects data on tourist spots, restaurants, events, and activities around the specified route and destination based on the received departure and destination information. Web scraping libraries (BeautifulSoup and Scrapy) are used to collect this data. The input is the departure and destination information, and the output is a list of tourist spots, restaurants, events, and activities.

[0979] Step 3:

[0980] The server filters the collected information based on the purpose and user attributes, generating a suggested itinerary that is optimal for the user. A generative AI model (OpenAI GPT-4) is used to create a travel plan based on the collected data and user profile (age, interests, etc.). The input is the collected tourist destination information and user profile, and the output is a filtered suggested itinerary.

[0981] Step 4:

[0982] The server sends the generated proposed plan to the terminal. The user can check the sent proposed plan on the in-car display or smartphone. The input is the proposed plan, and the output is the plan displayed on the user terminal.

[0983] Step 5:

[0984] When a user starts moving, the device periodically transmits location information to the server using the GPS sensor. The input is real-time location information, and the output is the transmission of location information to the server.

[0985] Step 6:

[0986] The server dynamically updates the proposed itinerary based on real-time location information, taking into account current traffic and weather conditions. This includes, for example, suggesting alternative routes when congestion is expected, or indoor activities when the weather worsens. The input is location information and real-time traffic and weather data, and the output is an updated proposed itinerary.

[0987] Step 7:

[0988] The terminal receives the updated proposed plan and displays it to the user in real time. The user can continue their journey based on the new proposals and changes. The input is the updated proposed plan and the output is the updated plan displayed on the user terminal.

[0989] Step 8:

[0990] Using the on-board camera and microphone, the device collects the user's emotional data, including voice input and facial expression detection. The input is the emotional data from the camera and microphone, and the output is the transmission of the emotional data to the server.

[0991] Step 9:

[0992] Using the emotion recognition API, the server analyzes the user's emotional data. Based on the analysis results, the proposed plan is adjusted to match the user's emotional state. For example, if the user is feeling stressed, the server will suggest a place where they can relax. The input is emotional data, and the output is a proposed plan adjusted based on the emotion.

[0993] Step 10:

[0994] The server retransmits the adjusted proposed plan to the terminal, which displays it to the user. The user can adjust their behavior based on the new proposal. The input is the adjusted proposed plan, and the output is the adjusted plan displayed on the user terminal.

[0995] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0996] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0997] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0998] [Third embodiment]

[0999] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1000] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1001] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1002] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1003] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1004] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1005] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1006] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1007] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1008] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1009] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1010] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1011] System Overview

[1012] The present invention is a system that includes a means for inputting a departure point and destination when a user travels, and a means for collecting information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, filtering the collected information based on purpose and attributes to generate a proposed plan, sending the generated proposed plan to the user's terminal, and receiving the user's location information in real time to update the proposed plan according to the situation.

[1013] Program processing

[1014] 1. User Input

[1015] Users input the departure point, destination, route, and purpose of the trip (date, solo trip, family trip, etc.) through an app or web interface on their device (smartphone, tablet, PC). For example, a user might input, "I plan to drive from Shibuya to Kamakura, and the purpose is a date."

[1016] 2. Transmission of User Information

[1017] The device sends the entered information (starting point, destination, route, purpose) to the server. The device sends the data "starting point: Shibuya," "destination: Kamakura," and "purpose: date" to the server.

[1018] 3. Receiving data and preparing for analysis

[1019] The server performs an initial analysis of the received data and determines the required data collection range. The server analyzes the route information for "Shibuya - Kamakura" and determines the destination and the range for collecting information on tourist spots, restaurants, and events along the way.

[1020] 4. Data Collection

[1021] The server runs a generative AI model and collects data on tourist spots, restaurants, events, activities, etc. within a specified area. The server collects information on "romantic sunset spots," "quiet cafes," "seafood restaurants," "art galleries," etc. between Shibuya and Kamakura from the internet and its internal database.

[1022] 5. Data filtering and proposal generation

[1023] Based on the collected information, the server generates suggestions for sightseeing spots and activities suitable for the user's purpose (date), such as "sunset spots in Enoshima," "quiet and cozy cafes in Kita-Kamakura," and "art galleries in Kamakura."

[1024] 6. Submit your proposal

[1025] The server sends the generated proposed plan to the device. The server sends the plan, which includes "Sunset Spots in Enoshima," "Cafes in Kita-Kamakura," and "Art Gallery in Kamakura," to the device.

[1026] 7. View your plan

[1027] The terminal displays the received proposed plan to the user. The terminal displays the proposed plan on a map or in list format, and provides navigation information to the user.

[1028] 8. Real-time location information transmission

[1029] When the user starts moving, the device periodically sends the user's current location information to the server. The device sends the user's current location to the server every 10 minutes.

[1030] 9. Real-time data analysis and proposal updates

[1031] The server receives real-time location information and updates suggestions based on new information and changing conditions (e.g., traffic congestion, weather). If the user is delayed or bad weather is forecast, the server will suggest alternative rest spots, dining spots, and indoor activities.

[1032] 10. Submitting a Resubmission

[1033] The server sends the updated suggestions to the device. The server also sends newly generated information such as "indoor cafes" and "stylish bookstores" to the device.

[1034] 11. Displaying real-time suggestions

[1035] The device will display new suggestions to the user in real time, such as "new cafes" or "places to shelter from bad weather," via pop-ups and notifications.

[1036] Specific examples

[1037] For example, when a couple plans a date drive from Shibuya to Kamakura, the following suggestions are made:

[1038] Departure point: Shibuya

[1039] Destination: Kamakura

[1040] Use: Date

[1041] The server collects tourist spots and restaurants between Shibuya and Kamakura and suggests romantic spots and cafes suitable for dates. Along the way, the server suggests spots such as sunset spots in Enoshima, quiet cafes in Kita-Kamakura, and art galleries in Kamakura. New suggestions are also made based on real-time location information and conditions during travel. For example, in the event of bad weather, alternatives such as indoor cafes or stylish bookstores are suggested.

[1042] In this way, users can enjoy a richer experience while traveling or on the move.

[1043] The processing flow will be explained below.

[1044] Step 1:

[1045] A user inputs the starting point, destination, route, and purpose (date, solo trip, family trip, etc.) via an application on the device or a web interface. For example, a user plans a "drive from Shibuya to Kamakura" and inputs the purpose as "date."

[1046] Step 2:

[1047] The device sends the entered information about the departure point, destination, route, and purpose to the server, along with the user's basic information and attributes (age group, interests, etc.).

[1048] Step 3:

[1049] The server performs an initial analysis of the received data and determines the range of information to be collected. For example, based on the route information "Shibuya - Kamakura," it sets the range to include the destination and tourist spots, restaurants, and event information along the way.

[1050] Step 4:

[1051] The server runs a generative AI model, collecting data on tourist spots, restaurants, events, and activities within a specified area from the internet and an internal database, such as romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[1052] Step 5:

[1053] The server filters the collected information and generates a plan suitable for the purpose and the user's attributes. For example, it might select "sunset spots in Enoshima," "cafes in Kita-Kamakura," and "art galleries in Kamakura" that are suitable for a date.

[1054] Step 6:

[1055] The server then sends the generated proposed plan to the terminal, which includes detailed information about each spot and a navigation guide.

[1056] Step 7:

[1057] The terminal displays the proposed plan to the user on a map or in list format, designed to be intuitive and convenient for the user.

[1058] Step 8:

[1059] When a user starts moving, the device periodically sends the user's current location information to the server. For example, by sending GPS information every 10 minutes, the device can grasp the user's location in real time.

[1060] Step 9:

[1061] The server analyzes the location information sent in real time and updates the proposed plan based on new information and changes in conditions (such as crowding and weather information). If crowding is expected or the weather worsens, the server will suggest alternative tourist spots and indoor activities.

[1062] Step 10:

[1063] The server then sends the updated plan proposal to the device, which includes newly selected locations such as an indoor cafe and a stylish bookstore.

[1064] Step 11:

[1065] The device will display updated proposals to the user in real time, with new proposals and changes indicated to the user through pop-up notifications and changes to map markers.

[1066] This series of processes allows users to enjoy a rich experience while traveling or commuting.

[1067] Example 1

[1068] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1069] Conventional travel planning systems allow users to input information about their departure and destination points, but they lack the ability to dynamically propose plans that respond to real-time changes in circumstances. They also struggle to automatically filter and suggest the best tourist spots and activities for specific purposes and attributes. This leaves users unable to respond to unexpected events or changes in the weather during their trip, resulting in an inadequate travel experience.

[1070] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1071] In this invention, the server includes means for inputting a departure point and destination for a user's trip, means for using an artificial intelligence model to generate and collect information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on purpose and attributes and generating a proposed plan, means for transmitting the generated proposed plan to the user's terminal, and means for receiving the user's location information in real time and updating the proposed plan in response to changes in the situation. This allows the user to receive a dynamic plan that responds to real-time changes in the situation during their trip, enabling them to flexibly respond to unexpected events and changes in the weather.

[1072] definition statement

[1073] The "starting point" is the point where the user begins their journey.

[1074] A "destination" is the point where the user intends to end their journey.

[1075] "Input means" is an interface through which a user provides the origin and destination to the system.

[1076] The "artificial intelligence model that generates information" is an algorithm that analyzes collected data and generates information related to tourist attractions, restaurants, events, and activities.

[1077] A "filtering means" is a method for selecting appropriate information from collected information based on specific conditions.

[1078] The "means for generating a proposed plan" is a method for creating a plan that combines optimal tourist spots and activities based on the user's purpose and attributes.

[1079] The "means for transmitting the proposed plan" refers to a communication protocol and data format for transmitting the generated proposed plan to the user's terminal.

[1080] "Means for receiving location information in real time" means technology for continuously transmitting and receiving a user's current geographical location to a server.

[1081] The "means for updating the proposed plan in response to changes in the situation" refers to a method for reevaluating the proposed plan based on real-time location information and changes in the environment, and generating new proposals as necessary.

[1082] This invention relates to a system that suggests tourist spots, restaurants, events, and activities in response to real-time changes in the user's situation while they are traveling. A specific embodiment of this system is described below.

[1083] User Input

[1084] Users can input the origin, destination, route, and purpose of the trip (e.g., date, solo trip, family trip, etc.) through an app or web interface on their device (smartphone, tablet, PC). For example, a user might input, "I'm planning a drive from Shibuya to Kamakura, and the purpose is a date."

[1085] Sending input information

[1086] The information entered by the user is sent from the device to the server. Specifically, the device compiles the data "Departure: Shibuya," "Destination: Kamakura," and "Purpose: Date" and sends it to the server using the HTTPS protocol.

[1087] Receiving data and preparing for analysis

[1088] The server analyzes the received data and determines the required data collection range. The server analyzes the route information for "Shibuya - Kamakura" and determines the range for collecting information on the destination, tourist spots along the way, restaurants, events, etc.

[1089] Data collection and use of generative AI models

[1090] The server uses the generative AI model to collect data on tourist spots, restaurants, events, activities, etc. within a specified range. For example, between Shibuya and Kamakura, information such as "romantic sunset spots," "quiet cafes," "seafood restaurants," and "art galleries" is collected from the internet and an internal database. An example of a prompt to be input to the generative AI model is "Please suggest the best places for a date between Shibuya and Kamakura."

[1091] Filtering data and generating proposed plans

[1092] The collected information is filtered by the server to select sightseeing spots and activities that best suit the user's needs and attributes. For example, suggestions such as "sunset spots in Enoshima," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura" are generated.

[1093] Submitting and viewing proposals

[1094] The generated proposed plan is sent from the server to the terminal, which displays the received proposed plan on a map or in list format and provides navigation information to the user.

[1095] Real-time location and plan updates

[1096] Once the user begins moving, the device periodically sends the user's current location information to the server. For example, the device obtains the user's current location every 10 minutes and sends it to the server using the HTTPS protocol. The server dynamically updates the proposed plan based on real-time location information and current traffic and weather information. By using the generative AI model again, it can suggest "alternative rest spots" or "indoor activities" in cases such as "when the route is delayed compared to planned" or "when bad weather is forecast." An example of a prompt used in this case is "Please suggest the best rest spot for the current situation."

[1097] Submit and view new proposals

[1098] The updated proposal plan is then sent back to the device from the server, and the device displays the new proposals to the user in real time, such as pop-ups and notifications about new cafes and bad weather shelters.

[1099] In this way, the system of the present invention allows users to receive appropriate suggestions in real time while traveling or moving, enabling them to make comfortable and flexible travel plans.

[1100] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1101] Step 1:

[1102] The user uses the terminal to input the origin, destination, route, and purpose of the trip.

[1103] Specific operation: The user opens the app, enters "Shibuya" as the departure point, "Kamakura" as the destination, and "date" as the purpose, and presses the "Start" button.

[1104] Input: Information entered by the user (origin, destination, purpose, etc.).

[1105] Output: The application validates the information entered and proceeds to the next step.

[1106] Step 2:

[1107] The terminal transmits the input information to the server.

[1108] Specific operation: The device sends the input information to the server using the HTTPS protocol as "Departure: Shibuya," "Destination: Kamakura," and "Purpose: Date." After the transmission is complete, the user is shown the message "Sending."

[1109] Input: Information entered by the user.

[1110] Output: The input information is sent to the server.

[1111] Step 3:

[1112] The server performs an initial analysis of the received data and determines the scope of data collection.

[1113] Specific operation: The server retrieves the distance and route information between "Shibuya and Kamakura" from the database and determines the range of data collection required based on the purpose of the "date."

[1114] Input: Origin, destination, and purpose information sent from the device.

[1115] Output: Identification of data collection area and list of required tourist attractions, places to eat, and event information.

[1116] Step 4:

[1117] The server uses a generative AI model to collect data within a specified range.

[1118] Specific operation: The server collects information on "romantic sunset spots," "quiet cafes," "seafood restaurants," "art galleries," etc. from the Internet and an internal database between "Shibuya and Kamakura." The generative AI model uses the prompt sentence, "Please suggest the best places for a date between Shibuya and Kamakura."

[1119] Input: Data collection scope and collection prompt statement.

[1120] Output: A list of collected tourist attractions, places to eat, events, and activities.

[1121] Step 5:

[1122] The server filters the information and generates a proposed plan.

[1123] How it works: The server selects date spots from the collected data, such as "sunset spots on Enoshima Island," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura City," and prioritizes highly rated data using a scoring algorithm.

[1124] Input: A list of collected tourist attractions, places to eat, events, and activities.

[1125] Output: Optimized proposed plan.

[1126] Step 6:

[1127] The server transmits the generated proposed plan to the terminal.

[1128] Specific operation: The server converts the proposed plan into JSON format and sends it to the terminal via HTTPS. After the transmission is complete, a transmission log is recorded on the server.

[1129] Input: Optimized proposal plan.

[1130] Output: The proposed plan sent to the device.

[1131] Step 7:

[1132] The terminal displays the received proposed plan to the user.

[1133] What it does: The device parses the JSON data, displays the proposed plans on a map or in a list format, and provides navigation information to the user.

[1134] Input: Proposed plan sent by the server.

[1135] Output: The proposed plan that is displayed to the user.

[1136] Step 8:

[1137] When the user starts moving, the terminal periodically transmits the user's current location information to the server.

[1138] How it works: The device uses the GPS sensor to obtain the user's current location every 10 minutes and sends it to the server using the HTTPS protocol. The device's status bar displays the progress of the transfer.

[1139] Input: User's current location.

[1140] Output: Location data sent to the server.

[1141] Step 9:

[1142] The server dynamically updates the proposed plan based on real-time location information, current traffic conditions, and weather information.

[1143] How it works: The server receives real-time location information and the latest weather and congestion data to generate new suggestions. The generative AI model uses a new prompt: "Please suggest the best rest spot for the current situation."

[1144] Input: Real-time location, traffic, and weather information.

[1145] Output: Updated proposed plan.

[1146] Step 10:

[1147] The server sends the updated proposed plan to the terminal.

[1148] Specific operation: The server converts the updated proposal into JSON format and sends it to the device via HTTPS. After sending is complete, the new proposal is recorded in the server history.

[1149] Input: Updated proposed plan.

[1150] Output: The updated proposed plan sent to the device.

[1151] Step 11:

[1152] The terminal displays new suggestions to the user in real time.

[1153] What it does: Your device will notify you of new suggestions via pop-up notifications or in the notification bar, such as "New Cafes" or "Shelter in Bad Weather."

[1154] Input: The updated proposed plan sent from the server.

[1155] Output: Updated suggestions shown to the user in real time.

[1156] (Application example 1)

[1157] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1158] Conventional travel plan generation systems can only provide static suggestions based on predefined tourist destinations and restaurants, and lack the flexibility to adapt to the user's location information or real-time changes in the situation. Furthermore, they do not provide optimal suggestions based on the user's purpose or attributes, so they are unable to fully meet individual needs. Furthermore, in the case of food delivery, the provision of restaurant information based on the user's location information and real-time tracking of delivery status are insufficient, making it difficult to provide optimal suggestions. There is a need to solve these issues.

[1159] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1160] In this invention, the server includes: a means for inputting a user's departure and destination; a means for collecting information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input departure and destination; a means for filtering the collected information based on the user's purpose and attributes and generating a proposed plan; a means for transmitting the generated proposed plan to the user's device; a means for receiving the user's location information in real time and updating the proposed plan according to the situation; and a means for collecting information on nearby restaurants based on the user's location information and providing suggestions based on delivery status. This allows users to receive suggestions for optimal tourist attractions and restaurants even while traveling, enabling flexible planning that responds to real-time changes in the situation. In addition, for food delivery, the server can obtain optimal restaurant information and delivery information based on the user's current location.

[1161] "User" refers to a person or organization that uses the service, and is the person to whom the system makes suggestions based on their location information and input information.

[1162] The "origin" refers to the point where the user begins their journey, and is important information for the system to generate route and destination information.

[1163] The "destination" refers to the point where the user completes their journey and serves as the basis for the system to make suggestions along the way and after arrival.

[1164] "Tourist destinations" refer to places that users should visit based on their interests, including historical buildings and natural landscapes.

[1165] "Food and beverage establishments" refers to establishments that serve food and beverages, including restaurants and cafes.

[1166] "Event" means an activity or event in which users can participate, including concerts and festivals.

[1167] "Activities" refers to experiences and activities that users can undertake, including outdoor sports and workshops.

[1168] "Purpose" refers to the purpose of the user's travel or trip, and can be categorized as a date, family trip, work, etc.

[1169] "Attributes" refer to a user's individual characteristics and preferences, including age, interests, special requests, etc.

[1170] "Proposed Plan" means a trip or travel plan provided to a User by the System, including details of places to visit and activities.

[1171] "Means of collection" refers to the method by which the specified information is obtained from the Internet or internal databases.

[1172] "Filtering means" refers to methods for sorting collected information based on the user's purpose and attributes.

[1173] "Means of receiving in real time" refers to a method for instantly obtaining the user's current location information and situation.

[1174] "Means of updating" refers to methods for modifying the proposed plan based on the user's location information or changes in the situation.

[1175] "Delivery status" refers to the location of the delivery person and the progress of the order in food delivery.

[1176] The system of the present invention allows a user to input their starting point and destination when traveling, collects information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input, filters the collected information based on purpose and attributes, and generates a proposed plan.The system also sends the generated proposed plan to the user's device, receives the user's location information in real time, and updates the proposed plan according to the situation.Furthermore, it collects information on nearby restaurants based on the user's location information and provides suggestions based on delivery status.

[1177] Program processing

[1178] Hardware and software used

[1179] Hardware: Smartphone (iOS, Android, etc.), server PC.

[1180] Software: Python, Requests library, Web API, generative AI models.

[1181] Data processing and calculation

[1182] 1. User input:

[1183] Users input their departure point, destination, and purpose of travel through a smartphone application, such as "Current location: Shinjuku," "Destination: Kyoto," and "Purpose: Sightseeing trip."

[1184] 2. Data Collection:

[1185] The server uses Web APIs, such as the Google Places API and Yelp API, to collect information on tourist attractions, restaurants, events, and activities related to the specified route and destination.

[1186] 3. Information filtering and generation of proposed plans:

[1187] The server uses a generative AI model to filter the collected information based on purpose and attributes to generate optimal proposals, such as prioritizing kid-friendly tourist spots and family restaurants for a family trip.

[1188] 4. Receive real-time location information and update your proposed plan:

[1189] While the user is moving, their device periodically sends their current location information to the server, which receives this information in real time and dynamically updates the proposed plan based on weather, traffic conditions, and other information using the OpenWeatherMap API and Google Maps Traffic API.

[1190] 5. Food delivery suggestions:

[1191] Based on the user's location, the app collects information about nearby restaurants, tracks the delivery person's current location and delivery status in real time, and suggests the most suitable restaurant and menu. Delivery status is updated in real time using a GPS tracking system.

[1192] Specific examples

[1193] For example, if a user plans a sightseeing trip from Shinjuku to Kyoto, the system will collect information on tourist spots such as Shinjuku Station, Kyoto Tower, and the bamboo forests of Arashiyama, as well as Japanese restaurants in Kyoto City and local souvenir shops, and provide the optimal plan. Based on real-time location information during travel, the system will also make new suggestions based on changes in congestion and weather.

[1194] Prompt Sentence Examples

[1195] A user is planning a sightseeing trip from Shinjuku to Kyoto. Suggest attractions, restaurants, events, and activities along the way and at the destination. Also includes new suggestions based on real-time updates.

[1196] In this way, users can find the best tourist spots and restaurants while traveling, and even for food delivery, they can track delivery status in real time and get information on recommended restaurants.

[1197] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1198] Step 1:

[1199] The user inputs the departure point, destination, and purpose into the terminal, which then transmits this information to the server.

[1200] Input: Departure point, destination, purpose (e.g., "Current location: Shinjuku", "Destination: Kyoto", "Purpose: Sightseeing trip")

[1201] Output: User information sent to the server

[1202] Step 2:

[1203] The server receives the departure and destination information sent by the user and collects information related to tourist attractions, restaurants, events, and activities within the specified range.

[1204] Input: User information sent (origin, destination, purpose)

[1205] Data processing: Collect information using Web APIs (e.g., Google Places API, Yelp API)

[1206] Output: Collected information on tourist spots, restaurants, events, and activities

[1207] Step 3:

[1208] The server filters the collected information based on the user's purpose and attributes, and uses a generative AI model to generate the optimal proposed plan.

[1209] Input: Collected tourist destination, restaurant, event, activity information, user purpose and attributes

[1210] Data processing: Filtering process using generative AI models

[1211] Output: Optimal proposed plan

[1212] Step 4:

[1213] The server transmits the generated proposed plan to the user's terminal, which receives the proposed plan and displays it to the user.

[1214] Input: Proposed plan

[1215] Output: Proposed plan sent to user device

[1216] Step 5:

[1217] When the user starts moving, the terminal periodically collects current location information and transmits it to the server.

[1218] Input: Real-time location of the user

[1219] Output: Location information sent to the server

[1220] Step 6:

[1221] The server receives the user's location information in real time, compares it with weather information, traffic conditions, etc., and updates the proposed plan.

[1222] Input: Real-time user location, weather, and traffic information

[1223] Data processing: Analyzing real-time data and updating proposal plans

[1224] Output: Updated proposed plan

[1225] Step 7:

[1226] The server then sends the updated proposal plan to the user's terminal again, and the terminal receives the new proposal plan and notifies the user.

[1227] Input: Updated Proposal Plan

[1228] Output: Updated proposed plan sent to user device

[1229] Step 8:

[1230] Based on the user's location information, the server collects information on nearby restaurants, tracks delivery status in real time, and provides the user with the most suitable restaurant information.

[1231] Input: User's location information, delivery person's current location information

[1232] Output: Information on the best restaurants and delivery status sent to the user's device

[1233] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1234] System Overview

[1235] The present invention is a system including means for inputting a departure point and destination when a user travels, means for collecting information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on purpose and attributes to generate a proposed plan, means for transmitting the generated proposed plan to the user's terminal, means for receiving the user's location information in real time to update the proposed plan according to the situation, and means for recognizing the user's emotions by combining an emotion engine and adjusting the proposed plan based on the recognized emotions.

[1236] Program processing

[1237] 1. User Input

[1238] Users input the departure point, destination, route, and purpose of the trip (date, solo trip, family trip, etc.) through an app or web interface on their device (smartphone, tablet, PC). For example, a user might input, "I plan to drive from Shibuya to Kamakura, and the purpose is a date."

[1239] 2. Transmission of User Information

[1240] The device sends the input information (starting point, destination, route, and purpose) to the server, along with the user's basic information and attributes (age group, interests, etc.).

[1241] 3. Receiving data and preparing for analysis

[1242] The server performs an initial analysis of the received data and determines the range of information to be collected. Based on the route information for "Shibuya - Kamakura," the server sets the range to include the destination and tourist spots, restaurants, and event information along the way.

[1243] 4. Data Collection

[1244] The server runs a generative AI model, collecting data on tourist spots, restaurants, events, and activities within a specified area from the internet and an internal database, such as romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[1245] 5. Data filtering and proposal generation

[1246] The server filters the collected information and generates a plan suitable for the purpose and the user's attributes. For example, it might select a sunset spot in Enoshima, a quiet and pleasant cafe in Kita-Kamakura, or an art gallery in Kamakura that are suitable for a date.

[1247] 6. Submit your proposal

[1248] The server then sends the generated proposed plan to the device, which includes detailed information about each spot and a navigation guide.

[1249] 7. View your plan

[1250] The terminal displays the proposed plan to the user on a map or in list format, designed to be intuitive and convenient for the user.

[1251] 8. Real-time location information transmission

[1252] When a user starts moving, the device periodically sends the user's current location information to the server. For example, by sending GPS information every 10 minutes, the device can grasp the user's location in real time.

[1253] 9. Real-time data analysis and proposal updates

[1254] The server analyzes the location information sent in real time and updates the proposed plan based on new information and changes in conditions (such as crowding and weather information). If crowding is expected or the weather worsens, the server will suggest alternative tourist spots and indoor activities.

[1255] 10. Submitting a Resubmission

[1256] The server then sends the updated plan proposal to the device, which includes newly selected locations such as an indoor cafe and a stylish bookstore.

[1257] 11. Displaying real-time suggestions

[1258] The device will display updated proposals to the user in real time, with new proposals and changes indicated to the user through pop-up notifications and changes to map markers.

[1259] Use of emotion engine

[1260] 1. Collecting Emotional Data

[1261] The device collects emotional data using methods such as voice input, facial expression recognition, and text analysis. For example, it analyzes emotions from facial expressions and voice when a user takes a selfie.

[1262] 2. Sending Emotional Data

[1263] The device sends the collected emotional data to a server, which includes the user's emotional state, such as joy, sadness, anger, and stress.

[1264] 3. Analyzing emotional data and adjusting the proposal plan

[1265] The server analyzes the received emotional data and adjusts the proposed plan based on the user's current emotional state. For example, if the user is feeling stressed, it will increase relaxation spots and entertainment.

[1266] 4. Recommendations based on emotional state

[1267] The server generates suggestions based on the user's emotional state and sends them to the device. For example, if the user is having fun, the server will suggest additional spots to help maintain that emotion.

[1268] Specific examples

[1269] For example, when a couple plans a date drive from Shibuya to Kamakura, the following suggestions are made:

[1270] Departure point: Shibuya

[1271] Destination: Kamakura

[1272] Use: Date

[1273] The server collects tourist spots and restaurants between Shibuya and Kamakura and suggests romantic spots and cafes suitable for dates. Along the way, the server suggests spots such as sunset spots in Enoshima, quiet cafes in Kita-Kamakura, and art galleries in Kamakura. New suggestions are also made based on real-time location information and conditions during travel. For example, in the event of bad weather, alternatives such as indoor cafes or stylish bookstores are suggested.

[1274] Furthermore, the emotion engine recognizes the user's emotions and suggests places to relax if the user is feeling stressed, or suggests additional spots to maintain that emotion if the user is having fun. In this way, users can enjoy a rich experience while traveling.

[1275] The processing flow will be explained below.

[1276] Step 1:

[1277] A user inputs the starting point, destination, route, and purpose (date, solo trip, family trip, etc.) via an application on the device or a web interface. For example, a user plans a "drive from Shibuya to Kamakura" and inputs the purpose as "date."

[1278] Step 2:

[1279] The device sends the entered information about the departure point, destination, route, and purpose to the server, along with the user's basic information and attributes (age group, interests, etc.).

[1280] Step 3:

[1281] The server performs an initial analysis of the received data and determines the range of information to be collected. For example, based on the route information "Shibuya - Kamakura," it sets the range to include the destination and tourist spots, restaurants, and event information along the way.

[1282] Step 4:

[1283] The server runs a generative AI model, collecting data on tourist spots, restaurants, events, and activities within a specified area from the internet and an internal database, such as romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[1284] Step 5:

[1285] The server filters the collected information and generates a plan suitable for the purpose and the user's attributes. For example, it might select a sunset spot in Enoshima, a quiet and pleasant cafe in Kita-Kamakura, or an art gallery in Kamakura that are suitable for a date.

[1286] Step 6:

[1287] The server then sends the generated proposed plan to the terminal, which includes detailed information about each spot and a navigation guide.

[1288] Step 7:

[1289] The terminal displays the received proposed plan to the user in a map or list format, designed to be intuitive for the user.

[1290] Step 8:

[1291] When a user starts moving, the device periodically sends the user's current location information to the server. For example, by sending GPS information every 10 minutes, the device can grasp the user's location in real time.

[1292] Step 9:

[1293] The server analyzes the location information sent in real time and updates the proposed plan based on new information and changes in conditions (such as crowding and weather information). For example, if crowding is expected or the weather worsens, it will suggest alternative tourist spots or indoor activities.

[1294] Step 10:

[1295] The server then sends the updated proposed plan to the terminal, which includes the newly selected "indoor cafe" and "stylish bookstore."

[1296] Step 11:

[1297] The device will display updated proposals to the user in real time, with new proposals and changes indicated to the user through pop-up notifications and changes to map markers.

[1298] Use of emotion engine

[1299] Step 12:

[1300] The device collects emotional data using methods such as voice input, facial expression recognition, and text analysis. For example, it analyzes emotions from facial expressions and voice when a user takes a selfie.

[1301] Step 13:

[1302] The device sends the collected emotional data to a server, which includes the user's emotional state, such as joy, sadness, anger, and stress.

[1303] Step 14:

[1304] The server analyzes the received emotional data and adjusts the proposed plan based on the user's current emotional state. For example, if the user is feeling stressed, it will increase relaxation spots and entertainment.

[1305] Step 15:

[1306] The server generates suggestions based on the user's emotional state and sends them to the device. For example, if the user is having fun, the server will suggest additional spots to help maintain that emotion.

[1307] Step 16:

[1308] The device displays updated proposed plans to the user in real time, and new proposals and changes based on emotional state are indicated to the user through pop-up notifications and changes to map markers.

[1309] In this way, users can enjoy a richer experience while traveling or on the move.

[1310] Example 2

[1311] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1312] In modern travel and mobility, users need to efficiently create plans, including routes and stopovers from their origin to their destination, and dynamically update them according to the situation. They also need to suggest optimal plans based on the user's emotional state and real-time circumstances. However, existing systems are insufficient in suggesting plans tailored to the user's interests and emotional state, and their ability to update suggestions in real time is limited. This makes it difficult for users to have a satisfying travel experience.

[1313] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1314] In this invention, the server includes means for inputting a departure point and destination when a user travels, means for collecting information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on purpose and attributes and generating a proposed plan, means for transmitting the generated proposed plan to the user's terminal, means for receiving the user's location information in real time and updating the proposed plan according to the situation, and means for analyzing the user's emotional state and adjusting the proposed plan based on the emotion. This makes it possible to provide an optimal plan based on the user's interests and real-time situation and emotional state.

[1315] "User" means an individual or entity that uses the System to input origin and destination and receive proposed itineraries.

[1316] "Origin" refers to the location where the user begins their journey.

[1317] "Destination" means the location where a User intends to complete a Trip.

[1318] "Terminal" refers to a device (smartphone, tablet, PC, etc.) that a user uses to input data and receive proposed plans.

[1319] A "server" is a computer system that collects and analyzes information sent by users and generates proposed plans.

[1320] "Means of collecting information" refers to the process of collecting data about tourist attractions, restaurants, events, and activities via the internet and internal databases.

[1321] "Means for filtering information" refers to the process of converting collected data into appropriate proposed plans based on usage and user attributes.

[1322] "Proposed Plan" means a plan including information on tourist attractions, restaurants, events, and activities provided to Users.

[1323] "Means for receiving in real time" refers to the process of periodically obtaining the user's current location information and sending it to the server.

[1324] The "means for updating the proposed plan" is a process for dynamically changing the proposed plan based on the user's location information and changes in conditions (such as congestion or weather changes).

[1325] "Means for analyzing emotional state" refers to the process of determining the user's current emotional state through the user's voice input, facial expression recognition, text analysis, etc.

[1326] The "means for adjusting the proposal plan based on emotions" is a process for modifying and optimizing the proposal plan according to the user's emotional state.

[1327] The present invention is a system that allows a user to input a departure point and destination when traveling. Based on the departure point and destination, the system collects information related to tourist attractions, restaurants, events, and activities along the way and at the destination, filters the information based on purpose and attributes, generates a proposed plan, and sends it to the user's device. The system also has the function of receiving the user's location information in real time and updating the proposed plan according to the situation. Furthermore, by combining it with an emotion engine, the system includes a means for recognizing the user's emotional state and adjusting the proposed plan based on the recognized emotion.

[1328] The system uses the following hardware and software:

[1329] 1. Device (smartphone, tablet, PC, etc.)

[1330] Users input their origin, destination, route, and purpose of the trip through the device, either via an app or web interface.

[1331] 2. Server

[1332] The server receives the information sent by the user (origin, destination, route, and purpose) and performs an initial analysis. Using a generative AI model, the server collects data on tourist spots, restaurants, events, and activities within the specified area from the internet and internal databases. For example, information on romantic spots, cafes, and restaurants between Shibuya and Kamakura is collected.

[1333] 3. Generative AI Models

[1334] The generative AI model filters the collected data and generates a plan proposal suited to the purpose and user attributes. Specifically, it selects suitable date spots such as "sunset spots in Enoshima," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura."

[1335] 4. Submitting and displaying the proposed plan

[1336] The server sends the generated proposed plan to the user's device, which displays it on a map or in a list format. Spots are indicated on the map with markers, and summary information about the spots is provided in the list.

[1337] 5. Real-time location information transmission

[1338] Once the user starts moving, the device will send GPS data to the server every 10 minutes, updating the user's location in real time.

[1339] 6. Real-time data analysis and proposal updates

[1340] The server analyzes real-time location information, traffic conditions, weather information, etc., and updates the proposed plan as needed, for example, suggesting quiet cafes or indoor facilities instead of crowded spots.

[1341] 7. Emotion Engine

[1342] The emotion engine collects emotional data from users through voice input, facial expression recognition, and text analysis, and sends it to the server. The server then analyzes the data and adjusts the recommendation plan based on the user's emotional state. For example, if the user is feeling stressed, the plan will include more relaxation spots.

[1343] Specific examples

[1344] For example, when a couple plans a date drive from Shibuya to Kamakura, the following suggestions are made:

[1345] Departure point: Shibuya

[1346] Destination: Kamakura

[1347] Use: Date

[1348] The server collects tourist spots and restaurants between Shibuya and Kamakura and suggests romantic spots and cafes for dates. Along the way, the server suggests spots like sunset spots in Enoshima, quiet cafes in Kita-Kamakura, and art galleries in Kamakura. New suggestions are also made based on real-time location information and conditions during travel. For example, in the event of bad weather, alternatives like indoor cafes or stylish bookstores are suggested.

[1349] Prompt Sentence Examples

[1350] "Please create a plan for a date drive from Shibuya to Kamakura. Suggest sightseeing spots and places to eat along the way."

[1351] "User is stressed. Can you suggest a spot where they can relax?"

[1352] In this way, users can enjoy their trip while always receiving the best possible suggested plans while on the move.

[1353] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1354] Step 1:

[1355] A user uses a device to input the origin, destination, route, and purpose of the trip. The user provides the input through an app or web interface. For example, the user might input, "I'm planning a drive from Shibuya to Kamakura, and the purpose is a date."

[1356] Input: origin, destination, route, purpose of trip

[1357] Output: Input information is kept in the terminal

[1358] Step 2:

[1359] The device sends the entered information (origin, destination, route, and purpose) to the server, along with basic attribute data such as the user's age group and interests.

[1360] Input: origin, destination, route, purpose of trip, user attribute data

[1361] Output: Input information and attribute data sent to the server

[1362] Step 3:

[1363] The server receives the data and performs an initial analysis. Based on the input information, the server determines the range in which to collect information related to tourist spots, restaurants, events, and activities. For example, it sets the target range based on the route information for "Shibuya - Kamakura."

[1364] Input: Transmitted data (origin, destination, route, purpose of trip, attribute data)

[1365] Output: Identifying the scope of information collection

[1366] Step 4:

[1367] The server runs the generative AI model and collects information within the specified area. Specifically, it collects data on tourist spots, restaurants, events, and activities from the internet and internal databases. For example, it collects information on romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[1368] Input: Identified scope of information collection

[1369] Output: Collected information data

[1370] Step 5:

[1371] The server filters the collected data and generates a proposal plan suited to the purpose and user attributes, for example, selecting "sunset spots in Enoshima," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura."

[1372] Input: Collected information data, user usage, and attribute data

[1373] Output: Proposed plan

[1374] Step 6:

[1375] The server then sends the generated proposed plan to the device, which includes detailed information about each spot and a navigation guide.

[1376] Input: Generated proposal plan

[1377] Output: Proposed plan sent to the device

[1378] Step 7:

[1379] The terminal displays the received proposed plan to the user in a map or list format, designed to be intuitive and easy for the user to understand.

[1380] Input: Proposed plan

[1381] Output: Display proposed plan

[1382] Step 8:

[1383] When the user actually starts moving, the device acquires the user's location information at regular intervals and sends it to the server. For example, it acquires and sends GPS data every 10 minutes.

[1384] Input: User begins moving

[1385] Output: Real-time location information sent to the server

[1386] Step 9:

[1387] The server analyzes real-time location information and dynamically updates the proposed plan, taking into account current congestion and weather conditions, for example, suggesting quiet cafes or indoor facilities instead of crowded spots.

[1388] Input: Real-time location information, current traffic and weather information

[1389] Output: Updated proposed plan

[1390] Step 10:

[1391] The server then sends the updated plan back to the device, including the latest information on things like "indoor cafes" and "stylish bookstores."

[1392] Input: Updated Proposal Plan

[1393] Output: Renewal plan sent to device

[1394] Step 11:

[1395] The device displays updated proposals to the user in real time, and new proposals and changes are instantly communicated to the user through pop-up notifications and changes to the map markers.

[1396] Input: Updated Proposal Plan

[1397] Output: Real-time notification and display

[1398] Step 12:

[1399] The device collects emotional data through the user's voice input, facial expression recognition, text analysis, etc., and sends it to a server. For example, emotions can be analyzed from the user's facial expressions and voice using a camera.

[1400] Input: User voice input, facial expression recognition, text analysis

[1401] Output: Emotion data sent to the server

[1402] Step 13:

[1403] The server analyzes the emotional data and adjusts the proposed plan based on the user's current emotional state: if the user is feeling stressed, it suggests relaxation spots.

[1404] Input: Emotion data

[1405] Output: Suggested plan depending on emotional state

[1406] Step 14:

[1407] The server sends a suggested plan based on the user's emotional state to the device, which then displays it to the user. For example, if the user is having fun, the server suggests additional spots to maintain that emotion.

[1408] Input: Suggested plan based on emotional state

[1409] Output: Proposed plan sent to the terminal and its display

[1410] (Application example 2)

[1411] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1412] In today's world, users need information that will allow them to enjoy a richer experience while traveling. However, conventional systems only provide simple tourist information based on the user's departure and destination, and do not adequately provide suggestions tailored to the user's attributes or real-time situation. They also lack personalized suggestions that take into account the user's emotions. This prevents users from receiving the optimal tourist experience, and further improvements in satisfaction are needed.

[1413] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1414] In this invention, the server includes means for inputting a departure point and destination when a user travels, means for collecting information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on the purpose and attributes and generating a proposed plan, means for transmitting the generated proposed plan to the user's terminal, means for receiving the user's location information in real time and updating the proposed plan according to the situation, and means for recognizing the user's emotions and adjusting the proposed plan based on the user's emotional state. This makes it possible to provide a personalized proposed plan based on the user's attributes, real-time location information, and emotions.

[1415] The "starting point" is the point where the user begins their journey.

[1416] A "destination" is a point that a user sets as the final purpose of their journey.

[1417] A "tourist destination" is a spot where visitors go for sightseeing purposes.

[1418] A "restaurant" is a place where meals are served.

[1419] An "event" is an event or occasion that takes place on a specific date and time.

[1420] "Activities" refers to experiential activities and programs.

[1421] "Means of collecting information" refers to the methods and functions for obtaining the necessary data using the Internet or databases.

[1422] "Means for filtering information" refers to the methods and functions for selecting and organizing collected information based on its purpose and attributes.

[1423] A "proposed plan" is a plan of destinations and activities that are optimal for the user's travel and sightseeing.

[1424] The "transmitting means" refers to a method and function for transmitting the generated proposed plan to the user's terminal.

[1425] "Location information" is data that indicates a user's current location using technologies such as GPS.

[1426] "Means for receiving in real time" refers to the method and function for obtaining user location information without time delay.

[1427] A "means for updating a proposed plan" is a method and function for modifying an existing proposed plan in response to new information or changing circumstances.

[1428] "Means for recognizing emotions" refers to methods and functions that use voice analysis and facial expression analysis to identify the user's emotional state.

[1429] The "means for adjusting the proposed plan based on the emotional state" refers to a method and function for modifying the content of the proposed plan according to the emotion recognition result.

[1430] This invention is a system that allows users to input their departure and destination points when traveling and specify the purpose of the trip (e.g., date, solo trip, family trip, etc.), and provides information about tourist spots, restaurants, events, and activities along the route and at the destination. This system is realized using the following hardware and software.

[1431] Hardware and software used

[1432] 1. Hardware

[1433] On-board computer: A computer installed in a self-driving vehicle.

[1434] GPS sensor: Obtains user location information.

[1435] Camera and microphone: Captures data to recognize user emotions.

[1436] 2. Software

[1437] To collect data, we use Python programs and web scraping libraries such as BeautifulSoup and Scrapy.

[1438] For emotion recognition, use emotion recognition APIs such as Google Cloud Vision API and Microsoft Azure Face API.

[1439] For data analysis, we use Pandas and NumPy.

[1440] The generative AI model is OpenAI's GPT-4.

[1441] System configuration

[1442] 1. User Input

[1443] Users input their origin, destination and purpose of the trip via the in-car display or smartphone app, and this information is sent to the vehicle's computer.

[1444] 2. Data Collection

[1445] The onboard computer uses the internet and internal databases to gather information about tourist spots, restaurants, events, and activities around the designated route and destinations. This data collection is done using a web scraping library.

[1446] 3. Proposal plan generation

[1447] Based on the collected data, a proposed plan is generated that is suited to the user's purpose and attributes. This proposal is made taking into account the user's profile data (age, interests, etc.). OpenAI's GPT-4 is used as the generative AI model, and the following example prompt sentence is used as input to create the proposed plan.

[1448] Prompt Sentence Examples

[1449] User profile: A young couple planning a romantic date drive from Shibuya to Kamakura. They enjoy scenic views and quiet cafes.

[1450] Data: List of tourist spots, cafes, and activities along the route from Shibuya to Kamakura.

[1451] Task: Generate a travel plan suitable for a romantic date drive, ensuring to include scenic spots and quiet cafes.

[1452] 4. Send proposals and update them in real time

[1453] The server sends the generated proposed plan to the user's device. Once the user starts moving, the onboard computer periodically sends location information to the server using the GPS sensor. The server updates the proposed plan as needed based on this location information and real-time traffic and weather information, and resends it to the user's device.

[1454] 5. Emotion recognition and proposal plan adjustment

[1455] The system recognizes the user's emotions using the vehicle's camera and microphone. Using an emotion recognition API, the system analyzes the user's emotional data and adjusts the proposed plan based on their emotional state. For example, if the user is feeling stressed, it will suggest places to relax, and if the user is having fun, it will add spots to maintain that emotion.

[1456] In this way, it is possible to provide personalized proposals based on user attributes, real-time location information, and emotions.

[1457] As a concrete example, if a couple plans a date drive from Shibuya to Kamakura, the system will collect tourist attractions and restaurants between Shibuya and Kamakura and suggest places like sunset spots on Enoshima or quiet cafes in Kita-Kamakura. New suggestions will be made as needed based on real-time location information and conditions during the trip, and if the weather worsens, alternatives such as indoor cafes or stylish bookstores will be suggested.

[1458] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1459] Step 1:

[1460] The user inputs the departure point and destination via the in-car display or smartphone app, as well as the purpose of the trip (e.g., date, solo trip, family trip, etc.). The input information is sent from the device to the server in the form of departure point, destination, and purpose of the trip.

[1461] Step 2:

[1462] The server collects data on tourist spots, restaurants, events, and activities around the specified route and destination based on the received departure and destination information. Web scraping libraries (BeautifulSoup and Scrapy) are used to collect this data. The input is the departure and destination information, and the output is a list of tourist spots, restaurants, events, and activities.

[1463] Step 3:

[1464] The server filters the collected information based on the purpose and user attributes, generating a suggested itinerary that is optimal for the user. A generative AI model (OpenAI GPT-4) is used to create a travel plan based on the collected data and user profile (age, interests, etc.). The input is the collected tourist destination information and user profile, and the output is a filtered suggested itinerary.

[1465] Step 4:

[1466] The server sends the generated proposed plan to the terminal. The user can check the sent proposed plan on the in-car display or smartphone. The input is the proposed plan, and the output is the plan displayed on the user terminal.

[1467] Step 5:

[1468] When a user starts moving, the device periodically transmits location information to the server using the GPS sensor. The input is real-time location information, and the output is the transmission of location information to the server.

[1469] Step 6:

[1470] The server dynamically updates the proposed itinerary based on real-time location information, taking into account current traffic and weather conditions. This includes, for example, suggesting alternative routes when congestion is expected, or indoor activities when the weather worsens. The input is location information and real-time traffic and weather data, and the output is an updated proposed itinerary.

[1471] Step 7:

[1472] The terminal receives the updated proposed plan and displays it to the user in real time. The user can continue their journey based on the new proposals and changes. The input is the updated proposed plan and the output is the updated plan displayed on the user terminal.

[1473] Step 8:

[1474] Using the on-board camera and microphone, the device collects the user's emotional data, including voice input and facial expression detection. The input is the emotional data from the camera and microphone, and the output is the transmission of the emotional data to the server.

[1475] Step 9:

[1476] Using the emotion recognition API, the server analyzes the user's emotional data. Based on the analysis results, the proposed plan is adjusted to match the user's emotional state. For example, if the user is feeling stressed, the server will suggest a place where they can relax. The input is emotional data, and the output is a proposed plan adjusted based on the emotion.

[1477] Step 10:

[1478] The server retransmits the adjusted proposed plan to the terminal, which displays it to the user. The user can adjust their behavior based on the new proposal. The input is the adjusted proposed plan, and the output is the adjusted plan displayed on the user terminal.

[1479] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1480] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1481] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1482] [Fourth embodiment]

[1483] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1484] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1485] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1486] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1487] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1488] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1489] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1490] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1491] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1492] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1493] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1494] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1495] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1496] System Overview

[1497] The present invention is a system that includes a means for inputting a departure point and destination when a user travels, and a means for collecting information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, filtering the collected information based on purpose and attributes to generate a proposed plan, sending the generated proposed plan to the user's terminal, and receiving the user's location information in real time to update the proposed plan according to the situation.

[1498] Program processing

[1499] 1. User Input

[1500] Users input the departure point, destination, route, and purpose of the trip (date, solo trip, family trip, etc.) through an app or web interface on their device (smartphone, tablet, PC). For example, a user might input, "I plan to drive from Shibuya to Kamakura, and the purpose is a date."

[1501] 2. Transmission of User Information

[1502] The device sends the entered information (starting point, destination, route, purpose) to the server. The device sends the data "starting point: Shibuya," "destination: Kamakura," and "purpose: date" to the server.

[1503] 3. Receiving data and preparing for analysis

[1504] The server performs an initial analysis of the received data and determines the required data collection range. The server analyzes the route information for "Shibuya - Kamakura" and determines the destination and the range for collecting information on tourist spots, restaurants, and events along the way.

[1505] 4. Data Collection

[1506] The server runs a generative AI model and collects data on tourist spots, restaurants, events, activities, etc. within a specified area. The server collects information on "romantic sunset spots," "quiet cafes," "seafood restaurants," "art galleries," etc. between Shibuya and Kamakura from the internet and its internal database.

[1507] 5. Data filtering and proposal generation

[1508] Based on the collected information, the server generates suggestions for sightseeing spots and activities suitable for the user's purpose (date), such as "sunset spots in Enoshima," "quiet and cozy cafes in Kita-Kamakura," and "art galleries in Kamakura."

[1509] 6. Submit your proposal

[1510] The server sends the generated proposed plan to the device. The server sends the plan, which includes "Sunset Spots in Enoshima," "Cafes in Kita-Kamakura," and "Art Gallery in Kamakura," to the device.

[1511] 7. View your plan

[1512] The terminal displays the received proposed plan to the user. The terminal displays the proposed plan on a map or in list format, and provides navigation information to the user.

[1513] 8. Real-time location information transmission

[1514] When the user starts moving, the device periodically sends the user's current location information to the server. The device sends the user's current location to the server every 10 minutes.

[1515] 9. Real-time data analysis and proposal updates

[1516] The server receives real-time location information and updates suggestions based on new information and changing conditions (e.g., traffic congestion, weather). If the user is delayed or bad weather is forecast, the server will suggest alternative rest spots, dining spots, and indoor activities.

[1517] 10. Submitting a Resubmission

[1518] The server sends the updated suggestions to the device. The server also sends newly generated information such as "indoor cafes" and "stylish bookstores" to the device.

[1519] 11. Displaying real-time suggestions

[1520] The device will display new suggestions to the user in real time, such as "new cafes" or "places to shelter from bad weather," via pop-ups and notifications.

[1521] Specific examples

[1522] For example, when a couple plans a date drive from Shibuya to Kamakura, the following suggestions are made:

[1523] Departure point: Shibuya

[1524] Destination: Kamakura

[1525] Use: Date

[1526] The server collects tourist spots and restaurants between Shibuya and Kamakura and suggests romantic spots and cafes suitable for dates. Along the way, the server suggests spots such as sunset spots in Enoshima, quiet cafes in Kita-Kamakura, and art galleries in Kamakura. New suggestions are also made based on real-time location information and conditions during travel. For example, in the event of bad weather, alternatives such as indoor cafes or stylish bookstores are suggested.

[1527] In this way, users can enjoy a richer experience while traveling or on the move.

[1528] The processing flow will be explained below.

[1529] Step 1:

[1530] A user inputs the starting point, destination, route, and purpose (date, solo trip, family trip, etc.) via an application on the device or a web interface. For example, a user plans a "drive from Shibuya to Kamakura" and inputs the purpose as "date."

[1531] Step 2:

[1532] The device sends the entered information about the departure point, destination, route, and purpose to the server, along with the user's basic information and attributes (age group, interests, etc.).

[1533] Step 3:

[1534] The server performs an initial analysis of the received data and determines the range of information to be collected. For example, based on the route information "Shibuya - Kamakura," it sets the range to include the destination and tourist spots, restaurants, and event information along the way.

[1535] Step 4:

[1536] The server runs a generative AI model, collecting data on tourist spots, restaurants, events, and activities within a specified area from the internet and an internal database, such as romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[1537] Step 5:

[1538] The server filters the collected information and generates a plan suitable for the purpose and the user's attributes. For example, it might select "sunset spots in Enoshima," "cafes in Kita-Kamakura," and "art galleries in Kamakura" that are suitable for a date.

[1539] Step 6:

[1540] The server then sends the generated proposed plan to the terminal, which includes detailed information about each spot and a navigation guide.

[1541] Step 7:

[1542] The terminal displays the proposed plan to the user on a map or in list format, designed to be intuitive and convenient for the user.

[1543] Step 8:

[1544] When a user starts moving, the device periodically sends the user's current location information to the server. For example, by sending GPS information every 10 minutes, the device can grasp the user's location in real time.

[1545] Step 9:

[1546] The server analyzes the location information sent in real time and updates the proposed plan based on new information and changes in conditions (such as crowding and weather information). If crowding is expected or the weather worsens, the server will suggest alternative tourist spots and indoor activities.

[1547] Step 10:

[1548] The server then sends the updated plan proposal to the device, which includes newly selected locations such as an indoor cafe and a stylish bookstore.

[1549] Step 11:

[1550] The device will display updated proposals to the user in real time, with new proposals and changes indicated to the user through pop-up notifications and changes to map markers.

[1551] This series of processes allows users to enjoy a rich experience while traveling or commuting.

[1552] Example 1

[1553] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1554] Conventional travel planning systems allow users to input information about their departure and destination points, but they lack the ability to dynamically propose plans that respond to real-time changes in circumstances. They also struggle to automatically filter and suggest the best tourist spots and activities for specific purposes and attributes. This leaves users unable to respond to unexpected events or changes in the weather during their trip, resulting in an inadequate travel experience.

[1555] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1556] In this invention, the server includes means for inputting a departure point and destination for a user's trip, means for using an artificial intelligence model to generate and collect information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on purpose and attributes and generating a proposed plan, means for transmitting the generated proposed plan to the user's terminal, and means for receiving the user's location information in real time and updating the proposed plan in response to changes in the situation. This allows the user to receive a dynamic plan that responds to real-time changes in the situation during their trip, enabling them to flexibly respond to unexpected events and changes in the weather.

[1557] definition statement

[1558] The "starting point" is the point where the user begins their journey.

[1559] A "destination" is the point where the user intends to end their journey.

[1560] "Input means" is an interface through which a user provides the origin and destination to the system.

[1561] The "artificial intelligence model that generates information" is an algorithm that analyzes collected data and generates information related to tourist attractions, restaurants, events, and activities.

[1562] A "filtering means" is a method for selecting appropriate information from collected information based on specific conditions.

[1563] The "means for generating a proposed plan" is a method for creating a plan that combines optimal tourist spots and activities based on the user's purpose and attributes.

[1564] The "means for transmitting the proposed plan" refers to a communication protocol and data format for transmitting the generated proposed plan to the user's terminal.

[1565] "Means for receiving location information in real time" means technology for continuously transmitting and receiving a user's current geographical location to a server.

[1566] The "means for updating the proposed plan in response to changes in the situation" refers to a method for reevaluating the proposed plan based on real-time location information and changes in the environment, and generating new proposals as necessary.

[1567] This invention relates to a system that suggests tourist spots, restaurants, events, and activities in response to real-time changes in the user's situation while they are traveling. A specific embodiment of this system is described below.

[1568] User Input

[1569] Users can input the origin, destination, route, and purpose of the trip (e.g., date, solo trip, family trip, etc.) through an app or web interface on their device (smartphone, tablet, PC). For example, a user might input, "I'm planning a drive from Shibuya to Kamakura, and the purpose is a date."

[1570] Sending input information

[1571] The information entered by the user is sent from the device to the server. Specifically, the device compiles the data "Departure: Shibuya," "Destination: Kamakura," and "Purpose: Date" and sends it to the server using the HTTPS protocol.

[1572] Receiving data and preparing for analysis

[1573] The server analyzes the received data and determines the required data collection range. The server analyzes the route information for "Shibuya - Kamakura" and determines the range for collecting information on the destination, tourist spots along the way, restaurants, events, etc.

[1574] Data collection and use of generative AI models

[1575] The server uses the generative AI model to collect data on tourist spots, restaurants, events, activities, etc. within a specified range. For example, between Shibuya and Kamakura, information such as "romantic sunset spots," "quiet cafes," "seafood restaurants," and "art galleries" is collected from the internet and an internal database. An example of a prompt to be input to the generative AI model is "Please suggest the best places for a date between Shibuya and Kamakura."

[1576] Filtering data and generating proposed plans

[1577] The collected information is filtered by the server to select sightseeing spots and activities that best suit the user's needs and attributes. For example, suggestions such as "sunset spots in Enoshima," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura" are generated.

[1578] Submitting and viewing proposals

[1579] The generated proposed plan is sent from the server to the terminal, which displays the received proposed plan on a map or in list format and provides navigation information to the user.

[1580] Real-time location and plan updates

[1581] Once the user begins moving, the device periodically sends the user's current location information to the server. For example, the device obtains the user's current location every 10 minutes and sends it to the server using the HTTPS protocol. The server dynamically updates the proposed plan based on real-time location information and current traffic and weather information. By using the generative AI model again, it can suggest "alternative rest spots" or "indoor activities" in cases such as "when the route is delayed compared to planned" or "when bad weather is forecast." An example of a prompt used in this case is "Please suggest the best rest spot for the current situation."

[1582] Submit and view new proposals

[1583] The updated proposal plan is then sent back to the device from the server, and the device displays the new proposals to the user in real time, such as pop-ups and notifications about new cafes and bad weather shelters.

[1584] In this way, the system of the present invention allows users to receive appropriate suggestions in real time while traveling or moving, enabling them to make comfortable and flexible travel plans.

[1585] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1586] Step 1:

[1587] The user uses the terminal to input the origin, destination, route, and purpose of the trip.

[1588] Specific operation: The user opens the app, enters "Shibuya" as the departure point, "Kamakura" as the destination, and "date" as the purpose, and presses the "Start" button.

[1589] Input: Information entered by the user (origin, destination, purpose, etc.).

[1590] Output: The application validates the information entered and proceeds to the next step.

[1591] Step 2:

[1592] The terminal transmits the input information to the server.

[1593] Specific operation: The device sends the input information to the server using the HTTPS protocol as "Departure: Shibuya," "Destination: Kamakura," and "Purpose: Date." After the transmission is complete, the user is shown the message "Sending."

[1594] Input: Information entered by the user.

[1595] Output: The input information is sent to the server.

[1596] Step 3:

[1597] The server performs an initial analysis of the received data and determines the scope of data collection.

[1598] Specific operation: The server retrieves the distance and route information between "Shibuya and Kamakura" from the database and determines the range of data collection required based on the purpose of the "date."

[1599] Input: Origin, destination, and purpose information sent from the device.

[1600] Output: Identification of data collection area and list of required tourist attractions, places to eat, and event information.

[1601] Step 4:

[1602] The server uses a generative AI model to collect data within a specified range.

[1603] Specific operation: The server collects information on "romantic sunset spots," "quiet cafes," "seafood restaurants," "art galleries," etc. from the Internet and an internal database between "Shibuya and Kamakura." The generative AI model uses the prompt sentence, "Please suggest the best places for a date between Shibuya and Kamakura."

[1604] Input: Data collection scope and collection prompt statement.

[1605] Output: A list of collected tourist attractions, places to eat, events, and activities.

[1606] Step 5:

[1607] The server filters the information and generates a proposed plan.

[1608] How it works: The server selects date spots from the collected data, such as "sunset spots on Enoshima Island," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura City," and prioritizes highly rated data using a scoring algorithm.

[1609] Input: A list of collected tourist attractions, places to eat, events, and activities.

[1610] Output: Optimized proposed plan.

[1611] Step 6:

[1612] The server transmits the generated proposed plan to the terminal.

[1613] Specific operation: The server converts the proposed plan into JSON format and sends it to the terminal via HTTPS. After the transmission is complete, a transmission log is recorded on the server.

[1614] Input: Optimized proposal plan.

[1615] Output: The proposed plan sent to the device.

[1616] Step 7:

[1617] The terminal displays the received proposed plan to the user.

[1618] What it does: The device parses the JSON data, displays the proposed plans on a map or in a list format, and provides navigation information to the user.

[1619] Input: Proposed plan sent by the server.

[1620] Output: The proposed plan that is displayed to the user.

[1621] Step 8:

[1622] When the user starts moving, the terminal periodically transmits the user's current location information to the server.

[1623] How it works: The device uses the GPS sensor to obtain the user's current location every 10 minutes and sends it to the server using the HTTPS protocol. The device's status bar displays the progress of the transfer.

[1624] Input: User's current location.

[1625] Output: Location data sent to the server.

[1626] Step 9:

[1627] The server dynamically updates the proposed plan based on real-time location information, current traffic conditions, and weather information.

[1628] How it works: The server receives real-time location information and the latest weather and congestion data to generate new suggestions. The generative AI model uses a new prompt: "Please suggest the best rest spot for the current situation."

[1629] Input: Real-time location, traffic, and weather information.

[1630] Output: Updated proposed plan.

[1631] Step 10:

[1632] The server sends the updated proposed plan to the terminal.

[1633] Specific operation: The server converts the updated proposal into JSON format and sends it to the device via HTTPS. After sending is complete, the new proposal is recorded in the server history.

[1634] Input: Updated proposed plan.

[1635] Output: The updated proposed plan sent to the device.

[1636] Step 11:

[1637] The terminal displays new suggestions to the user in real time.

[1638] What it does: Your device will notify you of new suggestions via pop-up notifications or in the notification bar, such as "New Cafes" or "Shelter in Bad Weather."

[1639] Input: The updated proposed plan sent from the server.

[1640] Output: Updated suggestions shown to the user in real time.

[1641] (Application example 1)

[1642] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1643] Conventional travel plan generation systems can only provide static suggestions based on predefined tourist destinations and restaurants, and lack the flexibility to adapt to the user's location information or real-time changes in the situation. Furthermore, they do not provide optimal suggestions based on the user's purpose or attributes, so they are unable to fully meet individual needs. Furthermore, in the case of food delivery, the provision of restaurant information based on the user's location information and real-time tracking of delivery status are insufficient, making it difficult to provide optimal suggestions. There is a need to solve these issues.

[1644] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1645] In this invention, the server includes: a means for inputting a user's departure and destination; a means for collecting information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input departure and destination; a means for filtering the collected information based on the user's purpose and attributes and generating a proposed plan; a means for transmitting the generated proposed plan to the user's device; a means for receiving the user's location information in real time and updating the proposed plan according to the situation; and a means for collecting information on nearby restaurants based on the user's location information and providing suggestions based on delivery status. This allows users to receive suggestions for optimal tourist attractions and restaurants even while traveling, enabling flexible planning that responds to real-time changes in the situation. In addition, for food delivery, the server can obtain optimal restaurant information and delivery information based on the user's current location.

[1646] "User" refers to a person or organization that uses the service, and is the person to whom the system makes suggestions based on their location information and input information.

[1647] The "origin" refers to the point where the user begins their journey, and is important information for the system to generate route and destination information.

[1648] The "destination" refers to the point where the user completes their journey and serves as the basis for the system to make suggestions along the way and after arrival.

[1649] "Tourist destinations" refer to places that users should visit based on their interests, including historical buildings and natural landscapes.

[1650] "Food and beverage establishments" refers to establishments that serve food and beverages, including restaurants and cafes.

[1651] "Event" means an activity or event in which users can participate, including concerts and festivals.

[1652] "Activities" refers to experiences and activities that users can undertake, including outdoor sports and workshops.

[1653] "Purpose" refers to the purpose of the user's travel or trip, and can be categorized as a date, family trip, work, etc.

[1654] "Attributes" refer to a user's individual characteristics and preferences, including age, interests, special requests, etc.

[1655] "Proposed Plan" means a trip or travel plan provided to a User by the System, including details of places to visit and activities.

[1656] "Means of collection" refers to the method by which the specified information is obtained from the Internet or internal databases.

[1657] "Filtering means" refers to methods for sorting collected information based on the user's purpose and attributes.

[1658] "Means of receiving in real time" refers to a method for instantly obtaining the user's current location information and situation.

[1659] "Means of updating" refers to methods for modifying the proposed plan based on the user's location information or changes in the situation.

[1660] "Delivery status" refers to the location of the delivery person and the progress of the order in food delivery.

[1661] The system of the present invention allows a user to input their starting point and destination when traveling, collects information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input, filters the collected information based on purpose and attributes, and generates a proposed plan.The system also sends the generated proposed plan to the user's device, receives the user's location information in real time, and updates the proposed plan according to the situation.Furthermore, it collects information on nearby restaurants based on the user's location information and provides suggestions based on delivery status.

[1662] Program processing

[1663] Hardware and software used

[1664] Hardware: Smartphone (iOS, Android, etc.), server PC.

[1665] Software: Python, Requests library, Web API, generative AI models.

[1666] Data processing and calculation

[1667] 1. User input:

[1668] Users input their departure point, destination, and purpose of travel through a smartphone application, such as "Current location: Shinjuku," "Destination: Kyoto," and "Purpose: Sightseeing trip."

[1669] 2. Data Collection:

[1670] The server uses Web APIs, such as the Google Places API and Yelp API, to collect information on tourist attractions, restaurants, events, and activities related to the specified route and destination.

[1671] 3. Information filtering and generation of proposed plans:

[1672] The server uses a generative AI model to filter the collected information based on purpose and attributes to generate optimal proposals, such as prioritizing kid-friendly tourist spots and family restaurants for a family trip.

[1673] 4. Receive real-time location information and update your proposed plan:

[1674] While the user is moving, their device periodically sends their current location information to the server, which receives this information in real time and dynamically updates the proposed plan based on weather, traffic conditions, and other information using the OpenWeatherMap API and Google Maps Traffic API.

[1675] 5. Food delivery suggestions:

[1676] Based on the user's location, the app collects information about nearby restaurants, tracks the delivery person's current location and delivery status in real time, and suggests the most suitable restaurant and menu. Delivery status is updated in real time using a GPS tracking system.

[1677] Specific examples

[1678] For example, if a user plans a sightseeing trip from Shinjuku to Kyoto, the system will collect information on tourist spots such as Shinjuku Station, Kyoto Tower, and the bamboo forests of Arashiyama, as well as Japanese restaurants in Kyoto City and local souvenir shops, and provide the optimal plan. Based on real-time location information during travel, the system will also make new suggestions based on changes in congestion and weather.

[1679] Prompt Sentence Examples

[1680] A user is planning a sightseeing trip from Shinjuku to Kyoto. Suggest attractions, restaurants, events, and activities along the way and at the destination. Also includes new suggestions based on real-time updates.

[1681] In this way, users can find the best tourist spots and restaurants while traveling, and even for food delivery, they can track delivery status in real time and get information on recommended restaurants.

[1682] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1683] Step 1:

[1684] The user inputs the departure point, destination, and purpose into the terminal, which then transmits this information to the server.

[1685] Input: Departure point, destination, purpose (e.g., "Current location: Shinjuku", "Destination: Kyoto", "Purpose: Sightseeing trip")

[1686] Output: User information sent to the server

[1687] Step 2:

[1688] The server receives the departure and destination information sent by the user and collects information related to tourist attractions, restaurants, events, and activities within the specified range.

[1689] Input: User information sent (origin, destination, purpose)

[1690] Data processing: Collect information using Web APIs (e.g., Google Places API, Yelp API)

[1691] Output: Collected information on tourist spots, restaurants, events, and activities

[1692] Step 3:

[1693] The server filters the collected information based on the user's purpose and attributes, and uses a generative AI model to generate the optimal proposed plan.

[1694] Input: Collected tourist destination, restaurant, event, activity information, user purpose and attributes

[1695] Data processing: Filtering process using generative AI models

[1696] Output: Optimal proposed plan

[1697] Step 4:

[1698] The server transmits the generated proposed plan to the user's terminal, which receives the proposed plan and displays it to the user.

[1699] Input: Proposed plan

[1700] Output: Proposed plan sent to user device

[1701] Step 5:

[1702] When the user starts moving, the terminal periodically collects current location information and transmits it to the server.

[1703] Input: Real-time location of the user

[1704] Output: Location information sent to the server

[1705] Step 6:

[1706] The server receives the user's location information in real time, compares it with weather information, traffic conditions, etc., and updates the proposed plan.

[1707] Input: Real-time user location, weather, and traffic information

[1708] Data processing: Analyzing real-time data and updating proposal plans

[1709] Output: Updated proposed plan

[1710] Step 7:

[1711] The server then sends the updated proposal plan to the user's terminal again, and the terminal receives the new proposal plan and notifies the user.

[1712] Input: Updated Proposal Plan

[1713] Output: Updated proposed plan sent to user device

[1714] Step 8:

[1715] Based on the user's location information, the server collects information on nearby restaurants, tracks delivery status in real time, and provides the user with the most suitable restaurant information.

[1716] Input: User's location information, delivery person's current location information

[1717] Output: Information on the best restaurants and delivery status sent to the user's device

[1718] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1719] System Overview

[1720] The present invention is a system including means for inputting a departure point and destination when a user travels, means for collecting information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on purpose and attributes to generate a proposed plan, means for transmitting the generated proposed plan to the user's terminal, means for receiving the user's location information in real time to update the proposed plan according to the situation, and means for recognizing the user's emotions by combining an emotion engine and adjusting the proposed plan based on the recognized emotions.

[1721] Program processing

[1722] 1. User Input

[1723] Users input the departure point, destination, route, and purpose of the trip (date, solo trip, family trip, etc.) through an app or web interface on their device (smartphone, tablet, PC). For example, a user might input, "I plan to drive from Shibuya to Kamakura, and the purpose is a date."

[1724] 2. Transmission of User Information

[1725] The device sends the input information (starting point, destination, route, and purpose) to the server, along with the user's basic information and attributes (age group, interests, etc.).

[1726] 3. Receiving data and preparing for analysis

[1727] The server performs an initial analysis of the received data and determines the range of information to be collected. Based on the route information for "Shibuya - Kamakura," the server sets the range to include the destination and tourist spots, restaurants, and event information along the way.

[1728] 4. Data Collection

[1729] The server runs a generative AI model, collecting data on tourist spots, restaurants, events, and activities within a specified area from the internet and an internal database, such as romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[1730] 5. Data filtering and proposal generation

[1731] The server filters the collected information and generates a plan suitable for the purpose and the user's attributes. For example, it might select a sunset spot in Enoshima, a quiet and pleasant cafe in Kita-Kamakura, or an art gallery in Kamakura that are suitable for a date.

[1732] 6. Submit your proposal

[1733] The server then sends the generated proposed plan to the device, which includes detailed information about each spot and a navigation guide.

[1734] 7. View your plan

[1735] The terminal displays the proposed plan to the user on a map or in list format, designed to be intuitive and convenient for the user.

[1736] 8. Real-time location information transmission

[1737] When a user starts moving, the device periodically sends the user's current location information to the server. For example, by sending GPS information every 10 minutes, the device can grasp the user's location in real time.

[1738] 9. Real-time data analysis and proposal updates

[1739] The server analyzes the location information sent in real time and updates the proposed plan based on new information and changes in conditions (such as crowding and weather information). If crowding is expected or the weather worsens, the server will suggest alternative tourist spots and indoor activities.

[1740] 10. Submitting a Resubmission

[1741] The server then sends the updated plan proposal to the device, which includes newly selected locations such as an indoor cafe and a stylish bookstore.

[1742] 11. Displaying real-time suggestions

[1743] The device will display updated proposals to the user in real time, with new proposals and changes indicated to the user through pop-up notifications and changes to map markers.

[1744] Use of emotion engine

[1745] 1. Collecting Emotional Data

[1746] The device collects emotional data using methods such as voice input, facial expression recognition, and text analysis. For example, it analyzes emotions from facial expressions and voice when a user takes a selfie.

[1747] 2. Sending Emotional Data

[1748] The device sends the collected emotional data to a server, which includes the user's emotional state, such as joy, sadness, anger, and stress.

[1749] 3. Analyzing emotional data and adjusting the proposal plan

[1750] The server analyzes the received emotional data and adjusts the proposed plan based on the user's current emotional state. For example, if the user is feeling stressed, it will increase relaxation spots and entertainment.

[1751] 4. Recommendations based on emotional state

[1752] The server generates suggestions based on the user's emotional state and sends them to the device. For example, if the user is having fun, the server will suggest additional spots to help maintain that emotion.

[1753] Specific examples

[1754] For example, when a couple plans a date drive from Shibuya to Kamakura, the following suggestions are made:

[1755] Departure point: Shibuya

[1756] Destination: Kamakura

[1757] Use: Date

[1758] The server collects tourist spots and restaurants between Shibuya and Kamakura and suggests romantic spots and cafes suitable for dates. Along the way, the server suggests spots such as sunset spots in Enoshima, quiet cafes in Kita-Kamakura, and art galleries in Kamakura. New suggestions are also made based on real-time location information and conditions during travel. For example, in the event of bad weather, alternatives such as indoor cafes or stylish bookstores are suggested.

[1759] Furthermore, the emotion engine recognizes the user's emotions and suggests places to relax if the user is feeling stressed, or suggests additional spots to maintain that emotion if the user is having fun. In this way, users can enjoy a rich experience while traveling.

[1760] The processing flow will be explained below.

[1761] Step 1:

[1762] A user inputs the starting point, destination, route, and purpose (date, solo trip, family trip, etc.) via an application on the device or a web interface. For example, a user plans a "drive from Shibuya to Kamakura" and inputs the purpose as "date."

[1763] Step 2:

[1764] The device sends the entered information about the departure point, destination, route, and purpose to the server, along with the user's basic information and attributes (age group, interests, etc.).

[1765] Step 3:

[1766] The server performs an initial analysis of the received data and determines the range of information to be collected. For example, based on the route information "Shibuya - Kamakura," it sets the range to include the destination and tourist spots, restaurants, and event information along the way.

[1767] Step 4:

[1768] The server runs a generative AI model, collecting data on tourist spots, restaurants, events, and activities within a specified area from the internet and an internal database, such as romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[1769] Step 5:

[1770] The server filters the collected information and generates a plan suitable for the purpose and the user's attributes. For example, it might select a sunset spot in Enoshima, a quiet and pleasant cafe in Kita-Kamakura, or an art gallery in Kamakura that are suitable for a date.

[1771] Step 6:

[1772] The server then sends the generated proposed plan to the terminal, which includes detailed information about each spot and a navigation guide.

[1773] Step 7:

[1774] The terminal displays the received proposed plan to the user in a map or list format, designed to be intuitive for the user.

[1775] Step 8:

[1776] When a user starts moving, the device periodically sends the user's current location information to the server. For example, by sending GPS information every 10 minutes, the device can grasp the user's location in real time.

[1777] Step 9:

[1778] The server analyzes the location information sent in real time and updates the proposed plan based on new information and changes in conditions (such as crowding and weather information). For example, if crowding is expected or the weather worsens, it will suggest alternative tourist spots or indoor activities.

[1779] Step 10:

[1780] The server then sends the updated proposed plan to the terminal, which includes the newly selected "indoor cafe" and "stylish bookstore."

[1781] Step 11:

[1782] The device will display updated proposals to the user in real time, with new proposals and changes indicated to the user through pop-up notifications and changes to map markers.

[1783] Use of emotion engine

[1784] Step 12:

[1785] The device collects emotional data using methods such as voice input, facial expression recognition, and text analysis. For example, it analyzes emotions from facial expressions and voice when a user takes a selfie.

[1786] Step 13:

[1787] The device sends the collected emotional data to a server, which includes the user's emotional state, such as joy, sadness, anger, and stress.

[1788] Step 14:

[1789] The server analyzes the received emotional data and adjusts the proposed plan based on the user's current emotional state. For example, if the user is feeling stressed, it will increase relaxation spots and entertainment.

[1790] Step 15:

[1791] The server generates suggestions based on the user's emotional state and sends them to the device. For example, if the user is having fun, the server will suggest additional spots to help maintain that emotion.

[1792] Step 16:

[1793] The device displays updated proposed plans to the user in real time, and new proposals and changes based on emotional state are indicated to the user through pop-up notifications and changes to map markers.

[1794] In this way, users can enjoy a richer experience while traveling or on the move.

[1795] Example 2

[1796] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1797] In modern travel and mobility, users need to efficiently create plans, including routes and stopovers from their origin to their destination, and dynamically update them according to the situation. They also need to suggest optimal plans based on the user's emotional state and real-time circumstances. However, existing systems are insufficient in suggesting plans tailored to the user's interests and emotional state, and their ability to update suggestions in real time is limited. This makes it difficult for users to have a satisfying travel experience.

[1798] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1799] In this invention, the server includes means for inputting a departure point and destination when a user travels, means for collecting information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on purpose and attributes and generating a proposed plan, means for transmitting the generated proposed plan to the user's terminal, means for receiving the user's location information in real time and updating the proposed plan according to the situation, and means for analyzing the user's emotional state and adjusting the proposed plan based on the emotion. This makes it possible to provide an optimal plan based on the user's interests and real-time situation and emotional state.

[1800] "User" means an individual or entity that uses the System to input origin and destination and receive proposed itineraries.

[1801] "Origin" refers to the location where the user begins their journey.

[1802] "Destination" means the location where a User intends to complete a Trip.

[1803] "Terminal" refers to a device (smartphone, tablet, PC, etc.) that a user uses to input data and receive proposed plans.

[1804] A "server" is a computer system that collects and analyzes information sent by users and generates proposed plans.

[1805] "Means of collecting information" refers to the process of collecting data about tourist attractions, restaurants, events, and activities via the internet and internal databases.

[1806] "Means for filtering information" refers to the process of converting collected data into appropriate proposed plans based on usage and user attributes.

[1807] "Proposed Plan" means a plan including information on tourist attractions, restaurants, events, and activities provided to Users.

[1808] "Means for receiving in real time" refers to the process of periodically obtaining the user's current location information and sending it to the server.

[1809] The "means for updating the proposed plan" is a process for dynamically changing the proposed plan based on the user's location information and changes in conditions (such as congestion or weather changes).

[1810] "Means for analyzing emotional state" refers to the process of determining the user's current emotional state through the user's voice input, facial expression recognition, text analysis, etc.

[1811] The "means for adjusting the proposal plan based on emotions" is a process for modifying and optimizing the proposal plan according to the user's emotional state.

[1812] The present invention is a system that allows a user to input a departure point and destination when traveling. Based on the departure point and destination, the system collects information related to tourist attractions, restaurants, events, and activities along the way and at the destination, filters the information based on purpose and attributes, generates a proposed plan, and sends it to the user's device. The system also has the function of receiving the user's location information in real time and updating the proposed plan according to the situation. Furthermore, by combining it with an emotion engine, the system includes a means for recognizing the user's emotional state and adjusting the proposed plan based on the recognized emotion.

[1813] The system uses the following hardware and software:

[1814] 1. Device (smartphone, tablet, PC, etc.)

[1815] Users input their origin, destination, route, and purpose of the trip through the device, either via an app or web interface.

[1816] 2. Server

[1817] The server receives the information sent by the user (origin, destination, route, and purpose) and performs an initial analysis. Using a generative AI model, the server collects data on tourist spots, restaurants, events, and activities within the specified area from the internet and internal databases. For example, information on romantic spots, cafes, and restaurants between Shibuya and Kamakura is collected.

[1818] 3. Generative AI Models

[1819] The generative AI model filters the collected data and generates a plan proposal suited to the purpose and user attributes. Specifically, it selects suitable date spots such as "sunset spots in Enoshima," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura."

[1820] 4. Submitting and displaying the proposed plan

[1821] The server sends the generated proposed plan to the user's device, which displays it on a map or in a list format. Spots are indicated on the map with markers, and summary information about the spots is provided in the list.

[1822] 5. Real-time location information transmission

[1823] Once the user starts moving, the device will send GPS data to the server every 10 minutes, updating the user's location in real time.

[1824] 6. Real-time data analysis and proposal updates

[1825] The server analyzes real-time location information, traffic conditions, weather information, etc., and updates the proposed plan as needed, for example, suggesting quiet cafes or indoor facilities instead of crowded spots.

[1826] 7. Emotion Engine

[1827] The emotion engine collects emotional data from users through voice input, facial expression recognition, and text analysis, and sends it to the server. The server then analyzes the data and adjusts the recommendation plan based on the user's emotional state. For example, if the user is feeling stressed, the plan will include more relaxation spots.

[1828] Specific examples

[1829] For example, when a couple plans a date drive from Shibuya to Kamakura, the following suggestions are made:

[1830] Departure point: Shibuya

[1831] Destination: Kamakura

[1832] Use: Date

[1833] The server collects tourist spots and restaurants between Shibuya and Kamakura and suggests romantic spots and cafes for dates. Along the way, the server suggests spots like sunset spots in Enoshima, quiet cafes in Kita-Kamakura, and art galleries in Kamakura. New suggestions are also made based on real-time location information and conditions during travel. For example, in the event of bad weather, alternatives like indoor cafes or stylish bookstores are suggested.

[1834] Prompt Sentence Examples

[1835] "Please create a plan for a date drive from Shibuya to Kamakura. Suggest sightseeing spots and places to eat along the way."

[1836] "User is stressed. Can you suggest a spot where they can relax?"

[1837] In this way, users can enjoy their trip while always receiving the best possible suggested plans while on the move.

[1838] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1839] Step 1:

[1840] A user uses a device to input the origin, destination, route, and purpose of the trip. The user provides the input through an app or web interface. For example, the user might input, "I'm planning a drive from Shibuya to Kamakura, and the purpose is a date."

[1841] Input: origin, destination, route, purpose of trip

[1842] Output: Input information is kept in the terminal

[1843] Step 2:

[1844] The device sends the entered information (origin, destination, route, and purpose) to the server, along with basic attribute data such as the user's age group and interests.

[1845] Input: origin, destination, route, purpose of trip, user attribute data

[1846] Output: Input information and attribute data sent to the server

[1847] Step 3:

[1848] The server receives the data and performs an initial analysis. Based on the input information, the server determines the range in which to collect information related to tourist spots, restaurants, events, and activities. For example, it sets the target range based on the route information for "Shibuya - Kamakura."

[1849] Input: Transmitted data (origin, destination, route, purpose of trip, attribute data)

[1850] Output: Identifying the scope of information collection

[1851] Step 4:

[1852] The server runs the generative AI model and collects information within the specified area. Specifically, it collects data on tourist spots, restaurants, events, and activities from the internet and internal databases. For example, it collects information on romantic sunset spots, quiet cafes, and seafood restaurants between Shibuya and Kamakura.

[1853] Input: Identified scope of information collection

[1854] Output: Collected information data

[1855] Step 5:

[1856] The server filters the collected data and generates a proposal plan suited to the purpose and user attributes, for example, selecting "sunset spots in Enoshima," "quiet cafes in Kita-Kamakura," and "art galleries in Kamakura."

[1857] Input: Collected information data, user usage, and attribute data

[1858] Output: Proposed plan

[1859] Step 6:

[1860] The server then sends the generated proposed plan to the device, which includes detailed information about each spot and a navigation guide.

[1861] Input: Generated proposal plan

[1862] Output: Proposed plan sent to the device

[1863] Step 7:

[1864] The terminal displays the received proposed plan to the user in a map or list format, designed to be intuitive and easy for the user to understand.

[1865] Input: Proposed plan

[1866] Output: Display proposed plan

[1867] Step 8:

[1868] When the user actually starts moving, the device acquires the user's location information at regular intervals and sends it to the server. For example, it acquires and sends GPS data every 10 minutes.

[1869] Input: User begins moving

[1870] Output: Real-time location information sent to the server

[1871] Step 9:

[1872] The server analyzes real-time location information and dynamically updates the proposed plan, taking into account current congestion and weather conditions, for example, suggesting quiet cafes or indoor facilities instead of crowded spots.

[1873] Input: Real-time location information, current traffic and weather information

[1874] Output: Updated proposed plan

[1875] Step 10:

[1876] The server then sends the updated plan back to the device, including the latest information on things like "indoor cafes" and "stylish bookstores."

[1877] Input: Updated Proposal Plan

[1878] Output: Renewal plan sent to device

[1879] Step 11:

[1880] The device displays updated proposals to the user in real time, and new proposals and changes are instantly communicated to the user through pop-up notifications and changes to the map markers.

[1881] Input: Updated Proposal Plan

[1882] Output: Real-time notification and display

[1883] Step 12:

[1884] The device collects emotional data through the user's voice input, facial expression recognition, text analysis, etc., and sends it to a server. For example, emotions can be analyzed from the user's facial expressions and voice using a camera.

[1885] Input: User voice input, facial expression recognition, text analysis

[1886] Output: Emotion data sent to the server

[1887] Step 13:

[1888] The server analyzes the emotional data and adjusts the proposed plan based on the user's current emotional state: if the user is feeling stressed, it suggests relaxation spots.

[1889] Input: Emotion data

[1890] Output: Suggested plan depending on emotional state

[1891] Step 14:

[1892] The server sends a suggested plan based on the user's emotional state to the device, which then displays it to the user. For example, if the user is having fun, the server suggests additional spots to maintain that emotion.

[1893] Input: Suggested plan based on emotional state

[1894] Output: Proposed plan sent to the terminal and its display

[1895] (Application example 2)

[1896] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1897] In today's world, users need information that will allow them to enjoy a richer experience while traveling. However, conventional systems only provide simple tourist information based on the user's departure and destination, and do not adequately provide suggestions tailored to the user's attributes or real-time situation. They also lack personalized suggestions that take into account the user's emotions. This prevents users from receiving the optimal tourist experience, and further improvements in satisfaction are needed.

[1898] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1899] In this invention, the server includes means for inputting a departure point and destination when a user travels, means for collecting information related to tourist spots, restaurants, events, and activities along the way and at the destination based on the input departure point and destination, means for filtering the collected information based on the purpose and attributes and generating a proposed plan, means for transmitting the generated proposed plan to the user's terminal, means for receiving the user's location information in real time and updating the proposed plan according to the situation, and means for recognizing the user's emotions and adjusting the proposed plan based on the user's emotional state. This makes it possible to provide a personalized proposed plan based on the user's attributes, real-time location information, and emotions.

[1900] The "starting point" is the point where the user begins their journey.

[1901] A "destination" is a point that a user sets as the final purpose of their journey.

[1902] A "tourist destination" is a spot where visitors go for sightseeing purposes.

[1903] A "restaurant" is a place where meals are served.

[1904] An "event" is an event or occasion that takes place on a specific date and time.

[1905] "Activities" refers to experiential activities and programs.

[1906] "Means of collecting information" refers to the methods and functions for obtaining the necessary data using the Internet or databases.

[1907] "Means for filtering information" refers to the methods and functions for selecting and organizing collected information based on its purpose and attributes.

[1908] A "proposed plan" is a plan of destinations and activities that are optimal for the user's travel and sightseeing.

[1909] The "transmitting means" refers to a method and function for transmitting the generated proposed plan to the user's terminal.

[1910] "Location information" is data that indicates a user's current location using technologies such as GPS.

[1911] "Means for receiving in real time" refers to the method and function for obtaining user location information without time delay.

[1912] A "means for updating a proposed plan" is a method and function for modifying an existing proposed plan in response to new information or changing circumstances.

[1913] "Means for recognizing emotions" refers to methods and functions that use voice analysis and facial expression analysis to identify the user's emotional state.

[1914] The "means for adjusting the proposed plan based on the emotional state" refers to a method and function for modifying the content of the proposed plan according to the emotion recognition result.

[1915] This invention is a system that allows users to input their departure and destination points when traveling and specify the purpose of the trip (e.g., date, solo trip, family trip, etc.), and provides information about tourist spots, restaurants, events, and activities along the route and at the destination. This system is realized using the following hardware and software.

[1916] Hardware and software used

[1917] 1. Hardware

[1918] On-board computer: A computer installed in a self-driving vehicle.

[1919] GPS sensor: Obtains user location information.

[1920] Camera and microphone: Captures data to recognize user emotions.

[1921] 2. Software

[1922] To collect data, we use Python programs and web scraping libraries such as BeautifulSoup and Scrapy.

[1923] For emotion recognition, use emotion recognition APIs such as Google Cloud Vision API and Microsoft Azure Face API.

[1924] For data analysis, we use Pandas and NumPy.

[1925] The generative AI model is OpenAI's GPT-4.

[1926] System configuration

[1927] 1. User Input

[1928] Users input their origin, destination and purpose of the trip via the in-car display or smartphone app, and this information is sent to the vehicle's computer.

[1929] 2. Data Collection

[1930] The onboard computer uses the internet and internal databases to gather information about tourist spots, restaurants, events, and activities around the designated route and destinations. This data collection is done using a web scraping library.

[1931] 3. Proposal plan generation

[1932] Based on the collected data, a proposed plan is generated that is suited to the user's purpose and attributes. This proposal is made taking into account the user's profile data (age, interests, etc.). OpenAI's GPT-4 is used as the generative AI model, and the following example prompt sentence is used as input to create the proposed plan.

[1933] Prompt Sentence Examples

[1934] User profile: A young couple planning a romantic date drive from Shibuya to Kamakura. They enjoy scenic views and quiet cafes.

[1935] Data: List of tourist spots, cafes, and activities along the route from Shibuya to Kamakura.

[1936] Task: Generate a travel plan suitable for a romantic date drive, ensuring to include scenic spots and quiet cafes.

[1937] 4. Send proposals and update them in real time

[1938] The server sends the generated proposed plan to the user's device. Once the user starts moving, the onboard computer periodically sends location information to the server using the GPS sensor. The server updates the proposed plan as needed based on this location information and real-time traffic and weather information, and resends it to the user's device.

[1939] 5. Emotion recognition and proposal plan adjustment

[1940] The system recognizes the user's emotions using the vehicle's camera and microphone. Using an emotion recognition API, the system analyzes the user's emotional data and adjusts the proposed plan based on their emotional state. For example, if the user is feeling stressed, it will suggest places to relax, and if the user is having fun, it will add spots to maintain that emotion.

[1941] In this way, it is possible to provide personalized proposals based on user attributes, real-time location information, and emotions.

[1942] As a concrete example, if a couple plans a date drive from Shibuya to Kamakura, the system will collect tourist attractions and restaurants between Shibuya and Kamakura and suggest places like sunset spots on Enoshima or quiet cafes in Kita-Kamakura. New suggestions will be made as needed based on real-time location information and conditions during the trip, and if the weather worsens, alternatives such as indoor cafes or stylish bookstores will be suggested.

[1943] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1944] Step 1:

[1945] The user inputs the departure point and destination via the in-car display or smartphone app, as well as the purpose of the trip (e.g., date, solo trip, family trip, etc.). The input information is sent from the device to the server in the form of departure point, destination, and purpose of the trip.

[1946] Step 2:

[1947] The server collects data on tourist spots, restaurants, events, and activities around the specified route and destination based on the received departure and destination information. Web scraping libraries (BeautifulSoup and Scrapy) are used to collect this data. The input is the departure and destination information, and the output is a list of tourist spots, restaurants, events, and activities.

[1948] Step 3:

[1949] The server filters the collected information based on the purpose and user attributes, generating a suggested itinerary that is optimal for the user. A generative AI model (OpenAI GPT-4) is used to create a travel plan based on the collected data and user profile (age, interests, etc.). The input is the collected tourist destination information and user profile, and the output is a filtered suggested itinerary.

[1950] Step 4:

[1951] The server sends the generated proposed plan to the terminal. The user can check the sent proposed plan on the in-car display or smartphone. The input is the proposed plan, and the output is the plan displayed on the user terminal.

[1952] Step 5:

[1953] When a user starts moving, the device periodically transmits location information to the server using the GPS sensor. The input is real-time location information, and the output is the transmission of location information to the server.

[1954] Step 6:

[1955] The server dynamically updates the proposed itinerary based on real-time location information, taking into account current traffic and weather conditions. This includes, for example, suggesting alternative routes when congestion is expected, or indoor activities when the weather worsens. The input is location information and real-time traffic and weather data, and the output is an updated proposed itinerary.

[1956] Step 7:

[1957] The terminal receives the updated proposed plan and displays it to the user in real time. The user can continue their journey based on the new proposals and changes. The input is the updated proposed plan and the output is the updated plan displayed on the user terminal.

[1958] Step 8:

[1959] Using the on-board camera and microphone, the device collects the user's emotional data, including voice input and facial expression detection. The input is the emotional data from the camera and microphone, and the output is the transmission of the emotional data to the server.

[1960] Step 9:

[1961] Using the emotion recognition API, the server analyzes the user's emotional data. Based on the analysis results, the proposed plan is adjusted to match the user's emotional state. For example, if the user is feeling stressed, the server will suggest a place where they can relax. The input is emotional data, and the output is a proposed plan adjusted based on the emotion.

[1962] Step 10:

[1963] The server retransmits the adjusted proposed plan to the terminal, which displays it to the user. The user can adjust their behavior based on the new proposal. The input is the adjusted proposed plan, and the output is the adjusted plan displayed on the user terminal.

[1964] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1965] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1966] In the above embod...

Claims

1. a means for the user to input origin and destination for a trip; A means for collecting information related to tourist attractions, restaurants, events, and activities along the way and at the destination based on the input origin and destination; means for filtering the collected information based on usage and attributes to generate a proposed plan; A means for transmitting the generated proposed plan to a user's terminal; A means of receiving real-time location information from users and updating proposed plans accordingly; A system including:

2. The system of claim 1 further comprising means for selecting and suggesting specific tourist spots, restaurants, events, and activities based on the user's attributes.

3. The system according to claim 1 , further comprising means for dynamically updating and presenting the proposed plan to the user based on the user's location information and current traffic and weather information.

Images