system

Abstract

We provide the system. [Solution] A means of receiving travel plan information from users, A means for collecting information on barrier-free facilities in a designated area and storing it in a database, Means for generating a travel route and facility information suitable for the user based on the aforementioned travel plan information, A means for receiving the user's current location information during travel and providing barrier-free facility information based on that current location, A means of receiving urgent support requests from users, providing immediate countermeasures, and working with support staff to resolve problems, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In order for wheelchair users to enjoy overseas travel comfortably and safely, it is necessary to collect a vast amount of information on barrier-free facilities at each travel destination and make appropriate plans. However, at present, the necessary information is not sufficient, and due to the lack of means to obtain quick and accurate information during travel, wheelchair users often feel inconvenience and difficulty when moving or sightseeing. Therefore, there is a demand for providing means that enable wheelchair users to efficiently utilize barrier-free information at travel destinations and respond to unexpected situations.

Means for Solving the Problems

[0005] This invention provides a system to support travel for wheelchair users, comprising means for receiving travel plan information from the user and providing optimal travel routes and facility information based on that information. Furthermore, the system can provide up-to-date information in real time by collecting barrier-free facility information in a predetermined area and storing it in a database. In addition, it can receive the user's current location information during travel and immediately provide necessary information, enabling a rapid response to unexpected situations. Each piece of information is standardized using a natural language processing model and provided in the most user-friendly format.

[0006] A "user" is an individual or group that uses the system to plan a trip.

[0007] "Travel plan information" refers to detailed information about the user's planned trip, such as the destination, date and time, and places to visit.

[0008] "Barrier-free facility information" refers to information about facilities that can be used by wheelchair users, and includes the locations of accessible toilets and elevators, as well as barrier-free restaurants.

[0009] A "database" is an information management system used to organize and store barrier-free facility information collected by a system.

[0010] A "travel route" is the optimal travel path and order of visits generated based on the user's travel plan.

[0011] "Real-time delivery" means providing the latest information instantly, tailored to the user's current location and situation.

[0012] An "emergency support request" is a means of communication that allows users to request support from the system when they encounter unexpected situations while traveling.

[0013] A "natural language processing model" is a machine learning technique used to analyze collected information and convert it into a standardized format. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0015] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] This invention is a support system for wheelchair users to travel comfortably. When a user inputs their travel plan using a terminal, the server generates an optimal travel route based on that information and presents relevant barrier-free facility information. The server collects barrier-free information for each region and stores it in a database. This information is standardized using a natural language processing model and stored in a structured format.

[0036] While traveling, users can access the server in real time using their device. The device sends the user's current location information to the server, which then searches for accessible facilities near the user based on that location. Specifically, it helps users move around safely by showing the locations of accessible toilets and elevators.

[0037] Furthermore, if a user encounters an unexpected situation while traveling, they can send an emergency support request from their device. Upon receiving this request, the server will immediately provide a solution and work with local support staff to quickly resolve the problem.

[0038] As a concrete example, let's consider a scenario where a user is planning a trip to Paris. The user inputs information such as "Paris" and "wheelchair-accessible tourist attractions" through their device. The server automatically searches for barrier-free tourist attractions in Paris and suggests a route. The suggested route can be customized according to the user's preferences, and real-time updates of surrounding barrier-free information are also provided. This allows the user to continue their trip safely and smoothly. In this way, this system provides comprehensive support to enable wheelchair users to enjoy traveling with peace of mind.

[0039] The following describes the processing flow.

[0040] Step 1:

[0041] The server collects accessibility information for various travel destinations from the internet. This information includes accessibility data for tourist attractions, transportation, accommodations, and restaurants, and the collected information is stored in a database.

[0042] Step 2:

[0043] The server uses a natural language processing model to analyze the collected barrier-free facility information and convert it into a standardized format. This organizes the information and allows it to be stored in a user-friendly format.

[0044] Step 3:

[0045] The user activates the device to plan their trip and enters their desired destinations and preferences. The device then sends this information to the server.

[0046] Step 4:

[0047] The server receives travel plan information submitted by the user, searches its database, and generates the optimal travel route and facility information. The generated information is customized according to the user's preferences.

[0048] Step 5:

[0049] The terminal receives travel routes and facility information generated from the server and displays them to the user. The user can then choose the travel plan that best suits their needs from the displayed options.

[0050] Step 6:

[0051] While traveling, users use their devices to send their current location information to the server. This allows the server to determine the user's current location.

[0052] Step 7:

[0053] The server identifies accessible facilities near the user based on their current location and sends the appropriate information to the terminal. The terminal displays the received information to the user, providing detailed route guidance and facility locations.

[0054] Step 8:

[0055] If a user encounters a situation requiring urgent support, they send an emergency support request from their device to the server. The server processes the request immediately, arranges for on-site support as needed, and returns instructions to the user.

[0056] (Example 1)

[0057] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0058] To ensure that diverse users, including wheelchair users, can enjoy safe and smooth travel, it is necessary to provide timely information on barrier-free facilities and propose optimal travel routes based on that information. However, systems that can automatically generate detailed travel plans tailored to individual needs and flexibly respond to unexpected situations during travel are still not sufficiently developed. This invention solves these problems.

[0059] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0060] In this invention, the server includes means for receiving travel plan information from users, means for collecting barrier-free facility information in the region and storing it in an information management device, and means for analyzing user requests using information analysis technology. This makes it possible to propose personalized travel routes to users and to present appropriate relevant facilities based on real-time location information.

[0061] "Users" refers to individuals who use the system to create travel plans or access information on barrier-free facilities.

[0062] "Travel plan information" refers to information entered by the user regarding the travel destination, itinerary, desired sightseeing spots, and other conditions.

[0063] "Region" refers to a specific geographical area that is the subject of a travel plan.

[0064] "Barrier-free facility information" refers to information about facilities and equipment that are easily accessible to all people, including wheelchair users.

[0065] An "information management device" refers to a database or storage system used to organize and store collected information.

[0066] "Information analysis technology" refers to technologies used for analyzing and processing data, particularly natural language processing models.

[0067] "Location information" refers to information that indicates the user's current geographical location while traveling.

[0068] "Travel route" refers to the travel route set based on the user's travel plan.

[0069] "Related facilities" refer to facilities and services that are relevant to the user's travel plans or current location and are accessible to them.

[0070] An "emergency response request" refers to a communication used to quickly seek assistance when a user encounters an unexpected situation while traveling.

[0071] This invention is a system designed to ensure that all travelers, including wheelchair users, can have a comfortable travel experience. Users can use a terminal to input their travel plans and obtain necessary information. The terminal uses a general-purpose computer or smartphone and connects to the server via the internet.

[0072] The server receives travel plan information sent by the user and generates the optimal travel route by referring to local barrier-free facility information stored in the information management device. The server accurately analyzes user requests and provides appropriate suggestions by using a natural language processing model as its information analysis technology. The specific software includes a general-purpose AI model as a natural language processing technology.

[0073] During their trip, users can access the server through their device and continuously send location information to obtain the latest facility information in real time. Based on the received location information, the server searches for nearby barrier-free facilities and, if necessary, suggests a more appropriate route to the user.

[0074] Furthermore, in the event of an unexpected situation, users can send an emergency response request to the server via their device. Upon receiving this request, the server will immediately provide a solution and, if necessary, contact local support staff. This process utilizes communication technology that enables real-time communication.

[0075] For example, when a user enters information such as "London" and "wheelchair-accessible museums," the server suggests the optimal route based on information about accessible museums in the London area. This suggestion is updated in real time with data from the trip, allowing the user to make choices that suit their situation at any given moment. By using a prompt such as "Suggest the best travel route for wheelchair users," the server provides the optimal travel experience tailored to the user's preferences.

[0076] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0077] Step 1:

[0078] The user enters travel plan information using a terminal. This includes the travel destination, dates, mode of transportation, and desired tourist spots. This entered information is output as data sent from the terminal to the server. Specifically, the user enters the necessary information using the interface and completes the process by pressing the submit button.

[0079] Step 2:

[0080] The server uses travel plan information received from the terminal to reference local barrier-free facility information stored in the information management device. The server then analyzes this information using information analysis technology to generate the optimal travel route. In this step, the input is the user's travel plan information, and the output is the optimal travel route and related facility information. Specifically, a generative AI model is used to analyze the user's requests in natural language and construct a corresponding travel plan.

[0081] Step 3:

[0082] The server sends the generated travel route and related facility information to the terminal. The user can review the route information received through the terminal and choose the most suitable plan from the options. The input for this step is the route information generated by the server, and the output is the options displayed on the user's terminal. Specifically, a list of routes is displayed on the terminal's display, and the user selects the one they want.

[0083] Step 4:

[0084] During travel, the user's device uses GPS to obtain current location information and sends it to the server. Based on the received location information, the server searches for real-time information on nearby barrier-free facilities and provides it to the user. The input for this step is the user's current location information, and the output is real-time information on nearby facilities based on that location. Specifically, the device has a function to periodically send location information to the server.

[0085] Step 5:

[0086] If a user encounters an unexpected emergency while traveling, they send an emergency response request from their device to the server. The server receives this request, promptly provides a response plan, and communicates with local support staff if necessary. The input for this step is the user's emergency response request, and the output is the response plan and, if possible, on-site support from local staff. Specifically, the user sends the request by pressing the emergency button on their device and follows the instructions from the server.

[0087] (Application Example 1)

[0088] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0089] In modern times, wheelchair users face problems such as a lack of barrier-free information and inadequate emergency support systems when traveling. In this situation, for wheelchair users to enjoy travel with peace of mind, the collection and presentation of barrier-free facility information and prompt support in emergencies are necessary. Therefore, the present invention aims to realize a travel support system that provides real-time barrier-free facility information for wheelchair users and enables rapid response in emergencies.

[0090] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0091] In this invention, the server includes means for receiving travel plan information from a user, means for collecting barrier-free facility information in a predetermined area and storing it in a database, and means for generating travel route and facility information suitable for the user based on the travel plan information. As a result, wheelchair users can obtain the latest barrier-free facility information at their destination in real time, enabling them to respond quickly to unexpected situations and travel with peace of mind.

[0092] "User travel plan information" refers to information that includes details about the places and routes that users wish to visit.

[0093] "Barrier-free facility information" refers to information about public and commercial facilities that are accessible to wheelchair users without any obstacles.

[0094] A "database" is a collection of structured data used to store collected information on barrier-free facilities and travel plans.

[0095] "Natural language processing technology" is the technology that enables computers to understand and process human language.

[0096] An "emergency assistance request" is a request for help from a user in an emergency situation while traveling.

[0097] "Support staff" are personnel who provide on-site assistance to users regarding the problems they face.

[0098] "Real-time updates" means constantly updating information in order to provide the latest information quickly.

[0099] The system implementing this invention is designed to enable wheelchair users to travel safely and efficiently. The server receives travel plan information from the user, collects information on barrier-free facilities in a designated area based on that information, and stores it in a database. Furthermore, it uses natural language processing technology to standardize the data and provide the user with the most suitable travel route and facility information. Real-time data updates ensure that users on the move always have access to the latest barrier-free information.

[0100] When a user provides their current location information using their device while traveling, the server uses that information to search for nearby accessible facilities and displays the information on the user's device. This process uses the Google® Maps API to obtain location information.

[0101] Furthermore, if a user requests emergency assistance, the server will immediately provide a solution and coordinate with local support staff. This allows users to resolve problems with peace of mind. For example, if a user is looking for an accessible toilet while traveling in Paris, the server can suggest the optimal route based on their location.

[0102] It is also possible to use prompts for the generated AI model, such as, "Please propose a travel plan that takes into account barrier-free tourist attractions and facilities in Paris so that wheelchair users can travel comfortably. Also, please show specific steps for developing an app that provides real-time information on barrier-free access in the surrounding area." In this way, the system makes travel safer and more comfortable for wheelchair users.

[0103] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0104] Step 1:

[0105] The user enters travel plan information using a terminal. The terminal receives the entered information (e.g., "Paris, wheelchair-accessible tourist attractions") and sends it to the server. Based on this information, the server analyzes the user's travel requirements.

[0106] Step 2:

[0107] The server searches its database for relevant accessibility information based on the received travel plan information. Using this database, the server collects information on the accessibility level and location of each facility. The input is travel plan information, and the output is accessibility information related to that plan.

[0108] Step 3:

[0109] The server standardizes the facility information collected using natural language processing technology. The input is raw data obtained from a database, and the output is data converted into a consistent format. In this process, a natural language processing model unifies the data.

[0110] Step 4:

[0111] The server generates travel routes and facility information tailored to the user based on standardized data. The input is standardized accessibility facility information, and the output is recommended travel routes and facility information. The server then sends this information to the terminal.

[0112] Step 5:

[0113] During travel, users send their current location information to the server in real time using their device. This allows the server to search for and update the latest accessibility facility information based on the user's current location. The input is the user's current location, and the output is facility information suitable for that location.

[0114] Step 6:

[0115] When a user requests emergency assistance, the terminal immediately sends the request to the server. The server receives the emergency assistance request, quickly devises a response plan, and works with relevant support staff to take action. The output is the support plan and the intervention of local staff.

[0116] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0117] This invention is a system that combines an emotion engine to help wheelchair users enjoy travel in a more comfortable and individually customized way. The user inputs their travel plan from a terminal, and the server receives this information. The server collects information on barrier-free facilities in a given area, standardizes it using a natural language processing model, and stores it in a database.

[0118] During their trip, users provide real-time location information to the server via their device. In addition, an emotion engine built into the device analyzes the user's emotional state and sends it to the server. Based on the user's location and emotional information, the server generates and updates optimal travel routes and facility information, and adjusts the plan as needed.

[0119] As a concrete example, consider a scenario where a user is feeling anxious while traveling in London. The emotion engine detects the user's emotions and notifies the server. The server immediately consults its database and suggests relaxation spots, quiet restaurants, and other options to alleviate the user's anxiety. The user can then review these options from their device and take actions that reduce their stress.

[0120] Furthermore, when the emotion engine recognizes that the user is ready to enjoy themselves, the server provides suggestions to enhance the activity, such as information on special sightseeing events or recommended scenic viewing spots. This system allows wheelchair users to experience a trip that best suits their emotional state at the time, thereby increasing their overall satisfaction with the trip.

[0121] The following describes the processing flow.

[0122] Step 1:

[0123] The user uses a device to enter their travel destination and desired conditions. The device then sends this information to the server.

[0124] Step 2:

[0125] Based on the received travel plan information, the server searches its database for the latest information on barrier-free facilities in the specified area and organizes it.

[0126] Step 3:

[0127] The server uses a natural language processing model to convert the organized barrier-free facility information into a standardized format and generates optimal travel routes and destinations for the user.

[0128] Step 4:

[0129] The terminal receives travel plans generated from the server and displays them to the user. The displayed plans can be customized according to the user's preferences.

[0130] Step 5:

[0131] During travel, the device's built-in emotion engine periodically analyzes the user's emotional state. This emotional information may be collected using user interactions and biometric data.

[0132] Step 6:

[0133] The device sends the analyzed emotional state information to the server. The server receives this information whenever the emotional state information is updated.

[0134] Step 7:

[0135] The server readjusts travel routes and facility suggestions based on the user's emotional state and current location. For example, if the user is feeling stressed, the server will suggest places where relaxation is possible.

[0136] Step 8:

[0137] The terminal receives updated information from the server and presents it to the user. The user can then use the suggested options to take action appropriate to the situation.

[0138] Step 9:

[0139] If a user requires urgent support, they send an emergency request from their device to the server. The server responds quickly and provides the necessary support information.

[0140] (Example 2)

[0141] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0142] This initiative aims to address the challenge faced by travelers, including wheelchair users, in finding barrier-free environments at their destinations and experiencing optimal tourism tailored to their individual emotional states. Furthermore, it requires dynamically adjusting travel plans based on the individual traveler's condition and emotions to enhance travel satisfaction.

[0143] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0144] In this invention, the server includes means for receiving travel planning information from users, means for collecting barrier-free facility data in a predetermined area and storing it in an information storage device, and means for analyzing the user's emotional state using an emotion analysis device and dynamically updating travel route and facility data based on the analysis. This allows travelers to receive in real time the routes and facilities best suited to their specific needs and emotions.

[0145] A "user" refers to an individual who uses the system to plan a trip and receives support during their trip.

[0146] "Tourism planning information" refers to information that users input into the system, such as travel destinations, itineraries, and accessibility needs.

[0147] An "information storage device" refers to a database that records and stores various types of information processed by a system, such as travel plan information and facility data.

[0148] A "tour route" refers to the path a user should take during their trip, or route information to their destination.

[0149] "Facility data" refers to information about various facilities, including barrier-free facilities, and describes locations that have been prepared to be easily accessible to users.

[0150] "Current location data" refers to information about the user's current geographical location while traveling.

[0151] An "emotion analysis device" refers to a device or program that analyzes a user's emotional state based on their voice and facial expression data.

[0152] A "generative AI model" refers to an artificial intelligence model used to generate appropriate suggestions based on the user's state.

[0153] To implement this invention, a system is primarily constructed in which a server, a terminal, and a user cooperate. First, the user uses the terminal to input travel plan information. This information includes destination, itinerary, and special requests such as accessibility needs, and the terminal transmits this as digital data to the server.

[0154] Next, the server collects barrier-free facility data for a specified area based on the received travel plan information. In this process, the server uses scraping tools to search open data on the internet and databases of partner organizations, standardizes the collected data, and stores it in an information storage device. Generative AI models are used for standardization. Specific examples include the use of natural language processing models such as BERT and GPT-3(registered trademark).

[0155] During travel, the device acquires the user's current location data and sends it to the server. Simultaneously, the device is equipped with an emotion analysis device that analyzes the user's emotional state based on their voice and facial expression data. This analysis result is also sent to the server.

[0156] The server generates optimal sightseeing routes and facility data for the user based on current location data and sentiment information, and dynamically updates them as needed. This can utilize prompts generated using a generative AI model. Examples of specific prompts include, "Please provide a list of quiet places in London," and "What are some active spots to visit if the user is ready to have fun?"

[0157] This invention allows users to receive real-time options best suited to their needs and emotional state, thereby improving their comfort and satisfaction during travel.

[0158] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0159] Step 1:

[0160] The user enters travel plan information into the terminal. This includes planned destinations, dates, and accessibility needs. The terminal converts the entered information into a digital format and sends it to the server. The input is the user's travel plan data, and the output is the digitized plan information sent to the server.

[0161] Step 2:

[0162] The server receives travel plan information and collects barrier-free facility data from online databases and partner organizations. The server uses scraping tools to obtain data for specific regions. The input is travel plan information, and the output is the collected raw data. A generative AI model is used to standardize the data through natural language processing and store it in an information storage device.

[0163] Step 3:

[0164] During travel, the user sends real-time location data from their device to the server. A built-in emotion analyzer in the device analyzes the user's voice and facial expressions to detect their emotional state. The inputs are real-time location data and emotion analysis data, and the output is the information sent to the server.

[0165] Step 4:

[0166] The server receives current location data and emotional state, and generates optimal sightseeing routes and facility data. Using a generative AI model, the server creates prompt sentences and generates suggestions based on them. The input is current location data and emotional information, and the output is optimal sightseeing routes and facility data. Specifically, it might suggest quiet places or recommend lively events.

[0167] Step 5:

[0168] The server sends the generated suggestions to the terminal. The terminal provides this information to the user, presenting it visually or audibly. Based on the information provided, the user decides on their destination and actions. The input is the suggestion data from the server, and the output is the specific choices presented to the user.

[0169] (Application Example 2)

[0170] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0171] Factors that hinder wheelchair users from enjoying travel in a more comfortable and individually tailored way include a lack of information on barrier-free facilities, difficulty in sharing that information, and insufficient support and planning tailored to their emotional state during travel. Addressing these challenges is essential.

[0172] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0173] In this invention, the server includes means for analyzing the user's emotional state and adjusting travel routes and facility information based on the analysis results; means for receiving the user's current location information during the trip and providing easily accessible facility information based on the current location; and means for standardizing barrier-free facility information using a natural language processing model. This makes it possible to provide optimal travel plans and barrier-free facility information tailored to the traveler's emotions and current situation.

[0174] A "user" is someone who uses the system to plan a trip and actually travels.

[0175] "Travel plan information" refers to the details of the date, time, destination, and activities based on the user's interests and preferences that they have selected for their trip.

[0176] "Accessible facility information" refers to information about buildings and locations that have been designed with barrier-free access in mind, and provides details about facilities that users can access smoothly.

[0177] A "data set" is a collection of information that has been organized and stored in a way that allows for later analysis and processing.

[0178] "Current location information" refers to data about the specific location where the user is while traveling.

[0179] "Emotional state" refers to the state of a user's mental and psychological state, and is captured by emotion recognition technology.

[0180] "Analysis results" refer to the conclusions or states that the system has derived from analyzing the collected data.

[0181] "Adjustment" refers to the act of changing information regarding the travel route and facilities during a trip according to the user's condition and preferences.

[0182] The system implementing this application example is built around a server and user terminals. The server performs the primary functions of data collection, analysis, and information provision. The server is configured as a standard web server and runs on a cloud platform. Specifically, it utilizes a server unit with a processor and sufficient memory, and uses Node.js as the software platform. In addition, a natural language processing model is used to standardize barrier-free facility information.

[0183] The device functions as an interface with the user and runs on a smartphone. Emotional state analysis uses data collected via the camera and the Microsoft® Azure® Emotion API. The device displays received travel route and facility information on its screen, offering choices.

[0184] The server organizes the collected barrier-free facility information using natural language processing technology and stores it as a data set. It also tracks the user's current location in real time during their trip, generates appropriate travel plans and facility information based on the user's emotional state, and provides them to the user's device. Users can then make choices based on the presented information and customize their travel experience.

[0185] For example, if the server detects signs of stress in the user during their trip, it might suggest a nearby quiet park or cafe. An example of a prompt message might be: "Please suggest places to alleviate the user's stress. Additionally, please consider how to retrieve information about art events and add them to the travel plan."

[0186] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0187] Step 1:

[0188] The terminal receives travel plan information from the user. This input information includes destination, dates, and activities of interest. The terminal sends this information to the server and prepares for the next step.

[0189] Step 2:

[0190] The server collects easily accessible facility information in a given area based on the received travel plan information. The server collects this data using external services such as the Google Places API, standardizes it using natural language processing technology, and stores it in a data set.

[0191] Step 3:

[0192] During travel, the device acquires the user's current location information in real time and sends it to the server. Based on this input information, the server identifies easily accessible facilities in the vicinity of the current location and prepares to generate the next suggestion.

[0193] Step 4:

[0194] The device uses its camera to analyze the user's emotional state. It utilizes the Microsoft Azure Emotion API for this analysis, sending emotional state data to a server. The server then uses this data to understand the user's state and gather information to adjust the travel plan.

[0195] Step 5:

[0196] The server receives current location information and sentiment analysis results as input and generates optimal travel routes and facility information for the user. The generated information is then analyzed using a generative AI model to determine which spots would be stress-relieving and which activities would be of interest to each user.

[0197] Step 6:

[0198] The server sends the generated travel route and facility information to the terminal. The terminal displays this information on its screen, allowing the user to select and decide on their actions. The user then customizes their trip based on the information from the server.

[0199] Step 7:

[0200] When a user inputs their preferences into the terminal, such as feeling stressed and seeking relaxation, or conversely, wanting to increase their activity level, the terminal sends this information to the server, which generates a prompt message and updates the data. Based on this prompt message, the server generates the most suitable information again.

[0201] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0202] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0203] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0204] [Second Embodiment]

[0205] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0206] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0207] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0208] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0209] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0210] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0211] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0212] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0213] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0214] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0215] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0216] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0217] This invention is a support system for wheelchair users to travel comfortably. When a user inputs their travel plan using a terminal, the server generates an optimal travel route based on that information and presents relevant barrier-free facility information. The server collects barrier-free information for each region and stores it in a database. This information is standardized using a natural language processing model and stored in a structured format.

[0218] While traveling, users can access the server in real time using their device. The device sends the user's current location information to the server, which then searches for accessible facilities near the user based on that location. Specifically, it helps users move around safely by showing the locations of accessible toilets and elevators.

[0219] Furthermore, if a user encounters an unexpected situation while traveling, they can send an emergency support request from their device. Upon receiving this request, the server will immediately provide a solution and work with local support staff to quickly resolve the problem.

[0220] As a concrete example, let's consider a scenario where a user is planning a trip to Paris. The user inputs information such as "Paris" and "wheelchair-accessible tourist attractions" through their device. The server automatically searches for barrier-free tourist attractions in Paris and suggests a route. The suggested route can be customized according to the user's preferences, and real-time updates of surrounding barrier-free information are also provided. This allows the user to continue their trip safely and smoothly. In this way, this system provides comprehensive support to enable wheelchair users to enjoy traveling with peace of mind.

[0221] The following describes the processing flow.

[0222] Step 1:

[0223] The server collects accessibility information for various travel destinations from the internet. This information includes accessibility data for tourist attractions, transportation, accommodations, and restaurants, and the collected information is stored in a database.

[0224] Step 2:

[0225] The server uses a natural language processing model to analyze the collected barrier-free facility information and convert it into a standardized format. This organizes the information and allows it to be stored in a user-friendly format.

[0226] Step 3:

[0227] The user activates the device to plan their trip and enters their desired destinations and preferences. The device then sends this information to the server.

[0228] Step 4:

[0229] The server receives travel plan information submitted by the user, searches its database, and generates the optimal travel route and facility information. The generated information is customized according to the user's preferences.

[0230] Step 5:

[0231] The terminal receives travel routes and facility information generated from the server and displays them to the user. The user can then choose the travel plan that best suits their needs from the displayed options.

[0232] Step 6:

[0233] While traveling, users use their devices to send their current location information to the server. This allows the server to determine the user's current location.

[0234] Step 7:

[0235] The server identifies accessible facilities near the user based on their current location and sends the appropriate information to the terminal. The terminal displays the received information to the user, providing detailed route guidance and facility locations.

[0236] Step 8:

[0237] If a user encounters a situation requiring urgent support, they send an emergency support request from their device to the server. The server processes the request immediately, arranges for on-site support as needed, and returns instructions to the user.

[0238] (Example 1)

[0239] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0240] To ensure that diverse users, including wheelchair users, can enjoy safe and smooth travel, it is necessary to provide timely information on barrier-free facilities and propose optimal travel routes based on that information. However, systems that can automatically generate detailed travel plans tailored to individual needs and flexibly respond to unexpected situations during travel are still not sufficiently developed. This invention solves these problems.

[0241] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0242] In this invention, the server includes means for receiving travel plan information from users, means for collecting barrier-free facility information in the region and storing it in an information management device, and means for analyzing user requests using information analysis technology. This makes it possible to propose personalized travel routes to users and to present appropriate relevant facilities based on real-time location information.

[0243] "Users" refers to individuals who use the system to create travel plans or access information on barrier-free facilities.

[0244] "Travel plan information" refers to information entered by the user regarding the travel destination, itinerary, desired sightseeing spots, and other conditions.

[0245] "Region" refers to a specific geographical area that is the subject of a travel plan.

[0246] "Barrier-free facility information" refers to information about facilities and equipment that are easily accessible to all people, including wheelchair users.

[0247] An "information management device" refers to a database or storage system used to organize and store collected information.

[0248] "Information analysis technology" refers to technologies used for analyzing and processing data, particularly natural language processing models.

[0249] "Location information" refers to information that indicates the user's current geographical location while traveling.

[0250] "Travel route" refers to the travel route set based on the user's travel plan.

[0251] "Related facilities" refer to facilities and services that are relevant to the user's travel plans or current location and are accessible to them.

[0252] An "emergency response request" refers to a communication used to quickly seek assistance when a user encounters an unexpected situation while traveling.

[0253] This invention is a system designed to ensure that all travelers, including wheelchair users, can have a comfortable travel experience. Users can use a terminal to input their travel plans and obtain necessary information. The terminal uses a general-purpose computer or smartphone and connects to the server via the internet.

[0254] The server receives travel plan information sent by the user and generates the optimal travel route by referring to local barrier-free facility information stored in the information management device. The server accurately analyzes user requests and provides appropriate suggestions by using a natural language processing model as its information analysis technology. The specific software includes a general-purpose AI model as a natural language processing technology.

[0255] During their trip, users can access the server through their device and continuously send location information to obtain the latest facility information in real time. Based on the received location information, the server searches for nearby barrier-free facilities and, if necessary, suggests a more appropriate route to the user.

[0256] Furthermore, in the event of an unexpected situation, users can send an emergency response request to the server via their device. Upon receiving this request, the server will immediately provide a solution and, if necessary, contact local support staff. This process utilizes communication technology that enables real-time communication.

[0257] For example, when a user enters information such as "London" and "wheelchair-accessible museums," the server suggests the optimal route based on information about accessible museums in the London area. This suggestion is updated in real time with data from the trip, allowing the user to make choices that suit their situation at any given moment. By using a prompt such as "Suggest the best travel route for wheelchair users," the server provides the optimal travel experience tailored to the user's preferences.

[0258] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0259] Step 1:

[0260] The user enters travel plan information using a terminal. This includes the travel destination, dates, mode of transportation, and desired tourist spots. This entered information is output as data sent from the terminal to the server. Specifically, the user enters the necessary information using the interface and completes the process by pressing the submit button.

[0261] Step 2:

[0262] The server uses travel plan information received from the terminal to reference local barrier-free facility information stored in the information management device. The server then analyzes this information using information analysis technology to generate the optimal travel route. In this step, the input is the user's travel plan information, and the output is the optimal travel route and related facility information. Specifically, a generative AI model is used to analyze the user's requests in natural language and construct a corresponding travel plan.

[0263] Step 3:

[0264] The server sends the generated travel route and related facility information to the terminal. The user can review the route information received through the terminal and choose the most suitable plan from the options. The input for this step is the route information generated by the server, and the output is the options displayed on the user's terminal. Specifically, a list of routes is displayed on the terminal's display, and the user selects the one they want.

[0265] Step 4:

[0266] During travel, the user's device uses GPS to obtain current location information and sends it to the server. Based on the received location information, the server searches for real-time information on nearby barrier-free facilities and provides it to the user. The input for this step is the user's current location information, and the output is real-time information on nearby facilities based on that location. Specifically, the device has a function to periodically send location information to the server.

[0267] Step 5:

[0268] If a user encounters an unexpected emergency while traveling, they send an emergency response request from their device to the server. The server receives this request, promptly provides a response plan, and communicates with local support staff if necessary. The input for this step is the user's emergency response request, and the output is the response plan and, if possible, on-site support from local staff. Specifically, the user sends the request by pressing the emergency button on their device and follows the instructions from the server.

[0269] (Application Example 1)

[0270] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0271] In modern times, wheelchair users face problems such as a lack of barrier-free information and inadequate emergency support systems when traveling. In this situation, for wheelchair users to enjoy travel with peace of mind, the collection and presentation of barrier-free facility information and prompt support in emergencies are necessary. Therefore, the present invention aims to realize a travel support system that provides real-time barrier-free facility information for wheelchair users and enables rapid response in emergencies.

[0272] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0273] In this invention, the server includes means for receiving travel plan information from a user, means for collecting barrier-free facility information in a predetermined area and storing it in a database, and means for generating travel route and facility information suitable for the user based on the travel plan information. As a result, wheelchair users can obtain the latest barrier-free facility information at their destination in real time, enabling them to respond quickly to unexpected situations and travel with peace of mind.

[0274] "User travel plan information" refers to information that includes details about the places and routes that users wish to visit.

[0275] "Barrier-free facility information" refers to information about public and commercial facilities that are accessible to wheelchair users without any obstacles.

[0276] A "database" is a collection of structured data used to store collected information on barrier-free facilities and travel plans.

[0277] "Natural language processing technology" is the technology that enables computers to understand and process human language.

[0278] An "emergency assistance request" is a request for help from a user in an emergency situation while traveling.

[0279] "Support staff" are personnel who provide on-site assistance to users regarding the problems they face.

[0280] "Real-time updates" means constantly updating information in order to provide the latest information quickly.

[0281] The system implementing this invention is designed to enable wheelchair users to travel safely and efficiently. The server receives travel plan information from the user, collects information on barrier-free facilities in a designated area based on that information, and stores it in a database. Furthermore, it uses natural language processing technology to standardize the data and provide the user with the most suitable travel route and facility information. Real-time data updates ensure that users on the move always have access to the latest barrier-free information.

[0282] When a user provides their current location information using their device while traveling, the server uses that information to search for nearby accessible facilities and displays the information on the user's device. This process uses the Google Maps API to obtain location information.

[0283] Also, when the user requests emergency assistance, the server immediately provides countermeasures and coordinates with local support staff. This enables the user to solve problems with peace of mind. As a specific example, when the user is searching for a wheelchair-accessible toilet during a trip in Paris, the server can present an optimal route based on the location information.

[0284] It is also possible to utilize a prompt sentence for a generative AI model such as "Please propose a travel plan considering wheelchair-accessible tourist attractions and facilities in Paris so that wheelchair users can travel comfortably. Also, please show the specific steps for developing an app that provides real-time wheelchair-accessible information in the vicinity." In this way, the system makes travel safer and more comfortable for wheelchair users.

[0285] The flow of the specific process in Application Example 1 will be described using FIG. 12.

[0286] Step 1:

[0287] The user uses the terminal to input travel plan information. The terminal receives the input information (e.g., "Paris, wheelchair-accessible tourist attractions") and transmits it to the server. Based on this information, the server analyzes the user's requirements regarding the trip.

[0288] Step 2:

[0289] Based on the received travel plan information, the server searches the database for relevant wheelchair-accessible facility information. The server uses this database to collect the wheelchair-accessibility level and location information of each facility. The input is the travel plan information, and the output is the wheelchair-accessible information related to that plan.

[0290] Step 3:

[0291] The server standardizes the facility information collected using natural language processing technology. The input is raw data obtained from a database, and the output is data converted into a consistent format. In this process, a natural language processing model unifies the data.

[0292] Step 4:

[0293] The server generates travel routes and facility information tailored to the user based on standardized data. The input is standardized accessibility facility information, and the output is recommended travel routes and facility information. The server then sends this information to the terminal.

[0294] Step 5:

[0295] During travel, users send their current location information to the server in real time using their device. This allows the server to search for and update the latest accessibility facility information based on the user's current location. The input is the user's current location, and the output is facility information suitable for that location.

[0296] Step 6:

[0297] When a user requests emergency assistance, the terminal immediately sends the request to the server. The server receives the emergency assistance request, quickly devises a response plan, and works with relevant support staff to take action. The output is the support plan and the intervention of local staff.

[0298] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0299] This invention is a system that combines an emotion engine to help wheelchair users enjoy travel in a more comfortable and individually customized way. The user inputs their travel plan from a terminal, and the server receives this information. The server collects information on barrier-free facilities in a given area, standardizes it using a natural language processing model, and stores it in a database.

[0300] During their trip, users provide real-time location information to the server via their device. In addition, an emotion engine built into the device analyzes the user's emotional state and sends it to the server. Based on the user's location and emotional information, the server generates and updates optimal travel routes and facility information, and adjusts the plan as needed.

[0301] As a concrete example, consider a scenario where a user is feeling anxious while traveling in London. The emotion engine detects the user's emotions and notifies the server. The server immediately consults its database and suggests relaxation spots, quiet restaurants, and other options to alleviate the user's anxiety. The user can then review these options from their device and take actions that reduce their stress.

[0302] Furthermore, when the emotion engine recognizes that the user is ready to enjoy themselves, the server provides suggestions to enhance the activity, such as information on special sightseeing events or recommended scenic viewing spots. This system allows wheelchair users to experience a trip that best suits their emotional state at the time, thereby increasing their overall satisfaction with the trip.

[0303] The following describes the processing flow.

[0304] Step 1:

[0305] The user uses a device to enter their travel destination and desired conditions. The device then sends this information to the server.

[0306] Step 2:

[0307] Based on the received travel plan information, the server searches for and organizes the latest barrier-free facility information in a predetermined area from the database.

[0308] Step 3:

[0309] Using a natural language processing model, the server converts the organized barrier-free facility information into a standardized format and generates an optimal travel route and visiting destinations for the user.

[0310] Step 4:

[0311] The terminal receives the travel plan generated by the server and displays it to the user. The displayed plan can be customized according to the user's preferences.

[0312] Step 5:

[0313] During the trip, the emotion engine installed on the terminal periodically analyzes the user's emotional state. This emotional information may be collected using the user's interactions and biometric data.

[0314] Step 6:

[0315] The terminal sends the analyzed emotional state information to the server. Each time the emotional information is updated, the server receives it.

[0316] Step 7:

[0317] Based on the user's emotional state and current location information, the server readjusts the travel route and facility suggestions. For example, if the user is feeling stressed, the server suggests places where relaxation is possible.

[0318] Step 8:

[0319] The terminal receives updated information from the server and presents it to the user. The user can then use the suggested options to take action appropriate to the situation.

[0320] Step 9:

[0321] If a user requires urgent support, they send an emergency request from their device to the server. The server responds quickly and provides the necessary support information.

[0322] (Example 2)

[0323] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0324] This initiative aims to address the challenge faced by travelers, including wheelchair users, in finding barrier-free environments at their destinations and experiencing optimal tourism tailored to their individual emotional states. Furthermore, it requires dynamically adjusting travel plans based on the individual traveler's condition and emotions to enhance travel satisfaction.

[0325] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0326] In this invention, the server includes means for receiving travel planning information from users, means for collecting barrier-free facility data in a predetermined area and storing it in an information storage device, and means for analyzing the user's emotional state using an emotion analysis device and dynamically updating travel route and facility data based on the analysis. This allows travelers to receive in real time the routes and facilities best suited to their specific needs and emotions.

[0327] A "user" refers to an individual who uses the system to plan a trip and receives support during their trip.

[0328] "Tourism planning information" refers to information that users input into the system, such as travel destinations, itineraries, and accessibility needs.

[0329] An "information storage device" refers to a database that records and stores various types of information processed by a system, such as travel plan information and facility data.

[0330] A "tour route" refers to the path a user should take during their trip, or route information to their destination.

[0331] "Facility data" refers to information about various facilities, including barrier-free facilities, and describes locations that have been prepared to be easily accessible to users.

[0332] "Current location data" refers to information about the user's current geographical location while traveling.

[0333] An "emotion analysis device" refers to a device or program that analyzes a user's emotional state based on their voice and facial expression data.

[0334] A "generative AI model" refers to an artificial intelligence model used to generate appropriate suggestions based on the user's state.

[0335] To implement this invention, a system is primarily constructed in which a server, a terminal, and a user cooperate. First, the user uses the terminal to input travel plan information. This information includes destination, itinerary, and special requests such as accessibility needs, and the terminal transmits this as digital data to the server.

[0336] Next, the server collects barrier-free facility data for a specified area based on the received travel plan information. In this process, the server uses scraping tools to search open data on the internet and databases of partner organizations, standardizes the collected data, and stores it in an information storage device. Generative AI models are used for standardization. Specific examples include the use of natural language processing models such as BERT and GPT-3.

[0337] During travel, the device acquires the user's current location data and sends it to the server. Simultaneously, the device is equipped with an emotion analysis device that analyzes the user's emotional state based on their voice and facial expression data. This analysis result is also sent to the server.

[0338] The server generates optimal sightseeing routes and facility data for the user based on current location data and sentiment information, and dynamically updates them as needed. This can utilize prompts generated using a generative AI model. Examples of specific prompts include, "Please provide a list of quiet places in London," and "What are some active spots to visit if the user is ready to have fun?"

[0339] This invention allows users to receive real-time options best suited to their needs and emotional state, thereby improving their comfort and satisfaction during travel.

[0340] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0341] Step 1:

[0342] The user enters travel plan information into the terminal. This includes planned destinations, dates, and accessibility needs. The terminal converts the entered information into a digital format and sends it to the server. The input is the user's travel plan data, and the output is the digitized plan information sent to the server.

[0343] Step 2:

[0344] The server receives travel plan information and collects barrier-free facility data from online databases and partner organizations. The server uses scraping tools to obtain data for specific regions. The input is travel plan information, and the output is the collected raw data. A generative AI model is used to standardize the data through natural language processing and store it in an information storage device.

[0345] Step 3:

[0346] During travel, the user sends real-time location data from their device to the server. A built-in emotion analyzer in the device analyzes the user's voice and facial expressions to detect their emotional state. The inputs are real-time location data and emotion analysis data, and the output is the information sent to the server.

[0347] Step 4:

[0348] The server receives current location data and emotional state, and generates optimal sightseeing routes and facility data. Using a generative AI model, the server creates prompt sentences and generates suggestions based on them. The input is current location data and emotional information, and the output is optimal sightseeing routes and facility data. Specifically, it might suggest quiet places or recommend lively events.

[0349] Step 5:

[0350] The server sends the generated suggestions to the terminal. The terminal provides this information to the user, presenting it visually or audibly. Based on the information provided, the user decides on their destination and actions. The input is the suggestion data from the server, and the output is the specific choices presented to the user.

[0351] (Application Example 2)

[0352] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0353] Factors that hinder wheelchair users from enjoying travel in a more comfortable and individually tailored way include a lack of information on barrier-free facilities, difficulty in sharing that information, and insufficient support and planning tailored to their emotional state during travel. Addressing these challenges is essential.

[0354] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0355] In this invention, the server includes means for analyzing the user's emotional state and adjusting travel routes and facility information based on the analysis results; means for receiving the user's current location information during the trip and providing easily accessible facility information based on the current location; and means for standardizing barrier-free facility information using a natural language processing model. This makes it possible to provide optimal travel plans and barrier-free facility information tailored to the traveler's emotions and current situation.

[0356] A "user" is someone who uses the system to plan a trip and actually travels.

[0357] "Travel plan information" refers to the details of the date, time, destination, and activities based on the user's interests and preferences that they have selected for their trip.

[0358] "Accessible facility information" refers to information about buildings and locations that have been designed with barrier-free access in mind, and provides details about facilities that users can access smoothly.

[0359] A "data set" is a collection of information that has been organized and stored in a way that allows for later analysis and processing.

[0360] "Current location information" refers to data about the specific location where the user is while traveling.

[0361] "Emotional state" refers to the state of a user's mental and psychological state, and is captured by emotion recognition technology.

[0362] "Analysis results" refer to the conclusions or states that the system has derived from analyzing the collected data.

[0363] "Adjustment" refers to the act of changing information regarding the travel route and facilities during a trip according to the user's condition and preferences.

[0364] The system implementing this application example is built around a server and user terminals. The server performs the primary functions of data collection, analysis, and information provision. The server is configured as a standard web server and runs on a cloud platform. Specifically, it utilizes a server unit with a processor and sufficient memory, and uses Node.js as the software platform. In addition, a natural language processing model is used to standardize barrier-free facility information.

[0365] The device functions as an interface with the user and runs on a smartphone. Emotional state analysis is performed by collecting data via the camera and using the Microsoft Azure Emotion API. The device displays received travel route and facility information on its screen, offering choices.

[0366] The server organizes the collected barrier-free facility information using natural language processing technology and stores it as a data set. It also tracks the user's current location in real time during their trip, generates appropriate travel plans and facility information based on the user's emotional state, and provides them to the user's device. Users can then make choices based on the presented information and customize their travel experience.

[0367] For example, if the server detects signs of stress in the user during their trip, it might suggest a nearby quiet park or cafe. An example of a prompt message might be: "Please suggest places to alleviate the user's stress. Additionally, please consider how to retrieve information about art events and add them to the travel plan."

[0368] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0369] Step 1:

[0370] The terminal receives travel plan information from the user. This input information includes destination, dates, and activities of interest. The terminal sends this information to the server and prepares for the next step.

[0371] Step 2:

[0372] The server collects easily accessible facility information in a given area based on the received travel plan information. The server collects this data using external services such as the Google Places API, standardizes it using natural language processing technology, and stores it in a data set.

[0373] Step 3:

[0374] During travel, the device acquires the user's current location information in real time and sends it to the server. Based on this input information, the server identifies easily accessible facilities in the vicinity of the current location and prepares to generate the next suggestion.

[0375] Step 4:

[0376] The device uses its camera to analyze the user's emotional state. It utilizes the Microsoft Azure Emotion API for this analysis, sending emotional state data to a server. The server then uses this data to understand the user's state and gather information to adjust the travel plan.

[0377] Step 5:

[0378] The server receives current location information and sentiment analysis results as input and generates optimal travel routes and facility information for the user. The generated information is then analyzed using a generative AI model to determine which spots would be stress-relieving and which activities would be of interest to each user.

[0379] Step 6:

[0380] The server sends the generated travel route and facility information to the terminal. The terminal displays this information on its screen, allowing the user to select and decide on their actions. The user then customizes their trip based on the information from the server.

[0381] Step 7:

[0382] When a user inputs their preferences into the terminal, such as feeling stressed and seeking relaxation, or conversely, wanting to increase their activity level, the terminal sends this information to the server, which generates a prompt message and updates the data. Based on this prompt message, the server generates the most suitable information again.

[0383] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0384] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0385] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0386] [Third Embodiment]

[0387] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0388] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0389] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0390] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0391] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0392] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0393] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0394] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0395] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0396] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0397] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0398] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0399] This invention is a support system for wheelchair users to travel comfortably. When a user inputs their travel plan using a terminal, the server generates an optimal travel route based on that information and presents relevant barrier-free facility information. The server collects barrier-free information for each region and stores it in a database. This information is standardized using a natural language processing model and stored in a structured format.

[0400] While traveling, users can access the server in real time using their device. The device sends the user's current location information to the server, which then searches for accessible facilities near the user based on that location. Specifically, it helps users move around safely by showing the locations of accessible toilets and elevators.

[0401] Furthermore, if a user encounters an unexpected situation while traveling, they can send an emergency support request from their device. Upon receiving this request, the server will immediately provide a solution and work with local support staff to quickly resolve the problem.

[0402] As a concrete example, let's consider a scenario where a user is planning a trip to Paris. The user inputs information such as "Paris" and "wheelchair-accessible tourist attractions" through their device. The server automatically searches for barrier-free tourist attractions in Paris and suggests a route. The suggested route can be customized according to the user's preferences, and real-time updates of surrounding barrier-free information are also provided. This allows the user to continue their trip safely and smoothly. In this way, this system provides comprehensive support to enable wheelchair users to enjoy traveling with peace of mind.

[0403] The following describes the processing flow.

[0404] Step 1:

[0405] The server collects accessibility information for various travel destinations from the internet. This information includes accessibility data for tourist attractions, transportation, accommodations, and restaurants, and the collected information is stored in a database.

[0406] Step 2:

[0407] The server uses a natural language processing model to analyze the collected barrier-free facility information and convert it into a standardized format. This organizes the information and allows it to be stored in a user-friendly format.

[0408] Step 3:

[0409] The user activates the device to plan their trip and enters their desired destinations and preferences. The device then sends this information to the server.

[0410] Step 4:

[0411] The server receives travel plan information submitted by the user, searches its database, and generates the optimal travel route and facility information. The generated information is customized according to the user's preferences.

[0412] Step 5:

[0413] The terminal receives travel routes and facility information generated from the server and displays them to the user. The user can then choose the travel plan that best suits their needs from the displayed options.

[0414] Step 6:

[0415] While traveling, users use their devices to send their current location information to the server. This allows the server to determine the user's current location.

[0416] Step 7:

[0417] The server identifies accessible facilities near the user based on their current location and sends the appropriate information to the terminal. The terminal displays the received information to the user, providing detailed route guidance and facility locations.

[0418] Step 8:

[0419] If a user encounters a situation requiring urgent support, they send an emergency support request from their device to the server. The server processes the request immediately, arranges for on-site support as needed, and returns instructions to the user.

[0420] (Example 1)

[0421] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0422] To ensure that diverse users, including wheelchair users, can enjoy safe and smooth travel, it is necessary to provide timely information on barrier-free facilities and propose optimal travel routes based on that information. However, systems that can automatically generate detailed travel plans tailored to individual needs and flexibly respond to unexpected situations during travel are still not sufficiently developed. This invention solves these problems.

[0423] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0424] In this invention, the server includes means for receiving travel plan information from users, means for collecting barrier-free facility information in the region and storing it in an information management device, and means for analyzing user requests using information analysis technology. This makes it possible to propose personalized travel routes to users and to present appropriate relevant facilities based on real-time location information.

[0425] "Users" refers to individuals who use the system to create travel plans or access information on barrier-free facilities.

[0426] "Travel plan information" refers to information entered by the user regarding the travel destination, itinerary, desired sightseeing spots, and other conditions.

[0427] "Region" refers to a specific geographical area that is the subject of a travel plan.

[0428] "Barrier-free facility information" refers to information about facilities and equipment that are easily accessible to all people, including wheelchair users.

[0429] An "information management device" refers to a database or storage system used to organize and store collected information.

[0430] "Information analysis technology" refers to technologies used for analyzing and processing data, particularly natural language processing models.

[0431] "Location information" refers to information that indicates the user's current geographical location while traveling.

[0432] "Travel route" refers to the travel route set based on the user's travel plan.

[0433] "Related facilities" refer to facilities and services that are relevant to the user's travel plans or current location and are accessible to them.

[0434] An "emergency response request" refers to a communication used to quickly seek assistance when a user encounters an unexpected situation while traveling.

[0435] This invention is a system designed to ensure that all travelers, including wheelchair users, can have a comfortable travel experience. Users can use a terminal to input their travel plans and obtain necessary information. The terminal uses a general-purpose computer or smartphone and connects to the server via the internet.

[0436] The server receives travel plan information sent by the user and generates the optimal travel route by referring to local barrier-free facility information stored in the information management device. The server accurately analyzes user requests and provides appropriate suggestions by using a natural language processing model as its information analysis technology. The specific software includes a general-purpose AI model as a natural language processing technology.

[0437] During their trip, users can access the server through their device and continuously send location information to obtain the latest facility information in real time. Based on the received location information, the server searches for nearby barrier-free facilities and, if necessary, suggests a more appropriate route to the user.

[0438] Furthermore, in the event of an unexpected situation, users can send an emergency response request to the server via their device. Upon receiving this request, the server will immediately provide a solution and, if necessary, contact local support staff. This process utilizes communication technology that enables real-time communication.

[0439] For example, when a user enters information such as "London" and "wheelchair-accessible museums," the server suggests the optimal route based on information about accessible museums in the London area. This suggestion is updated in real time with data from the trip, allowing the user to make choices that suit their situation at any given moment. By using a prompt such as "Suggest the best travel route for wheelchair users," the server provides the optimal travel experience tailored to the user's preferences.

[0440] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0441] Step 1:

[0442] The user enters travel plan information using a terminal. This includes the travel destination, dates, mode of transportation, and desired tourist spots. This entered information is output as data sent from the terminal to the server. Specifically, the user enters the necessary information using the interface and completes the process by pressing the submit button.

[0443] Step 2:

[0444] The server uses travel plan information received from the terminal to reference local barrier-free facility information stored in the information management device. The server then analyzes this information using information analysis technology to generate the optimal travel route. In this step, the input is the user's travel plan information, and the output is the optimal travel route and related facility information. Specifically, a generative AI model is used to analyze the user's requests in natural language and construct a corresponding travel plan.

[0445] Step 3:

[0446] The server sends the generated travel route and related facility information to the terminal. The user can review the route information received through the terminal and choose the most suitable plan from the options. The input for this step is the route information generated by the server, and the output is the options displayed on the user's terminal. Specifically, a list of routes is displayed on the terminal's display, and the user selects the one they want.

[0447] Step 4:

[0448] During travel, the user's device uses GPS to obtain current location information and sends it to the server. Based on the received location information, the server searches for real-time information on nearby barrier-free facilities and provides it to the user. The input for this step is the user's current location information, and the output is real-time information on nearby facilities based on that location. Specifically, the device has a function to periodically send location information to the server.

[0449] Step 5:

[0450] If a user encounters an unexpected emergency while traveling, they send an emergency response request from their device to the server. The server receives this request, promptly provides a response plan, and communicates with local support staff if necessary. The input for this step is the user's emergency response request, and the output is the response plan and, if possible, on-site support from local staff. Specifically, the user sends the request by pressing the emergency button on their device and follows the instructions from the server.

[0451] (Application Example 1)

[0452] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0453] In modern times, wheelchair users face problems such as a lack of barrier-free information and inadequate emergency support systems when traveling. In this situation, for wheelchair users to enjoy travel with peace of mind, the collection and presentation of barrier-free facility information and prompt support in emergencies are necessary. Therefore, the present invention aims to realize a travel support system that provides real-time barrier-free facility information for wheelchair users and enables rapid response in emergencies.

[0454] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0455] In this invention, the server includes means for receiving travel plan information from a user, means for collecting barrier-free facility information in a predetermined area and storing it in a database, and means for generating travel route and facility information suitable for the user based on the travel plan information. As a result, wheelchair users can obtain the latest barrier-free facility information at their destination in real time, enabling them to respond quickly to unexpected situations and travel with peace of mind.

[0456] "User travel plan information" refers to information that includes details about the places and routes that users wish to visit.

[0457] "Barrier-free facility information" refers to information about public and commercial facilities that are accessible to wheelchair users without any obstacles.

[0458] A "database" is a collection of structured data used to store collected information on barrier-free facilities and travel plans.

[0459] "Natural language processing technology" is the technology that enables computers to understand and process human language.

[0460] An "emergency assistance request" is a request for help from a user in an emergency situation while traveling.

[0461] "Support staff" are personnel who provide on-site assistance to users regarding the problems they face.

[0462] "Real-time updates" means constantly updating information in order to provide the latest information quickly.

[0463] The system implementing this invention is designed to enable wheelchair users to travel safely and efficiently. The server receives travel plan information from the user, collects information on barrier-free facilities in a designated area based on that information, and stores it in a database. Furthermore, it uses natural language processing technology to standardize the data and provide the user with the most suitable travel route and facility information. Real-time data updates ensure that users on the move always have access to the latest barrier-free information.

[0464] When a user provides their current location information using their device while traveling, the server uses that information to search for nearby accessible facilities and displays the information on the user's device. This process uses the Google Maps API to obtain location information.

[0465] Furthermore, if a user requests emergency assistance, the server will immediately provide a solution and coordinate with local support staff. This allows users to resolve problems with peace of mind. For example, if a user is looking for an accessible toilet while traveling in Paris, the server can suggest the optimal route based on their location.

[0466] It is also possible to use prompts for the generated AI model, such as, "Please propose a travel plan that takes into account barrier-free tourist attractions and facilities in Paris so that wheelchair users can travel comfortably. Also, please show specific steps for developing an app that provides real-time information on barrier-free access in the surrounding area." In this way, the system makes travel safer and more comfortable for wheelchair users.

[0467] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0468] Step 1:

[0469] The user enters travel plan information using a terminal. The terminal receives the entered information (e.g., "Paris, wheelchair-accessible tourist attractions") and sends it to the server. Based on this information, the server analyzes the user's travel requirements.

[0470] Step 2:

[0471] The server searches its database for relevant accessibility information based on the received travel plan information. Using this database, the server collects information on the accessibility level and location of each facility. The input is travel plan information, and the output is accessibility information related to that plan.

[0472] Step 3:

[0473] The server standardizes the facility information collected using natural language processing technology. The input is raw data obtained from a database, and the output is data converted into a consistent format. In this process, a natural language processing model unifies the data.

[0474] Step 4:

[0475] The server generates travel routes and facility information tailored to the user based on standardized data. The input is standardized accessibility facility information, and the output is recommended travel routes and facility information. The server then sends this information to the terminal.

[0476] Step 5:

[0477] During travel, users send their current location information to the server in real time using their device. This allows the server to search for and update the latest accessibility facility information based on the user's current location. The input is the user's current location, and the output is facility information suitable for that location.

[0478] Step 6:

[0479] When a user requests emergency assistance, the terminal immediately sends the request to the server. The server receives the emergency assistance request, quickly devises a response plan, and works with relevant support staff to take action. The output is the support plan and the intervention of local staff.

[0480] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0481] This invention is a system that combines an emotion engine to help wheelchair users enjoy travel in a more comfortable and individually customized way. The user inputs their travel plan from a terminal, and the server receives this information. The server collects information on barrier-free facilities in a given area, standardizes it using a natural language processing model, and stores it in a database.

[0482] During their trip, users provide real-time location information to the server via their device. In addition, an emotion engine built into the device analyzes the user's emotional state and sends it to the server. Based on the user's location and emotional information, the server generates and updates optimal travel routes and facility information, and adjusts the plan as needed.

[0483] As a concrete example, consider a scenario where a user is feeling anxious while traveling in London. The emotion engine detects the user's emotions and notifies the server. The server immediately consults its database and suggests relaxation spots, quiet restaurants, and other options to alleviate the user's anxiety. The user can then review these options from their device and take actions that reduce their stress.

[0484] Furthermore, when the emotion engine recognizes that the user is ready to enjoy themselves, the server provides suggestions to enhance the activity, such as information on special sightseeing events or recommended scenic viewing spots. This system allows wheelchair users to experience a trip that best suits their emotional state at the time, thereby increasing their overall satisfaction with the trip.

[0485] The following describes the processing flow.

[0486] Step 1:

[0487] The user uses a device to enter their travel destination and desired conditions. The device then sends this information to the server.

[0488] Step 2:

[0489] Based on the received travel plan information, the server searches its database for the latest information on barrier-free facilities in the specified area and organizes it.

[0490] Step 3:

[0491] The server uses a natural language processing model to convert the organized barrier-free facility information into a standardized format and generates optimal travel routes and destinations for the user.

[0492] Step 4:

[0493] The terminal receives travel plans generated from the server and displays them to the user. The displayed plans can be customized according to the user's preferences.

[0494] Step 5:

[0495] During travel, the device's built-in emotion engine periodically analyzes the user's emotional state. This emotional information may be collected using user interactions and biometric data.

[0496] Step 6:

[0497] The device sends the analyzed emotional state information to the server. The server receives this information whenever the emotional state information is updated.

[0498] Step 7:

[0499] The server readjusts travel routes and facility suggestions based on the user's emotional state and current location. For example, if the user is feeling stressed, the server will suggest places where relaxation is possible.

[0500] Step 8:

[0501] The terminal receives updated information from the server and presents it to the user. The user can then use the suggested options to take action appropriate to the situation.

[0502] Step 9:

[0503] If a user requires urgent support, they send an emergency request from their device to the server. The server responds quickly and provides the necessary support information.

[0504] (Example 2)

[0505] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0506] This initiative aims to address the challenge faced by travelers, including wheelchair users, in finding barrier-free environments at their destinations and experiencing optimal tourism tailored to their individual emotional states. Furthermore, it requires dynamically adjusting travel plans based on the individual traveler's condition and emotions to enhance travel satisfaction.

[0507] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0508] In this invention, the server includes means for receiving travel planning information from users, means for collecting barrier-free facility data in a predetermined area and storing it in an information storage device, and means for analyzing the user's emotional state using an emotion analysis device and dynamically updating travel route and facility data based on the analysis. This allows travelers to receive in real time the routes and facilities best suited to their specific needs and emotions.

[0509] A "user" refers to an individual who uses the system to plan a trip and receives support during their trip.

[0510] "Tourism planning information" refers to information that users input into the system, such as travel destinations, itineraries, and accessibility needs.

[0511] An "information storage device" refers to a database that records and stores various types of information processed by a system, such as travel plan information and facility data.

[0512] A "tour route" refers to the path a user should take during their trip, or route information to their destination.

[0513] "Facility data" refers to information about various facilities, including barrier-free facilities, and describes locations that have been prepared to be easily accessible to users.

[0514] "Current location data" refers to information about the user's current geographical location while traveling.

[0515] An "emotion analysis device" refers to a device or program that analyzes a user's emotional state based on their voice and facial expression data.

[0516] A "generative AI model" refers to an artificial intelligence model used to generate appropriate suggestions based on the user's state.

[0517] To implement this invention, a system is primarily constructed in which a server, a terminal, and a user cooperate. First, the user uses the terminal to input travel plan information. This information includes destination, itinerary, and special requests such as accessibility needs, and the terminal transmits this as digital data to the server.

[0518] Next, the server collects barrier-free facility data for a specified area based on the received travel plan information. In this process, the server uses scraping tools to search open data on the internet and databases of partner organizations, standardizes the collected data, and stores it in an information storage device. Generative AI models are used for standardization. Specific examples include the use of natural language processing models such as BERT and GPT-3.

[0519] During travel, the device acquires the user's current location data and sends it to the server. Simultaneously, the device is equipped with an emotion analysis device that analyzes the user's emotional state based on their voice and facial expression data. This analysis result is also sent to the server.

[0520] The server generates optimal sightseeing routes and facility data for the user based on current location data and sentiment information, and dynamically updates them as needed. This can utilize prompts generated using a generative AI model. Examples of specific prompts include, "Please provide a list of quiet places in London," and "What are some active spots to visit if the user is ready to have fun?"

[0521] This invention allows users to receive real-time options best suited to their needs and emotional state, thereby improving their comfort and satisfaction during travel.

[0522] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0523] Step 1:

[0524] The user enters travel plan information into the terminal. This includes planned destinations, dates, and accessibility needs. The terminal converts the entered information into a digital format and sends it to the server. The input is the user's travel plan data, and the output is the digitized plan information sent to the server.

[0525] Step 2:

[0526] The server receives travel plan information and collects barrier-free facility data from online databases and partner organizations. The server uses scraping tools to obtain data for specific regions. The input is travel plan information, and the output is the collected raw data. A generative AI model is used to standardize the data through natural language processing and store it in an information storage device.

[0527] Step 3:

[0528] During travel, the user sends real-time location data from their device to the server. A built-in emotion analyzer in the device analyzes the user's voice and facial expressions to detect their emotional state. The inputs are real-time location data and emotion analysis data, and the output is the information sent to the server.

[0529] Step 4:

[0530] The server receives current location data and emotional state, and generates optimal sightseeing routes and facility data. Using a generative AI model, the server creates prompt sentences and generates suggestions based on them. The input is current location data and emotional information, and the output is optimal sightseeing routes and facility data. Specifically, it might suggest quiet places or recommend lively events.

[0531] Step 5:

[0532] The server sends the generated suggestions to the terminal. The terminal provides this information to the user, presenting it visually or audibly. Based on the information provided, the user decides on their destination and actions. The input is the suggestion data from the server, and the output is the specific choices presented to the user.

[0533] (Application Example 2)

[0534] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0535] Factors that hinder wheelchair users from enjoying travel in a more comfortable and individually tailored way include a lack of information on barrier-free facilities, difficulty in sharing that information, and insufficient support and planning tailored to their emotional state during travel. Addressing these challenges is essential.

[0536] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0537] In this invention, the server includes means for analyzing the user's emotional state and adjusting travel routes and facility information based on the analysis results; means for receiving the user's current location information during the trip and providing easily accessible facility information based on the current location; and means for standardizing barrier-free facility information using a natural language processing model. This makes it possible to provide optimal travel plans and barrier-free facility information tailored to the traveler's emotions and current situation.

[0538] A "user" is someone who uses the system to plan a trip and actually travels.

[0539] "Travel plan information" refers to the details of the date, time, destination, and activities based on the user's interests and preferences that they have selected for their trip.

[0540] "Accessible facility information" refers to information about buildings and locations that have been designed with barrier-free access in mind, and provides details about facilities that users can access smoothly.

[0541] A "data set" is a collection of information that has been organized and stored in a way that allows for later analysis and processing.

[0542] "Current location information" refers to data about the specific location where the user is while traveling.

[0543] "Emotional state" refers to the state of a user's mental and psychological state, and is captured by emotion recognition technology.

[0544] "Analysis results" refer to the conclusions or states that the system has derived from analyzing the collected data.

[0545] "Adjustment" refers to the act of changing information regarding the travel route and facilities during a trip according to the user's condition and preferences.

[0546] The system implementing this application example is built around a server and user terminals. The server performs the primary functions of data collection, analysis, and information provision. The server is configured as a standard web server and runs on a cloud platform. Specifically, it utilizes a server unit with a processor and sufficient memory, and uses Node.js as the software platform. In addition, a natural language processing model is used to standardize barrier-free facility information.

[0547] The device functions as an interface with the user and runs on a smartphone. Emotional state analysis is performed by collecting data via the camera and using the Microsoft Azure Emotion API. The device displays received travel route and facility information on its screen, offering choices.

[0548] The server organizes the collected barrier-free facility information using natural language processing technology and stores it as a data set. It also tracks the user's current location in real time during their trip, generates appropriate travel plans and facility information based on the user's emotional state, and provides them to the user's device. Users can then make choices based on the presented information and customize their travel experience.

[0549] For example, if the server detects signs of stress in the user during their trip, it might suggest a nearby quiet park or cafe. An example of a prompt message might be: "Please suggest places to alleviate the user's stress. Additionally, please consider how to retrieve information about art events and add them to the travel plan."

[0550] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0551] Step 1:

[0552] The terminal receives travel plan information from the user. This input information includes destination, dates, and activities of interest. The terminal sends this information to the server and prepares for the next step.

[0553] Step 2:

[0554] The server collects easily accessible facility information in a given area based on the received travel plan information. The server collects this data using external services such as the Google Places API, standardizes it using natural language processing technology, and stores it in a data set.

[0555] Step 3:

[0556] During travel, the device acquires the user's current location information in real time and sends it to the server. Based on this input information, the server identifies easily accessible facilities in the vicinity of the current location and prepares to generate the next suggestion.

[0557] Step 4:

[0558] The device uses its camera to analyze the user's emotional state. It utilizes the Microsoft Azure Emotion API for this analysis, sending emotional state data to a server. The server then uses this data to understand the user's state and gather information to adjust the travel plan.

[0559] Step 5:

[0560] The server receives current location information and sentiment analysis results as input and generates optimal travel routes and facility information for the user. The generated information is then analyzed using a generative AI model to determine which spots would be stress-relieving and which activities would be of interest to each user.

[0561] Step 6:

[0562] The server sends the generated travel route and facility information to the terminal. The terminal displays this information on its screen, allowing the user to select and decide on their actions. The user then customizes their trip based on the information from the server.

[0563] Step 7:

[0564] When a user inputs their preferences into the terminal, such as feeling stressed and seeking relaxation, or conversely, wanting to increase their activity level, the terminal sends this information to the server, which generates a prompt message and updates the data. Based on this prompt message, the server generates the most suitable information again.

[0565] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0566] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0567] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0568] [Fourth Embodiment]

[0569] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0570] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0571] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0572] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0573] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0574] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0575] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0576] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0577] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0578] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0579] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0580] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0581] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0582] This invention is a support system for wheelchair users to travel comfortably. When a user inputs their travel plan using a terminal, the server generates an optimal travel route based on that information and presents relevant barrier-free facility information. The server collects barrier-free information for each region and stores it in a database. This information is standardized using a natural language processing model and stored in a structured format.

[0583] While traveling, users can access the server in real time using their device. The device sends the user's current location information to the server, which then searches for accessible facilities near the user based on that location. Specifically, it helps users move around safely by showing the locations of accessible toilets and elevators.

[0584] Furthermore, if a user encounters an unexpected situation while traveling, they can send an emergency support request from their device. Upon receiving this request, the server will immediately provide a solution and work with local support staff to quickly resolve the problem.

[0585] As a concrete example, let's consider a scenario where a user is planning a trip to Paris. The user inputs information such as "Paris" and "wheelchair-accessible tourist attractions" through their device. The server automatically searches for barrier-free tourist attractions in Paris and suggests a route. The suggested route can be customized according to the user's preferences, and real-time updates of surrounding barrier-free information are also provided. This allows the user to continue their trip safely and smoothly. In this way, this system provides comprehensive support to enable wheelchair users to enjoy traveling with peace of mind.

[0586] The following describes the processing flow.

[0587] Step 1:

[0588] The server collects accessibility information for various travel destinations from the internet. This information includes accessibility data for tourist attractions, transportation, accommodations, and restaurants, and the collected information is stored in a database.

[0589] Step 2:

[0590] The server uses a natural language processing model to analyze the collected barrier-free facility information and convert it into a standardized format. This organizes the information and allows it to be stored in a user-friendly format.

[0591] Step 3:

[0592] The user activates the device to plan their trip and enters their desired destinations and preferences. The device then sends this information to the server.

[0593] Step 4:

[0594] The server receives travel plan information submitted by the user, searches its database, and generates the optimal travel route and facility information. The generated information is customized according to the user's preferences.

[0595] Step 5:

[0596] The terminal receives travel routes and facility information generated from the server and displays them to the user. The user can then choose the travel plan that best suits their needs from the displayed options.

[0597] Step 6:

[0598] While traveling, users use their devices to send their current location information to the server. This allows the server to determine the user's current location.

[0599] Step 7:

[0600] The server identifies accessible facilities near the user based on their current location and sends the appropriate information to the terminal. The terminal displays the received information to the user, providing detailed route guidance and facility locations.

[0601] Step 8:

[0602] If a user encounters a situation requiring urgent support, they send an emergency support request from their device to the server. The server processes the request immediately, arranges for on-site support as needed, and returns instructions to the user.

[0603] (Example 1)

[0604] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0605] To ensure that diverse users, including wheelchair users, can enjoy safe and smooth travel, it is necessary to provide timely information on barrier-free facilities and propose optimal travel routes based on that information. However, systems that can automatically generate detailed travel plans tailored to individual needs and flexibly respond to unexpected situations during travel are still not sufficiently developed. This invention solves these problems.

[0606] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0607] In this invention, the server includes means for receiving travel plan information from users, means for collecting barrier-free facility information in the region and storing it in an information management device, and means for analyzing user requests using information analysis technology. This makes it possible to propose personalized travel routes to users and to present appropriate relevant facilities based on real-time location information.

[0608] "Users" refers to individuals who use the system to create travel plans or access information on barrier-free facilities.

[0609] "Travel plan information" refers to information entered by the user regarding the travel destination, itinerary, desired sightseeing spots, and other conditions.

[0610] "Region" refers to a specific geographical area that is the subject of a travel plan.

[0611] "Barrier-free facility information" refers to information about facilities and equipment that are easily accessible to all people, including wheelchair users.

[0612] An "information management device" refers to a database or storage system used to organize and store collected information.

[0613] "Information analysis technology" refers to technologies used for analyzing and processing data, particularly natural language processing models.

[0614] "Location information" refers to information that indicates the user's current geographical location while traveling.

[0615] "Travel route" refers to the travel route set based on the user's travel plan.

[0616] "Related facilities" refer to facilities and services that are relevant to the user's travel plans or current location and are accessible to them.

[0617] An "emergency response request" refers to a communication used to quickly seek assistance when a user encounters an unexpected situation while traveling.

[0618] This invention is a system designed to ensure that all travelers, including wheelchair users, can have a comfortable travel experience. Users can use a terminal to input their travel plans and obtain necessary information. The terminal uses a general-purpose computer or smartphone and connects to the server via the internet.

[0619] The server receives travel plan information sent by the user and generates the optimal travel route by referring to local barrier-free facility information stored in the information management device. The server accurately analyzes user requests and provides appropriate suggestions by using a natural language processing model as its information analysis technology. The specific software includes a general-purpose AI model as a natural language processing technology.

[0620] During their trip, users can access the server through their device and continuously send location information to obtain the latest facility information in real time. Based on the received location information, the server searches for nearby barrier-free facilities and, if necessary, suggests a more appropriate route to the user.

[0621] Furthermore, in the event of an unexpected situation, users can send an emergency response request to the server via their device. Upon receiving this request, the server will immediately provide a solution and, if necessary, contact local support staff. This process utilizes communication technology that enables real-time communication.

[0622] For example, when a user enters information such as "London" and "wheelchair-accessible museums," the server suggests the optimal route based on information about accessible museums in the London area. This suggestion is updated in real time with data from the trip, allowing the user to make choices that suit their situation at any given moment. By using a prompt such as "Suggest the best travel route for wheelchair users," the server provides the optimal travel experience tailored to the user's preferences.

[0623] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0624] Step 1:

[0625] The user enters travel plan information using a terminal. This includes the travel destination, dates, mode of transportation, and desired tourist spots. This entered information is output as data sent from the terminal to the server. Specifically, the user enters the necessary information using the interface and completes the process by pressing the submit button.

[0626] Step 2:

[0627] The server uses travel plan information received from the terminal to reference local barrier-free facility information stored in the information management device. The server then analyzes this information using information analysis technology to generate the optimal travel route. In this step, the input is the user's travel plan information, and the output is the optimal travel route and related facility information. Specifically, a generative AI model is used to analyze the user's requests in natural language and construct a corresponding travel plan.

[0628] Step 3:

[0629] The server sends the generated travel route and related facility information to the terminal. The user can review the route information received through the terminal and choose the most suitable plan from the options. The input for this step is the route information generated by the server, and the output is the options displayed on the user's terminal. Specifically, a list of routes is displayed on the terminal's display, and the user selects the one they want.

[0630] Step 4:

[0631] During travel, the user's device uses GPS to obtain current location information and sends it to the server. Based on the received location information, the server searches for real-time information on nearby barrier-free facilities and provides it to the user. The input for this step is the user's current location information, and the output is real-time information on nearby facilities based on that location. Specifically, the device has a function to periodically send location information to the server.

[0632] Step 5:

[0633] If a user encounters an unexpected emergency while traveling, they send an emergency response request from their device to the server. The server receives this request, promptly provides a response plan, and communicates with local support staff if necessary. The input for this step is the user's emergency response request, and the output is the response plan and, if possible, on-site support from local staff. Specifically, the user sends the request by pressing the emergency button on their device and follows the instructions from the server.

[0634] (Application Example 1)

[0635] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0636] In modern times, wheelchair users face problems such as a lack of barrier-free information and inadequate emergency support systems when traveling. In this situation, for wheelchair users to enjoy travel with peace of mind, the collection and presentation of barrier-free facility information and prompt support in emergencies are necessary. Therefore, the present invention aims to realize a travel support system that provides real-time barrier-free facility information for wheelchair users and enables rapid response in emergencies.

[0637] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0638] In this invention, the server includes means for receiving travel plan information from a user, means for collecting barrier-free facility information in a predetermined area and storing it in a database, and means for generating travel route and facility information suitable for the user based on the travel plan information. As a result, wheelchair users can obtain the latest barrier-free facility information at their destination in real time, enabling them to respond quickly to unexpected situations and travel with peace of mind.

[0639] "User travel plan information" refers to information that includes details about the places and routes that users wish to visit.

[0640] "Barrier-free facility information" refers to information about public and commercial facilities that are accessible to wheelchair users without any obstacles.

[0641] A "database" is a collection of structured data used to store collected information on barrier-free facilities and travel plans.

[0642] "Natural language processing technology" is the technology that enables computers to understand and process human language.

[0643] An "emergency assistance request" is a request for help from a user in an emergency situation while traveling.

[0644] "Support staff" are personnel who provide on-site assistance to users regarding the problems they face.

[0645] "Real-time updates" means constantly updating information in order to provide the latest information quickly.

[0646] The system implementing this invention is designed to enable wheelchair users to travel safely and efficiently. The server receives travel plan information from the user, collects information on barrier-free facilities in a designated area based on that information, and stores it in a database. Furthermore, it uses natural language processing technology to standardize the data and provide the user with the most suitable travel route and facility information. Real-time data updates ensure that users on the move always have access to the latest barrier-free information.

[0647] When a user provides their current location information using their device while traveling, the server uses that information to search for nearby accessible facilities and displays the information on the user's device. This process uses the Google Maps API to obtain location information.

[0648] Furthermore, if a user requests emergency assistance, the server will immediately provide a solution and coordinate with local support staff. This allows users to resolve problems with peace of mind. For example, if a user is looking for an accessible toilet while traveling in Paris, the server can suggest the optimal route based on their location.

[0649] It is also possible to use prompts for the generated AI model, such as, "Please propose a travel plan that takes into account barrier-free tourist attractions and facilities in Paris so that wheelchair users can travel comfortably. Also, please show specific steps for developing an app that provides real-time information on barrier-free access in the surrounding area." In this way, the system makes travel safer and more comfortable for wheelchair users.

[0650] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0651] Step 1:

[0652] The user enters travel plan information using a terminal. The terminal receives the entered information (e.g., "Paris, wheelchair-accessible tourist attractions") and sends it to the server. Based on this information, the server analyzes the user's travel requirements.

[0653] Step 2:

[0654] The server searches its database for relevant accessibility information based on the received travel plan information. Using this database, the server collects information on the accessibility level and location of each facility. The input is travel plan information, and the output is accessibility information related to that plan.

[0655] Step 3:

[0656] The server standardizes the facility information collected using natural language processing technology. The input is raw data obtained from a database, and the output is data converted into a consistent format. In this process, a natural language processing model unifies the data.

[0657] Step 4:

[0658] The server generates travel routes and facility information tailored to the user based on standardized data. The input is standardized accessibility facility information, and the output is recommended travel routes and facility information. The server then sends this information to the terminal.

[0659] Step 5:

[0660] During travel, users send their current location information to the server in real time using their device. This allows the server to search for and update the latest accessibility facility information based on the user's current location. The input is the user's current location, and the output is facility information suitable for that location.

[0661] Step 6:

[0662] When a user requests emergency assistance, the terminal immediately sends the request to the server. The server receives the emergency assistance request, quickly devises a response plan, and works with relevant support staff to take action. The output is the support plan and the intervention of local staff.

[0663] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0664] This invention is a system that combines an emotion engine to help wheelchair users enjoy travel in a more comfortable and individually customized way. The user inputs their travel plan from a terminal, and the server receives this information. The server collects information on barrier-free facilities in a given area, standardizes it using a natural language processing model, and stores it in a database.

[0665] During their trip, users provide real-time location information to the server via their device. In addition, an emotion engine built into the device analyzes the user's emotional state and sends it to the server. Based on the user's location and emotional information, the server generates and updates optimal travel routes and facility information, and adjusts the plan as needed.

[0666] As a concrete example, consider a scenario where a user is feeling anxious while traveling in London. The emotion engine detects the user's emotions and notifies the server. The server immediately consults its database and suggests relaxation spots, quiet restaurants, and other options to alleviate the user's anxiety. The user can then review these options from their device and take actions that reduce their stress.

[0667] Furthermore, when the emotion engine recognizes that the user is ready to enjoy themselves, the server provides suggestions to enhance the activity, such as information on special sightseeing events or recommended scenic viewing spots. This system allows wheelchair users to experience a trip that best suits their emotional state at the time, thereby increasing their overall satisfaction with the trip.

[0668] The following describes the processing flow.

[0669] Step 1:

[0670] The user uses a device to enter their travel destination and desired conditions. The device then sends this information to the server.

[0671] Step 2:

[0672] Based on the received travel plan information, the server searches its database for the latest information on barrier-free facilities in the specified area and organizes it.

[0673] Step 3:

[0674] The server uses a natural language processing model to convert the organized barrier-free facility information into a standardized format and generates optimal travel routes and destinations for the user.

[0675] Step 4:

[0676] The terminal receives travel plans generated from the server and displays them to the user. The displayed plans can be customized according to the user's preferences.

[0677] Step 5:

[0678] During travel, the device's built-in emotion engine periodically analyzes the user's emotional state. This emotional information may be collected using user interactions and biometric data.

[0679] Step 6:

[0680] The device sends the analyzed emotional state information to the server. The server receives this information whenever the emotional state information is updated.

[0681] Step 7:

[0682] The server readjusts travel routes and facility suggestions based on the user's emotional state and current location. For example, if the user is feeling stressed, the server will suggest places where relaxation is possible.

[0683] Step 8:

[0684] The terminal receives updated information from the server and presents it to the user. The user can then use the suggested options to take action appropriate to the situation.

[0685] Step 9:

[0686] If a user requires urgent support, they send an emergency request from their device to the server. The server responds quickly and provides the necessary support information.

[0687] (Example 2)

[0688] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0689] This initiative aims to address the challenge faced by travelers, including wheelchair users, in finding barrier-free environments at their destinations and experiencing optimal tourism tailored to their individual emotional states. Furthermore, it requires dynamically adjusting travel plans based on the individual traveler's condition and emotions to enhance travel satisfaction.

[0690] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0691] In this invention, the server includes means for receiving travel planning information from users, means for collecting barrier-free facility data in a predetermined area and storing it in an information storage device, and means for analyzing the user's emotional state using an emotion analysis device and dynamically updating travel route and facility data based on the analysis. This allows travelers to receive in real time the routes and facilities best suited to their specific needs and emotions.

[0692] A "user" refers to an individual who uses the system to plan a trip and receives support during their trip.

[0693] "Tourism planning information" refers to information that users input into the system, such as travel destinations, itineraries, and accessibility needs.

[0694] An "information storage device" refers to a database that records and stores various types of information processed by a system, such as travel plan information and facility data.

[0695] A "tour route" refers to the path a user should take during their trip, or route information to their destination.

[0696] "Facility data" refers to information about various facilities, including barrier-free facilities, and describes locations that have been prepared to be easily accessible to users.

[0697] "Current location data" refers to information about the user's current geographical location while traveling.

[0698] An "emotion analysis device" refers to a device or program that analyzes a user's emotional state based on their voice and facial expression data.

[0699] A "generative AI model" refers to an artificial intelligence model used to generate appropriate suggestions based on the user's state.

[0700] To implement this invention, a system is primarily constructed in which a server, a terminal, and a user cooperate. First, the user uses the terminal to input travel plan information. This information includes destination, itinerary, and special requests such as accessibility needs, and the terminal transmits this as digital data to the server.

[0701] Next, the server collects barrier-free facility data for a specified area based on the received travel plan information. In this process, the server uses scraping tools to search open data on the internet and databases of partner organizations, standardizes the collected data, and stores it in an information storage device. Generative AI models are used for standardization. Specific examples include the use of natural language processing models such as BERT and GPT-3.

[0702] During travel, the device acquires the user's current location data and sends it to the server. Simultaneously, the device is equipped with an emotion analysis device that analyzes the user's emotional state based on their voice and facial expression data. This analysis result is also sent to the server.

[0703] The server generates optimal sightseeing routes and facility data for the user based on current location data and sentiment information, and dynamically updates them as needed. This can utilize prompts generated using a generative AI model. Examples of specific prompts include, "Please provide a list of quiet places in London," and "What are some active spots to visit if the user is ready to have fun?"

[0704] This invention allows users to receive real-time options best suited to their needs and emotional state, thereby improving their comfort and satisfaction during travel.

[0705] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0706] Step 1:

[0707] The user enters travel plan information into the terminal. This includes planned destinations, dates, and accessibility needs. The terminal converts the entered information into a digital format and sends it to the server. The input is the user's travel plan data, and the output is the digitized plan information sent to the server.

[0708] Step 2:

[0709] The server receives travel plan information and collects barrier-free facility data from online databases and partner organizations. The server uses scraping tools to obtain data for specific regions. The input is travel plan information, and the output is the collected raw data. A generative AI model is used to standardize the data through natural language processing and store it in an information storage device.

[0710] Step 3:

[0711] During travel, the user sends real-time location data from their device to the server. A built-in emotion analyzer in the device analyzes the user's voice and facial expressions to detect their emotional state. The inputs are real-time location data and emotion analysis data, and the output is the information sent to the server.

[0712] Step 4:

[0713] The server receives current location data and emotional state, and generates optimal sightseeing routes and facility data. Using a generative AI model, the server creates prompt sentences and generates suggestions based on them. The input is current location data and emotional information, and the output is optimal sightseeing routes and facility data. Specifically, it might suggest quiet places or recommend lively events.

[0714] Step 5:

[0715] The server sends the generated suggestions to the terminal. The terminal provides this information to the user, presenting it visually or audibly. Based on the information provided, the user decides on their destination and actions. The input is the suggestion data from the server, and the output is the specific choices presented to the user.

[0716] (Application Example 2)

[0717] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0718] Factors that hinder wheelchair users from enjoying travel in a more comfortable and individually tailored way include a lack of information on barrier-free facilities, difficulty in sharing that information, and insufficient support and planning tailored to their emotional state during travel. Addressing these challenges is essential.

[0719] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0720] In this invention, the server includes means for analyzing the user's emotional state and adjusting travel routes and facility information based on the analysis results; means for receiving the user's current location information during the trip and providing easily accessible facility information based on the current location; and means for standardizing barrier-free facility information using a natural language processing model. This makes it possible to provide optimal travel plans and barrier-free facility information tailored to the traveler's emotions and current situation.

[0721] A "user" is someone who uses the system to plan a trip and actually travels.

[0722] "Travel plan information" refers to the details of the date, time, destination, and activities based on the user's interests and preferences that they have selected for their trip.

[0723] "Accessible facility information" refers to information about buildings and locations that have been designed with barrier-free access in mind, and provides details about facilities that users can access smoothly.

[0724] A "data set" is a collection of information that has been organized and stored in a way that allows for later analysis and processing.

[0725] "Current location information" refers to data about the specific location where the user is while traveling.

[0726] "Emotional state" refers to the state of a user's mental and psychological state, and is captured by emotion recognition technology.

[0727] "Analysis results" refer to the conclusions or states that the system has derived from analyzing the collected data.

[0728] "Adjustment" refers to the act of changing information regarding the travel route and facilities during a trip according to the user's condition and preferences.

[0729] The system implementing this application example is built around a server and user terminals. The server performs the primary functions of data collection, analysis, and information provision. The server is configured as a standard web server and runs on a cloud platform. Specifically, it utilizes a server unit with a processor and sufficient memory, and uses Node.js as the software platform. In addition, a natural language processing model is used to standardize barrier-free facility information.

[0730] The device functions as an interface with the user and runs on a smartphone. Emotional state analysis is performed by collecting data via the camera and using the Microsoft Azure Emotion API. The device displays received travel route and facility information on its screen, offering choices.

[0731] The server organizes the collected barrier-free facility information using natural language processing technology and stores it as a data set. It also tracks the user's current location in real time during their trip, generates appropriate travel plans and facility information based on the user's emotional state, and provides them to the user's device. Users can then make choices based on the presented information and customize their travel experience.

[0732] For example, if the server detects signs of stress in the user during their trip, it might suggest a nearby quiet park or cafe. An example of a prompt message might be: "Please suggest places to alleviate the user's stress. Additionally, please consider how to retrieve information about art events and add them to the travel plan."

[0733] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0734] Step 1:

[0735] The terminal receives travel plan information from the user. This input information includes destination, dates, and activities of interest. The terminal sends this information to the server and prepares for the next step.

[0736] Step 2:

[0737] The server collects easily accessible facility information in a given area based on the received travel plan information. The server collects this data using external services such as the Google Places API, standardizes it using natural language processing technology, and stores it in a data set.

[0738] Step 3:

[0739] During travel, the device acquires the user's current location information in real time and sends it to the server. Based on this input information, the server identifies easily accessible facilities in the vicinity of the current location and prepares to generate the next suggestion.

[0740] Step 4:

[0741] The device uses its camera to analyze the user's emotional state. It utilizes the Microsoft Azure Emotion API for this analysis, sending emotional state data to a server. The server then uses this data to understand the user's state and gather information to adjust the travel plan.

[0742] Step 5:

[0743] The server receives current location information and sentiment analysis results as input and generates optimal travel routes and facility information for the user. The generated information is then analyzed using a generative AI model to determine which spots would be stress-relieving and which activities would be of interest to each user.

[0744] Step 6:

[0745] The server sends the generated travel route and facility information to the terminal. The terminal displays this information on its screen, allowing the user to select and decide on their actions. The user then customizes their trip based on the information from the server.

[0746] Step 7:

[0747] When a user inputs their preferences into the terminal, such as feeling stressed and seeking relaxation, or conversely, wanting to increase their activity level, the terminal sends this information to the server, which generates a prompt message and updates the data. Based on this prompt message, the server generates the most suitable information again.

[0748] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0749] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0750] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0751] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0752] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0753] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0754] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0755] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0756] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0757] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0758] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0759] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0760] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0761] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0762] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0763] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0764] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0765] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0766] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0767] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0768] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0769] The following is further disclosed regarding the embodiments described above.

[0770] (Claim 1)

[0771] A means of receiving travel plan information from users,

[0772] A means for collecting information on barrier-free facilities in a designated area and storing it in a database,

[0773] Means for generating a travel route and facility information suitable for the user based on the aforementioned travel plan information,

[0774] A means for receiving the user's current location information during travel and providing barrier-free facility information based on that current location,

[0775] A means of receiving urgent support requests from users and providing immediate solutions,

[0776] A system that includes this.

[0777] (Claim 2)

[0778] The system according to claim 1, comprising means for standardizing barrier-free facility information using a natural language processing model.

[0779] (Claim 3)

[0780] The system according to claim 1, comprising means for displaying travel routes and facility information as options on a user terminal.

[0781] "Example 1"

[0782] (Claim 1)

[0783] A means of receiving travel plan information from users,

[0784] A means for collecting information on barrier-free facilities in the region and storing it in an information management device,

[0785] A means for generating a travel route and related facility information suitable for the user based on the aforementioned travel plan information,

[0786] A means for receiving the user's location information during travel and providing barrier-free facility information based on that location,

[0787] A means of receiving emergency response requests from users and providing immediate countermeasures,

[0788] A means of analyzing user requests using information analysis technology,

[0789] A system that includes this.

[0790] (Claim 2)

[0791] The system according to claim 1, comprising means for standardizing barrier-free facility information using information analysis technology.

[0792] (Claim 3)

[0793] The system according to claim 1, comprising means for displaying travel routes and related facility information as options on a user terminal.

[0794] "Application Example 1"

[0795] (Claim 1)

[0796] A means of receiving travel plan information from users,

[0797] A means for collecting information on barrier-free facilities in a designated area and storing it in a database,

[0798] Means for generating a travel route and facility information suitable for the user based on the aforementioned travel plan information,

[0799] A means for receiving the user's current location information during travel and providing barrier-free facility information based on that current location,

[0800] A means of receiving urgent support requests from users, providing immediate countermeasures, and working with support staff to resolve problems,

[0801] A system that includes this.

[0802] (Claim 2)

[0803] The system according to claim 1, comprising means for standardizing barrier-free facility information using natural language processing technology.

[0804] (Claim 3)

[0805] The system according to claim 1, comprising means for displaying travel routes and facility information as options on a user terminal and updating them in real time.

[0806] "Example 2 of combining an emotion engine"

[0807] (Claim 1)

[0808] A means of receiving travel planning information from users,

[0809] A means for collecting barrier-free facility data in a designated area and storing it in an information storage device,

[0810] A means for generating tourist routes and facility data suitable for the user based on the aforementioned tourist planning information,

[0811] A means for receiving the user's current location data while they are sightseeing and providing barrier-free facility data based on that current location,

[0812] A means for analyzing the user's emotional state using an emotion analysis device and dynamically updating tourist route and facility data based on that analysis,

[0813] A method using a generative AI model to generate suggestions for improving the tourism experience,

[0814] A system that includes this.

[0815] (Claim 2)

[0816] The system according to claim 1, comprising means for standardizing barrier-free facility data using a natural language processing model.

[0817] (Claim 3)

[0818] The system according to claim 1, comprising means for displaying tourist routes and facility data as options on a user information processing device.

[0819] "Application example 2 when combining with an emotional engine"

[0820] (Claim 1)

[0821] A device that receives travel plan information from users,

[0822] A device that collects easily accessible facility information in a designated area and stores it in a data set,

[0823] A device that generates travel routes and facility information suitable for the user based on the aforementioned travel plan information,

[0824] A device that receives the user's current location information during travel and provides easily accessible facility information based on that current location,

[0825] A device that analyzes the emotional state of the user and adjusts the travel route and facility information based on the analysis results,

[0826] A device that receives emergency support requests from users and provides immediate countermeasures,

[0827] A system that includes this.

[0828] (Claim 2)

[0829] The system according to claim 1, comprising means for standardizing barrier-free facility information using a natural language processing model.

[0830] (Claim 3)

[0831] The system according to claim 1, comprising a device that displays travel routes and facility information as options on a user terminal. [Explanation of symbols]

[0832] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of receiving travel plan information from users, A means for collecting information on barrier-free facilities in a designated area and storing it in a database, Means for generating a travel route and facility information suitable for the user based on the aforementioned travel plan information, A means for receiving the user's current location information during travel and providing barrier-free facility information based on that current location, A means of receiving urgent support requests from users, providing immediate countermeasures, and working with support staff to resolve problems, A system that includes this.

2. The system according to claim 1, comprising means for standardizing barrier-free facility information using natural language processing technology.

3. The system according to claim 1, comprising means for displaying travel routes and facility information as options on a user terminal and updating them in real time.

Images