System

The system addresses the challenge of providing optimal routes for users with special needs by registering their requirements, calculating routes that prioritize elevators and ramps, and updating in real-time to ensure smooth navigation in urban areas.

JP2026028088APending Publication Date: 2026-02-19SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024130386
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-06
Publication Date
2026-02-19

AI Technical Summary

Technical Problem

Current map applications and transportation guidance systems fail to provide optimal routes tailored to users with special needs, such as those using strollers, wheelchairs, or carry-ons, often directing them to places with stairs or escalators, making navigation difficult in urban areas.

Method used

A system that registers user needs information, calculates and provides optimal routes prioritizing elevators and ramps, and updates in real-time to account for facility and traffic changes.

Benefits of technology

Enables smooth travel for users with specific needs by providing personalized, real-time route guidance that avoids obstacles and adapts to dynamic conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026028088000001_ABST
    Figure 2026028088000001_ABST
Patent Text Reader

Abstract

A system is provided.SOLUTION: This system includes a means for registering the need information of a specific user, a means for acquiring prescribed map information and facility structure information, a means for calculating an optimum route based on the need information of the user, a means for providing the optimum route to the user, and a means for updating the route information in real time.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Current map applications and transportation guidance systems only provide general route guidance, which is inconvenient for users with special needs, such as those using strollers, wheelchairs, or carry-ons. These users can be greatly inconvenienced when they are directed to places where there are only stairs or escalators. This problem makes it difficult for users with special needs to get around in urban areas. [Means for solving the problem]

[0005] The present invention is a system that registers the needs information of specific users and calculates and provides the optimal route based on that information. The system of the present invention includes a means for registering the user's needs information, a means for acquiring predetermined map information and facility structure information, a means for calculating the optimal route based on the user's needs information, a means for providing the optimal route to the user, and a means for updating the route information in real time. This provides a route that prioritizes elevators and ramps, allowing users with specific needs to travel comfortably.

[0006] "User needs information" is information that is required when a specific user moves around under specific circumstances or conditions, such as data indicating the usage status of strollers, wheelchairs, etc.

[0007] "Means of registration" refers to the interface or function that allows users to input their needs information into the system and save that information.

[0008] "Map information" is data that includes geographical information such as roads, buildings, and public facilities, and is used for route guidance.

[0009] "Facility structural information" is structural data for a specific facility or location, including the locations and characteristics of elevators, ramps, stairs, etc.

[0010] "Means of acquisition" refers to the processes and functions for collecting map information and facility structure information from external databases and APIs.

[0011] The "optimal route" is the most appropriate and efficient route to the destination, taking into consideration the user's needs information.

[0012] The "means of calculation" refers to an algorithm or process that derives the optimal route based on registered user needs information and acquired map information and facility structure information.

[0013] The "means of providing" refers to the interface and functions for presenting the calculated optimal route information to the user.

[0014] "Means of real-time updates" refers to the processes and functions for obtaining the latest dynamic data such as construction information and equipment status, and recalculating and updating route information as necessary. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] ---

[0037] The present invention is a system that provides optimal route guidance to a specific user. This system registers the user's needs information, calculates the optimal route based on that information, and provides the optimal route.

[0038] User Registration

[0039] First, the user uses a smartphone or computer terminal to register their own usage status (e.g., stroller, wheelchair, carry case, etc.). The terminal then sends this information to the server, which then stores the received user needs information in a database.

[0040] Obtaining map information

[0041] The server uses the map provider API to collect the latest map data. It also obtains facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. Based on this information, it prepares to calculate routes tailored to the user's needs.

[0042] Route calculation

[0043] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered user needs information, to the server. The server receives this information and uses map information and facility structure information to calculate the optimal route. In particular, it generates a route that prioritizes elevators and ramps and avoids stairs and escalators.

[0044] Real-time updates

[0045] The server constantly monitors the latest information on public transport, construction status, and facility operation status, allowing route information to be updated in real time. For example, if an elevator is out of order, a new route can be recalculated based on that information.

[0046] Providing results

[0047] The calculated optimal route is sent from the server to the device, which then visually displays this route information to the user. The user can then follow detailed instructions (e.g., "Exit the east exit and walk 50 meters to the right to find the elevator") to reach their destination.

[0048] Specific examples

[0049] Example Scenario

[0050] A case will be described in which a user using a stroller travels from Shinjuku Station to Shibuya Hikarie.

[0051] 1. User Registration

[0052] Users register "stroller use" using a smartphone app, and the device sends this information to the server.

[0053] The server stores the user's needs information in a database.

[0054] 2. Route calculation that reflects usage status

[0055] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[0056] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route.For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to get to the platform, and then board the bus at a specific bus stop."

[0057] 3. Real-time updates

[0058] The server constantly receives the latest information from public transport operators and city management authorities, and if the route information is affected, it recalculates and updates the new route.

[0059] 4. Providing results

[0060] The calculated optimal route is sent to the terminal, which then provides visual route guidance to the user.

[0061] In this way, the system of the present invention can provide optimal route guidance to users with specific needs, significantly facilitating smooth travel in urban areas. Furthermore, real-time information updates enable route guidance that reflects the latest conditions.

[0062] The processing flow will be explained below.

[0063] ---

[0064] Step 1: Register user needs information

[0065] User: Launches the smartphone app and registers the usage of strollers, wheelchairs, carry-on bags, etc.

[0066] Terminal: Sends registered usage information to the server.

[0067] Server: Saves the received usage status in a database.

[0068] Step 2: Obtaining map information and facility structure information

[0069] Server: Connects to the map provider API and collects the latest map data.

[0070] Server: Obtain detailed facility structure information such as elevators, ramps, and stairs from public facilities and transportation facilities.

[0071] Step 3: Receiving a request from the user

[0072] User: Enter starting point and destination.

[0073] Terminal: Sends the entered departure point and destination information, as well as pre-registered usage status, to the server.

[0074] Step 4: Calculate the optimal route

[0075] Server: Based on the received information, it combines map information and facility structure information to calculate the optimal route.

[0076] In this case, prioritize elevators and ramps and select a route that avoids stairs and escalators.

[0077] Step 5: Gathering real-time information

[0078] Server: Continuously collects real-time information from public transport and city management agencies (e.g., elevator malfunctions, road construction, etc.).

[0079] Server: Based on real-time information, recalculates the optimal route as needed.

[0080] Step 6: Providing the calculation results

[0081] Server: Sends the calculated optimal route information to the terminal.

[0082] Terminal: Visually displays route guidance to the user, such as detailed instructions like "Exit the east exit and walk 50 meters to the right to find the elevator."

[0083] Step 7: Real-time updates

[0084] Server: If an abnormality or failure (e.g. elevator malfunction) is detected, the server immediately recalculates the route based on the latest information and sends the results to the terminal.

[0085] Terminal: The latest recalculated route information is promptly displayed to the user, and the user is guided to the new route while on the move.

[0086] ---

[0087] In this way, by providing optimal route guidance with real-time updates to users with specific needs, it is possible to smooth travel in urban areas and improve user convenience.

[0088] Example 1

[0089] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0090] In modern urban environments, the use of barrier-free facilities such as elevators and ramps is extremely important for users with mobility difficulties (e.g., parents using strollers and wheelchair users). However, it is difficult for users to individually grasp the location of these facilities and available routes, and it is also difficult to respond to real-time changes (e.g., elevator malfunctions or construction). This has created a demand for a system that provides route guidance appropriate for users.

[0091] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0092] In this invention, the server includes means for registering usage status information of a specific user, means for acquiring predetermined map data and facility structure data, means for calculating an optimal route based on the usage status information of the user, means for updating the optimal route in real time, and means for providing the user with the optimal route updated in real time. This allows users to grasp the optimal route tailored to their needs in real time, enabling smooth travel in urban areas.

[0093] "Usage information" refers to information about the specific conditions and needs that users face when traveling, including the use of strollers, wheelchairs, carry-ons, etc.

[0094] "Map data" refers to electronic geographic information including location information for roads, buildings, facilities, etc. in a geographic area.

[0095] "Facility structure data" refers to information about the structure and equipment inside the facility, including information about the location and access methods of elevators, ramps, stairs, etc.

[0096] "Means for calculating the optimal route" refers to algorithms and programs that calculate the most efficient and comfortable travel route for users based on usage information, map data, and facility structure data.

[0097] "Means of updating in real time" refers to systems or programs that constantly monitor the latest traffic information and facility status, and have the ability to dynamically revise route guidance information.

[0098] "Means for providing routes to users" refers to devices or applications that visually or audibly communicate calculated optimal routes and real-time updated route information to users.

[0099] "Real-time updated optimal route" refers to a route that is dynamically recalculated taking into account the latest traffic conditions and equipment operation status, and is always optimized to suit the current situation.

[0100] This invention is a system that provides optimal route guidance to specific users. This system registers the user's usage information, calculates the optimal route based on that information, and updates and provides the information in real time.

[0101] User Registration

[0102] First, the user uses a smartphone or computer terminal to register their own usage information (e.g., stroller, wheelchair, carry-on suitcase, etc.). The terminal then sends this information to a server, which then stores the received usage information in a database. This makes it possible to provide personalized route information that reflects the user's needs.

[0103] Obtaining map information

[0104] The server uses a map provider API (e.g., Google Maps API) to collect the latest map data. It also obtains facility structure data such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. This provides the basic information for calculating the optimal route.

[0105] Route calculation

[0106] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered usage information, to the server. The server receives this information and uses map data and facility structure data to calculate the optimal route. Specifically, it generates a route that prioritizes elevators and ramps and avoids stairs and escalators.

[0107] Real-time updates

[0108] The server constantly monitors the latest information from public transportation agencies and city management organizations (e.g., traffic information, construction status, and facility operation status). This allows route information to be updated in real time. For example, if an elevator is out of order, a new route can be recalculated based on that information and provided to users.

[0109] Providing results

[0110] The calculated optimal route is sent from the server to the device. The device visually displays this route information to the user, allowing the user to follow detailed instructions to reach their destination. For example, specific instructions such as "Exit the east exit and walk 50 meters to the right to find the elevator" are displayed.

[0111] Specific examples

[0112] Example Scenario

[0113] A case will be described in which a user using a stroller travels from Shinjuku Station to Shibuya Hikarie.

[0114] 1. User Registration

[0115] Users register "stroller use" using a smartphone app, and the device sends this information to the server.

[0116] The server stores the user's needs information in a database.

[0117] 2. Route calculation that reflects usage status

[0118] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[0119] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route.For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to get to the platform, and then board the bus at a specific bus stop."

[0120] 3. Real-time updates

[0121] The server constantly receives the latest information from public transport operators and city management authorities, and if the route information is affected, it recalculates and updates the new route.

[0122] 4. Providing results

[0123] The calculated optimal route is sent to the terminal, which then provides visual route guidance to the user.

[0124] Prompt Sentence Examples

[0125] Calculate the optimal route for a stroller user traveling from Shinjuku Station to Shibuya Hikarie, prioritizing elevators and ramps and taking real-time traffic information into account.

[0126] Through the above process, the system of the present invention can provide optimal route guidance to users with specific needs, significantly facilitating smooth travel in urban areas. Real-time information updates also enable route guidance that reflects the latest conditions.

[0127] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0128] Step 1: User Registration

[0129] input

[0130] Users enter their own usage information into their smartphones or computer terminals.

[0131] concrete action

[0132] The user enters "stroller use" or "wheelchair use" in the app's "Usage status" form and presses the registration button.

[0133] Data processing and calculation

[0134] The terminal creates and sends a "POST" request to send the entered information to the server.

[0135] output

[0136] The usage status information sent by the terminal arrives at the server, which stores the information in a database and saves it as user usage status information.

[0137] Step 2: Obtaining map information and facility structure data

[0138] input

[0139] The server calls the map provider API (general name: map API) to send a request to obtain the latest map data. It also collects facility structure information from databases of public facilities and transportation facilities.

[0140] concrete action

[0141] The server accesses the map API using a "GET" request to receive the latest map data, and issues a "SELECT" query to the public facility database to retrieve facility data such as elevators and ramps.

[0142] Data processing and calculation

[0143] The JSON format map data received from the map API is combined with facility structure information obtained from the database and converted into a referenceable format.

[0144] output

[0145] The integrated map data and facility structure information are stored on the server and are available for use when calculating routes.

[0146] Step 3: Route calculation

[0147] input

[0148] The user inputs the starting point and destination into the terminal.

[0149] concrete action

[0150] The user inputs the starting point "Shinjuku Station" and the destination "Shibuya Hikarie" and presses the send button. The device then sends this information to the server.

[0151] Data processing and calculation

[0152] The server receives the starting point and destination information, and then uses map data, facility structure information, and usage information to run an algorithm to calculate the optimal route, which includes logic to prioritize elevators and ramps.

[0153] output

[0154] The server generates optimal route information as a result of route calculation, including which route the user should take at a specific location.

[0155] Step 4: Real-time updates

[0156] input

[0157] The server obtains the latest information on public transportation operations, construction status, and equipment operation status.

[0158] concrete action

[0159] The server periodically sends a "GET" request to the public transportation company's SAPI to receive the latest traffic information, construction status, and facility status.

[0160] Data processing and calculation

[0161] Based on the latest information received, the server evaluates whether the pre-calculated optimal route will be affected and recalculates the route if necessary.

[0162] output

[0163] The server generates updated optimal route information in real time.

[0164] Step 5: Delivering results

[0165] input

[0166] The server sends the calculated optimal route information to the terminal.

[0167] concrete action

[0168] The server sends route information in JSON format to the terminal, which receives and analyzes it.

[0169] Data processing and calculation

[0170] To visually display the received route information, the terminal draws the route on a map and provides guidance in a format that is easy for the user to understand.

[0171] output

[0172] Users can visually check detailed route guidance on their device, such as "Take the elevator from the east exit of Shinjuku Station, then use the slope to reach the platform."

[0173] (Application example 1)

[0174] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0175] Conventional route guidance systems have the problem of being unable to provide optimal routes tailored to specific user needs and circumstances. In particular, in situations such as food delivery, delivery personnel are required to calculate optimal routes based on their own means of transportation. Furthermore, delivery efficiency can be reduced due to insufficient route updates to reflect real-time changes in traffic and road construction information. The present invention aims to solve these problems.

[0176] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0177] In this invention, the server includes a means for registering status information of a specific user, a means for acquiring predetermined map data and traffic regulation data, a means for calculating an optimal route based on the status information of the user, a means for providing the optimal route to the user, and a means for updating the route information in real time. This allows delivery personnel to efficiently obtain an optimal route according to their own means of transportation and to adapt to the latest traffic information and road construction information in real time.

[0178] "Specific users" refers to individuals with specific needs or circumstances, such as delivery people.

[0179] "Status information" includes information about the means of transportation used by the user and the conditions of use.

[0180] "Map data" refers to digital map information including location information for roads, facilities, traffic regulations, etc.

[0181] "Traffic regulation data" refers to traffic regulation information such as one-way streets, no entry restrictions, and speed limits.

[0182] "Means for calculating a route" refers to a function that calculates the optimal travel route based on the input starting point and destination, as well as the user's situation information.

[0183] "Means of updating in real time" refers to the function of constantly updating route information in response to the latest environmental changes, such as traffic information and road construction information.

[0184] "Map Provider API" refers to an application program interface for obtaining map data from an external service.

[0185] "Server" refers to a computer system that receives requests from users, performs the necessary data processing, and returns the results.

[0186] "Public transportation database" refers to a database that includes operation information and facility information for public transportation such as buses and trains.

[0187] "Calculating a route with priority given to elevators and ramps" means calculating a route that avoids stairs and escalators and uses elevators and ramps as the primary means of transportation.

[0188] "Construction information and facility equipment status" refers to the latest information on facilities, such as the progress of transportation construction work and elevator malfunction status.

[0189] These are the definitions of important terms included in the scope of patent claims. Please check them.

[0190] The present invention is an invention of a system that provides optimal route guidance to specific users. It is designed especially for the food delivery field, enabling delivery personnel to perform their delivery work efficiently.

[0191] User Registration

[0192] First, the delivery person uses a smartphone app to register their own status information (e.g., bicycle, motorcycle, car, etc.). The device sends this information to the server, which then stores the received user status information in a database.

[0193] Obtaining map data

[0194] Next, the server uses the map provider API to collect the latest map data and retrieves traffic regulation information such as one-way streets and no-entry restrictions from the traffic regulation database. Based on this information, the server is ready to calculate a route tailored to the user's situation.

[0195] Route calculation

[0196] When a delivery person enters their starting point (restaurant) and destination (customer address) into the smartphone app, the device sends this information, along with pre-registered user status information, to a server. The server receives this information and uses map data and traffic regulation data to calculate the optimal route. For example, for delivery people who use bicycles, it generates a bicycle-only route that takes into account vehicle closures and one-way street restrictions.

[0197] Real-time updates

[0198] The server constantly monitors traffic and road construction information, allowing it to update route information in real time. For example, if a traffic accident occurs or a route change is required due to road construction, the server will recalculate a new route based on that information.

[0199] Providing results

[0200] The calculated optimal route is sent from the server to the terminal. The terminal visually displays this route information to the delivery person. The delivery person can travel to their destination efficiently by following detailed instructions (e.g., "Go straight down XX Street and turn right at △△ intersection").

[0201] Specific examples

[0202] This section explains the case where a delivery person delivers food using a bicycle.

[0203] 1. User Registration

[0204] The delivery person registers "using a bicycle" on a smartphone app, and the device sends this information to the server.

[0205] The server stores the user's status information in a database.

[0206] 2. Route calculation

[0207] The delivery person enters the starting point (Restaurant A) and destination (Customer B's address).

[0208] The device sends this information to a server, which then uses map data and traffic regulation data to calculate the optimal route. For example, it automatically generates a detailed route such as "use bicycle lanes and turn right at specific intersections."

[0209] 3. Real-time updates

[0210] The server constantly receives traffic and road construction information, and if the route information is affected, it recalculates and updates a new route.

[0211] 4. Providing results

[0212] The calculated optimal route is sent to the terminal, which provides visual route guidance to the delivery person.

[0213] This allows delivery personnel to efficiently obtain the optimal route based on their means of transportation, and to carry out delivery tasks while adapting to the latest traffic and road construction information in real time.

[0214] Example prompts to be input to the generative AI model

[0215] "A user needs to place an order from Restaurant A from home by bicycle and then deliver it directly to Customer B's address. How can I use Google Maps API to calculate the optimal route in bicycle mode and update the route information in real time through the server?"

[0216] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0217] Step 1:

[0218] User Registration

[0219] Input: The delivery person enters their situation information (e.g. bicycle, motorcycle, car, etc.) into the smartphone app.

[0220] Operation: The device sends the entered information to the server.

[0221] Data processing: None.

[0222] Output: The delivery person's status information is registered in the server-side database.

[0223] Step 2:

[0224] Obtaining map data

[0225] Input: The server periodically requests updates to map data and traffic control data.

[0226] How it works: The server uses the map provider API to get the latest map data and retrieves information from the traffic regulation database.

[0227] Data processing: Extract the necessary map information and traffic regulation information from the API response and store it in the server database.

[0228] Output: The latest map data and traffic regulation data are saved in the server database.

[0229] Step 3:

[0230] Route calculation

[0231] Input: The delivery person enters the starting point (restaurant) and destination (customer address) into the smartphone app.

[0232] Operation: The device sends this information and previously registered user status information to the server.

[0233] Data processing: The server uses map data and traffic regulation data to calculate the optimal route, creating routes tailored to specific modes of transportation (e.g., bicycle routes, car routes).

[0234] Output: The calculated optimal route is sent from the server to the device.

[0235] Step 4:

[0236] Real-time updates

[0237] Input: The server retrieves the latest traffic and road construction information.

[0238] Behavior: The server monitors this information and updates the routing information as needed.

[0239] Data processing: Recalculate a new optimal route based on updated traffic and road construction information.

[0240] Output: Updated route information is sent to the delivery driver's device (if necessary).

[0241] Step 5:

[0242] Providing results

[0243] Input: Route calculation result.

[0244] Operation: The terminal visually displays the calculated optimal route information to the delivery person.

[0245] Data processing: None.

[0246] Output: Detailed route instructions (e.g., "Go straight down XX Street and turn right at △△ intersection") are displayed to the delivery person.

[0247] The above is a detailed description of the processing steps of the system program that realizes the application example.

[0248] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0249] ---

[0250] The present invention is a system that provides optimal route guidance for a specific user and further acquires and customizes route guidance based on the user's emotional information. This system registers the user's needs information and emotional information, and calculates and provides the optimal route based on that information.

[0251] User Registration

[0252] First, the user uses a smartphone or computer terminal to register their usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information. The terminal then sends this information to the server, which then stores the received user needs and emotional information in a database.

[0253] Obtaining map information and facility structure information

[0254] The server collects the latest map data using the map provider API. It also obtains facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. Based on this information, it prepares to calculate a route that matches the user's needs and emotional information.

[0255] Route calculation

[0256] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered user needs and emotional information, to the server. The server receives this information and uses map information and facility structure information to calculate the optimal route. The server prioritizes elevators and ramps and selects routes that avoid stairs and escalators. It also provides routes that reduce stress (e.g., routes that avoid crowds) based on emotional information.

[0257] Collecting and using emotional information

[0258] The emotion engine uses facial recognition or voice analysis to obtain emotional information from the user. This emotional information is updated in real time and sent to the server, which then customizes route guidance based on this information to provide the user with the optimal travel experience.

[0259] Real-time updates

[0260] The server constantly monitors the latest information on public transport, construction status, and facility operation status, allowing route information to be updated in real time. For example, if an elevator is out of order or crowded, a new route will be recalculated based on that information.

[0261] Providing results

[0262] The calculated optimal route is sent from the server to the device, which then visually displays this route information to the user. The user can follow detailed instructions (e.g., "Exit the east exit and walk 50 meters to the right to find the elevator") to reduce stress while traveling.

[0263] Specific examples

[0264] Example Scenario

[0265] A method for reducing a user's stress level while traveling from Shinjuku Station to Shibuya Hikarie using a stroller will be described.

[0266] 1. User Registration

[0267] The user registers "stroller use" and permission to obtain emotional information using a smartphone app, and the device then sends this information to the server.

[0268] The server stores the user's needs information and emotion information in a database.

[0269] 2. Route calculation that reflects usage status

[0270] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[0271] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route. For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to head to the platform, and then board the bus at a specific bus stop." It also uses facial recognition and voice analysis to check the user's stress level and provide a route that avoids crowds.

[0272] 3. Real-time updates of emotional information

[0273] The emotion engine collects emotional information in real time through facial recognition and voice analysis of the user and transmits it to the server.

[0274] The server recalculates route guidance based on the emotional information received in real time, and changes the optimal route if stress is felt.

[0275] 4. Providing results

[0276] The calculated optimal route is sent to the terminal, which then visually displays route guidance to the user, allowing the user to enjoy a stress-free journey.

[0277] In this way, the system of the present invention can provide optimal route guidance based on emotional information for users with specific needs, realizing a comfortable and stress-free travel experience.In addition, real-time information updates allow it to flexibly respond to the latest situations.

[0278] The processing flow will be explained below.

[0279] ---

[0280] Step 1: Registering user needs and emotions

[0281] User: Launches the smartphone app and registers their usage status (e.g., stroller, wheelchair, carry case, etc.) and permission to obtain emotional information.

[0282] Device: Sends the registered usage status and permission to obtain emotion information to the server.

[0283] Server: Stores the received usage status and permission to obtain emotion information in a database.

[0284] Step 2: Obtaining map information and facility structure information

[0285] Server: Collects the latest map data using the map provider API.

[0286] Server: Obtains facility structural information such as elevators, ramps, and stairs from databases of public facilities and transportation facilities.

[0287] Step 3: Enter your departure and destination information

[0288] User: Enter the starting point and destination into the smartphone device.

[0289] Terminal: Sends the input starting point and destination, as well as pre-registered usage status and permission to obtain emotion information, to the server.

[0290] Step 4: Calculate the optimal route

[0291] Server: Based on the received information, the server uses map information and facility structure information to calculate the optimal route. In particular, it prioritizes elevators and ramps, and derives a route that avoids stairs and escalators.

[0292] Step 5: Collecting emotional information

[0293] Device: Uses a camera and microphone to recognize the user's face or perform voice analysis to obtain emotional information.

[0294] Terminal: Sends the acquired emotion information to the server.

[0295] Step 6: Customizing route guidance based on emotional information

[0296] Server: Determines the user's stress level and mood based on the received emotional information. Based on this information, route guidance is customized. For example, it suggests routes that avoid crowds or more convenient ways of traveling.

[0297] Step 7: Real-time information collection and route updates

[0298] Server: Continuously collects real-time information from public transport and city management agencies (e.g., elevator malfunctions, road construction, etc.).

[0299] Server: Based on real-time information, it recalculates the optimal route as needed and generates new route guidance that includes emotional information.

[0300] Step 8: Providing optimal routes

[0301] Server: Sends the calculated optimal route to the terminal.

[0302] Terminal: Visual route guidance is displayed to the user, such as "Exit the east exit and walk 50 meters to the right to find the elevator."

[0303] Step 9: Real-time updates of emotions and route guidance

[0304] Emotion engine: Collects emotional information in real time while the user is on the move using facial recognition and voice analysis.

[0305] Device: Sends updated emotion information to the server.

[0306] Server: Recalculates the route based on new emotional information and traffic conditions received in real time, and sends the latest route information to the device.

[0307] Terminal: Visually displays updated route information to the user and guides them to new routes.

[0308] ---

[0309] In this way, by providing real-time optimal route guidance to users with specific needs and emotional information, users can enjoy a comfortable and stress-free journey.

[0310] Example 2

[0311] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0312] Conventional route guidance systems can provide route guidance that reflects a user's specific needs, but they cannot provide routes that take into account the user's emotional state. As a result, users often feel stressed while traveling, which is particularly burdensome for users with disabilities and those traveling with children. Furthermore, they do not support real-time updates of the latest public transportation status or construction information, and sometimes cannot provide the latest route information.

[0313] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for registering need information and emotion information of a specific user, a means for acquiring predetermined map information and facility structure information, a means for calculating an optimal route based on the user's need information and emotion information, a means for collecting emotion information in real time using facial recognition or voice analysis, a means for providing the optimal route to the user, and a means for monitoring the latest information on public transportation, construction status, and facility operation status, and updating the route information in real time. This enables optimal route guidance that takes into account the user's needs and emotion state, thereby providing a comfortable and stress-free travel experience. Furthermore, real-time information updates enable route guidance that corresponds to the latest conditions.

[0314] "Specific user needs information" is information that includes special requirements or conditions that a user needs when traveling, such as information about the use of strollers or wheelchairs, the number and size of luggage, etc.

[0315] "Emotional information" is data that indicates the user's emotional state, including stress levels and mood states obtained through facial recognition and voice analysis.

[0316] "Map information" is data that indicates geographical locations, roads, facility locations, etc., and is obtained from a map provider API.

[0317] "Facility structure information" is information about the internal structure of public facilities and transportation facilities, and is data that indicates the location and status of elevators, ramps, stairs, etc.

[0318] An "optimal route" is a route that takes into account the user's needs and emotions and allows them to travel to their destination in the most efficient and comfortable way.

[0319] "Facial recognition" is a technology that takes a picture of a user's face with a camera and analyzes their facial features to determine their emotional state based on their facial expressions.

[0320] "Voice analysis" is a technology that records a user's voice and analyzes the voice data to determine their emotional state based on the tone and pitch of their voice.

[0321] "Latest information on public transportation" refers to transportation-related information provided in real time, such as the operation status of trains and buses, delay information, and notices of non-operating days.

[0322] "Construction status" refers to current status information about construction work, such as road construction and facility repairs, that affects traffic flow and facility use.

[0323] "Facility operating status" is information that indicates whether mechanical equipment such as elevators and escalators are operating normally.

[0324] The present invention is a system that provides optimal route guidance to a specific user, and further acquires the user's emotional information and customizes the route guidance based on that information. This system registers the user's needs information and emotional information, and calculates and provides the optimal route based on that information.

[0325] System configuration and hardware and software used

[0326] User Registration

[0327] Users use their smartphones or computer terminals to register their usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information (using facial recognition or voice analysis). The terminals send this information to a server, which then stores the received information in a database. The specific hardware and software used are shown below.

[0328] Hardware:

[0329] Smartphone

[0330] computer terminal

[0331] server

[0332] software:

[0333] Mobile or web applications (for entering user information)

[0334] Database System

[0335] Facial Recognition and Voice Analysis Software

[0336] Obtaining map information and facility structure information

[0337] The server obtains the latest map data using a map provider API (e.g., Google Maps API), and also collects facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation facilities.

[0338] Route calculation

[0339] The device sends the user's input starting point and destination, as well as the user's registered needs and emotional information, to the server. The server calculates the optimal route, prioritizing elevators and ramps, based on map information and facility structure information. It also takes emotional information into account and provides routes that reduce stress (e.g., routes that avoid crowds).

[0340] Collecting and using emotional information

[0341] The emotion engine uses facial recognition or voice analysis to obtain real-time emotional information from the user and transmits it to the server, which then customizes route guidance based on that information to provide the user with an optimal travel experience.

[0342] Real-time updates

[0343] The server constantly monitors the latest information on public transport, construction status, and facility operation status to update route information in real time. For example, if information on elevator malfunctions or congestion is obtained in real time, the server recalculates the optimal route based on that information and sends the results to the terminal.

[0344] Providing results

[0345] The terminal visually presents the optimal route sent from the server to the user, who can then follow the visual instructions to travel, enjoying a stress-free travel experience.

[0346] Specific examples

[0347] Example Scenario

[0348] A method for reducing the stress level of a user using a stroller while traveling from Shinjuku Station to Shibuya Hikarie will be specifically described.

[0349] 1. User Registration

[0350] The user registers "stroller use" and "permission to obtain emotional information" in the app on their smartphone, and the information is sent to the server.

[0351] The server stores the received user needs information and emotion information in a database.

[0352] Example prompt: "I'm using a stroller. Please tell me the best route from Shinjuku Station to Shibuya Hikarie. Also, please monitor my emotional information as I want to reduce stress during the trip."

[0353] 2. Route calculation that reflects usage status

[0354] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[0355] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route. For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to get to the platform, and then board the bus at a specific bus stop." It also provides routes that avoid crowds based on emotion information.

[0356] Example prompt: "Please tell me which bus stop I should take after taking the elevator from the east exit of Shinjuku Station to the platform."

[0357] 3. Real-time updates of emotional information

[0358] The emotion engine collects emotional information in real time through facial recognition and voice analysis of the user and sends it to the server.

[0359] The server recalculates route guidance based on the emotional information received in real time, and changes the optimal route if stress is felt.

[0360] Example prompt: "Based on my current stress level, please guide me to the most relaxing route."

[0361] 4. Providing results

[0362] The calculated optimal route is sent to the terminal, which then visually displays route guidance to the user, allowing the user to enjoy a stress-free journey.

[0363] Example prompt: "What's the next step on my current route?"

[0364] In this way, the system provides optimal route guidance based on emotional information for users with specific needs, realizing a comfortable and stress-free travel experience.In addition, real-time information updates enable the system to flexibly respond to the latest conditions.

[0365] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0366] Step 1: User Registration

[0367] Input: The user uses a smartphone or computer terminal to set the usage status of the stroller, wheelchair, etc. and whether facial recognition or voice analysis will be used.

[0368] Specific behavior:

[0369] The user selects "Stroller use" and "Allow emotional information acquisition" from the smartphone application screen.

[0370] The terminal sends this information to the server as a "POST" request.

[0371] Output: The server stores the received information in a database and returns a registration confirmation message to the terminal.

[0372] Step 2: Obtaining map information and facility structure information

[0373] Input: The server obtains map information using the map provider API and collects facility structure information from public facility and transportation databases.

[0374] Specific behavior:

[0375] The server sends a "GET" request to the map provider API to retrieve the latest map data.

[0376] The server obtains facility structural information such as elevators, ramps, and stairs from the public facility's API and integrates it with map data.

[0377] Output: The latest map information and facility structure information are stored on the server, ready for route calculation.

[0378] Step 3: Route calculation

[0379] Input: The user inputs the starting point and destination through the terminal, which then sends this to the server. The terminal also inputs previously registered needs and emotion information.

[0380] Specific behavior:

[0381] A user inputs a route request from "Shinjuku Station" to "Shibuya Hikarie" into a smartphone app.

[0382] The terminal sends the request to the server as a "POST" request.

[0383] The server calculates the optimal route based on map information, facility structure information, and user needs and emotions, taking into account stress levels and selecting routes that avoid congestion as necessary.

[0384] Output: The server converts the calculated optimal route into a data format and sends it to the terminal.

[0385] Step 4: Collecting and using emotional information

[0386] Input: The emotion engine obtains emotion information in real time using facial recognition or voice analysis of the user and sends it to the server.

[0387] Specific behavior:

[0388] The emotion engine uses the smartphone's camera or microphone to analyze the user's facial expressions and voice.

[0389] The acquired emotional information is sent to the server in real time.

[0390] Output: The server receives the emotion information, customizes route guidance in real time, and recalculates the optimal route if an update is needed.

[0391] Step 5: Real-time updates

[0392] Input: The server monitors public transport updates, construction status, and equipment operation status.

[0393] Specific behavior:

[0394] The server sends a "GET" request to the public transportation API to obtain information on operation status and delays.

[0395] The latest information is obtained from an API that monitors construction information and equipment operation status.

[0396] If necessary, the optimum route is recalculated based on this information.

[0397] Output: The server generates the latest route information and sends it to the terminal. If the route information is updated, the user is notified.

[0398] Step 6: Delivering results

[0399] Input: Optimal route information sent from the server.

[0400] Specific behavior:

[0401] The terminal analyzes the route information received from the server and visually displays it to the user.

[0402] Users can check detailed route guidance through the application and follow the instructions.

[0403] Output: The user will be presented with visual route guidance, enabling a less stressful travel experience.

[0404] (Application example 2)

[0405] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0406] Conventional systems that provide optimal route guidance for specific users based on their needs information have the problem of being unable to reduce stress during travel because they do not take into account the user's emotional state. Additionally, it has been difficult to provide users with a comfortable travel experience by appropriately responding to the changing conditions of public transportation and facilities in real time.

[0407] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering need information of a specific user, means for acquiring predetermined map information and facility structure information, means for calculating an optimal route based on the need information and emotional information of the user, means for providing the optimal route to the user, means for updating the route information in real time, and means for acquiring emotional information of the user and recalculating the optimal route based on that information. This enables route guidance that is tailored to the emotional state of the user, reducing stress during travel and providing a more comfortable and flexible travel experience.

[0408] "Specific users" refer to individual users who require optimal route guidance based on needs information and emotional information.

[0409] "Needs information" is information that indicates the requirements and conditions that a user needs while traveling (e.g., wheelchair, stroller, carry case, etc.).

[0410] "Emotion information" is data that represents the user's emotional state (e.g., stress, joy, anger, etc.) obtained via the emotion engine.

[0411] "Map information" is data that indicates geographic locations and traffic conditions, and is typically obtained from a map provider.

[0412] "Facility structure information" is data related to the physical structure of buildings and public facilities, such as elevators, ramps, and stairs.

[0413] "Means for calculating a route" refers to an algorithm or program that calculates the optimal travel route based on the user's needs information and emotional information.

[0414] "Route providing means" refers to a device or application that notifies the user of the calculated optimal route visually or audibly.

[0415] "Real-time update means" refers to technology that constantly monitors information and instantly recalculates and corrects route information in response to new conditions.

[0416] "Means for acquiring emotional information" refers to a system that uses sensors such as cameras and microphones to collect the user's emotional state through their facial expressions and voice.

[0417] "Means for recalculating the route" refers to an algorithm or program that sets a new route that is optimal for the user based on the acquired emotional information.

[0418] The present invention is a system that provides optimal route guidance to a specific user and further acquires the user's emotional information and customizes the route guidance based on that information. This system registers the user's needs information and emotional information, and calculates and provides the optimal route based on that information. Specific embodiments for implementing this system are described below.

[0419] 1. User Registration

[0420] Users use their smartphones or computer terminals to register their usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information. The terminals send this information to a server, which then stores the received user needs and emotional information in a database.

[0421] 2. Obtaining map information and facility structure information

[0422] The server collects the latest map data using a map provider API (e.g., Google Maps API), and also obtains facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. This prepares the server to calculate routes tailored to the user's needs and emotional information.

[0423] 3. Route calculation

[0424] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered user needs and emotional information, to the server. The server receives this information and uses map information and facility structure information to calculate the optimal route. For example, it may prioritize elevators and ramps and select a route that avoids stairs and escalators. It also provides routes that reduce stress (e.g., routes that avoid crowds) based on emotional information.

[0425] 4. Collection and Use of Emotional Information

[0426] An emotion engine (e.g., software that performs facial expression recognition and voice analysis) is used to obtain the user's emotional information. This emotional information is updated in real time and sent to the server. The server uses this information to further customize route guidance and provide the user with the optimal travel experience.

[0427] 5. Real-time updates

[0428] The server constantly monitors the latest information on public transportation, construction status, and facility operation status. This makes it possible to update route information in real time. For example, if an elevator is out of order or crowded, a new route will be recalculated based on that information.

[0429] 6. Providing Results

[0430] The calculated optimal route is sent from the server to the device, which then visually displays this route information to the user. The user can follow detailed instructions (e.g., "Exit the east exit and walk 50 meters to the right to find the elevator") and enjoy a stress-free journey.

[0431] Specific examples

[0432] Example Scenario

[0433] Consider a user with a stroller traveling from Shinjuku Station to Shibuya Hikarie. The steps are as follows:

[0434] 1. User Registration:

[0435] The user registers permission to use the stroller and obtain emotional information using the smartphone app, and the device sends this information to the server, which then stores the user's needs and emotional information in a database.

[0436] 2. Route planning based on usage:

[0437] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination. The device sends this information to the server, which then uses map information and facility structure information to calculate the optimal route. For example, the system automatically generates a detailed route, such as taking the elevator from the east exit of Shinjuku Station, then using the slope to reach the platform, and then boarding a bus from a specific bus stop. The system also uses facial recognition and voice analysis to check the user's stress level and provides routes that avoid crowds.

[0438] 3. Real-time update of emotional information:

[0439] The emotion engine collects emotional information in real time through facial recognition and voice analysis, and sends it to a server. The server then recalculates route guidance based on the emotional information received in real time, and changes the optimal route if stress is felt.

[0440] 4. Providing results:

[0441] The calculated optimal route is sent to the terminal, which then visually displays route guidance to the user, allowing the user to enjoy a stress-free journey.

[0442] Prompt Sentence Examples

[0443] "Calculate which route will cause the least amount of stress for the user."

[0444] "Show the user the most comfortable route from Shinjuku to Shibuya"

[0445] In this way, the system of the present invention can provide optimal route guidance based on emotional information for users with specific needs, realizing a comfortable and stress-free travel experience.In addition, real-time information updates allow it to flexibly respond to the latest situations.

[0446] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0447] Step 1:

[0448] User Registration

[0449] Users use devices such as smartphones to input their own usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information. The device sends this information to the server. The server processes the received user needs and emotional information and stores it in a database, and saves the user information as its output.

[0450] Step 2:

[0451] Obtaining map information and facility structure information

[0452] The server obtains map and traffic information via a map provider API (e.g., Google Maps API). Based on this input, the server processes the data by retrieving facility structure information such as elevators, ramps, and stairs from a database of designated map data and public facilities and transportation facilities, and stores this information in a database. This output is used for subsequent route calculations.

[0453] Step 3:

[0454] Route calculation

[0455] The user enters the starting point and destination into the device, and this information is sent to the server, which performs the following data calculations:

[0456] 1. Registered needs and emotions

[0457] 2. Acquired map information and facility structure information

[0458] Based on this, an algorithm is run to calculate the optimal route, and the output is route information that prioritizes elevators and ramps and avoids stairs and escalators.

[0459] Step 4:

[0460] Collecting and using emotional information

[0461] The device collects the user's emotional information in real time using the attached camera and microphone. This input data is analyzed through an emotion engine (e.g., facial expression recognition or voice analysis software), and the output is the user's emotional state. The acquired emotional information is sent to a server, which updates it repeatedly.

[0462] Step 5:

[0463] Real-time updates

[0464] The server constantly monitors information on public transportation, construction status, and the equipment status of facilities. If an elevator is out of order or is crowded, route information is recalculated in real time based on this input data (re-executing data calculations). The output is a new optimal route.

[0465] Step 6:

[0466] Providing results

[0467] The optimal route is sent from the server to the device, which then displays it visually and audibly to the user. Specifically, detailed guidance such as "Exit the east exit and walk 50 meters to the right to find the elevator" is provided. The resulting output is route guidance that allows the user to travel without stress.

[0468] Prompt Sentence Examples

[0469] "Calculate which route will cause the least amount of stress for the user."

[0470] "Show the user the most comfortable route from Shinjuku to Shibuya"

[0471] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0472] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0473] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0474] [Second embodiment]

[0475] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0476] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0477] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0478] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0479] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0480] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0481] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0482] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0483] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0484] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0485] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0486] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0487] ---

[0488] The present invention is a system that provides optimal route guidance to a specific user. This system registers the user's needs information, calculates the optimal route based on that information, and provides the optimal route.

[0489] User Registration

[0490] First, the user uses a smartphone or computer terminal to register their own usage status (e.g., stroller, wheelchair, carry case, etc.). The terminal then sends this information to the server, which then stores the received user needs information in a database.

[0491] Obtaining map information

[0492] The server uses the map provider API to collect the latest map data. It also obtains facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. Based on this information, it prepares to calculate routes tailored to the user's needs.

[0493] Route calculation

[0494] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered user needs information, to the server. The server receives this information and uses map information and facility structure information to calculate the optimal route. In particular, it generates a route that prioritizes elevators and ramps and avoids stairs and escalators.

[0495] Real-time updates

[0496] The server constantly monitors the latest information on public transport, construction status, and facility operation status, allowing route information to be updated in real time. For example, if an elevator is out of order, a new route can be recalculated based on that information.

[0497] Providing results

[0498] The calculated optimal route is sent from the server to the device, which then visually displays this route information to the user. The user can then follow detailed instructions (e.g., "Exit the east exit and walk 50 meters to the right to find the elevator") to reach their destination.

[0499] Specific examples

[0500] Example Scenario

[0501] A case will be described in which a user using a stroller travels from Shinjuku Station to Shibuya Hikarie.

[0502] 1. User Registration

[0503] Users register "stroller use" using a smartphone app, and the device sends this information to the server.

[0504] The server stores the user's needs information in a database.

[0505] 2. Route calculation that reflects usage status

[0506] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[0507] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route.For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to get to the platform, and then board the bus at a specific bus stop."

[0508] 3. Real-time updates

[0509] The server constantly receives the latest information from public transport operators and city management authorities, and if the route information is affected, it recalculates and updates the new route.

[0510] 4. Providing results

[0511] The calculated optimal route is sent to the terminal, which then provides visual route guidance to the user.

[0512] In this way, the system of the present invention can provide optimal route guidance to users with specific needs, significantly facilitating smooth travel in urban areas. Furthermore, real-time information updates enable route guidance that reflects the latest conditions.

[0513] The processing flow will be explained below.

[0514] ---

[0515] Step 1: Register user needs information

[0516] User: Launches the smartphone app and registers the usage of strollers, wheelchairs, carry-on bags, etc.

[0517] Terminal: Sends registered usage information to the server.

[0518] Server: Saves the received usage status in a database.

[0519] Step 2: Obtaining map information and facility structure information

[0520] Server: Connects to the map provider API and collects the latest map data.

[0521] Server: Obtain detailed facility structure information such as elevators, ramps, and stairs from public facilities and transportation facilities.

[0522] Step 3: Receiving a request from the user

[0523] User: Enter starting point and destination.

[0524] Terminal: Sends the entered departure point and destination information, as well as pre-registered usage status, to the server.

[0525] Step 4: Calculate the optimal route

[0526] Server: Based on the received information, it combines map information and facility structure information to calculate the optimal route.

[0527] In this case, prioritize elevators and ramps and select a route that avoids stairs and escalators.

[0528] Step 5: Gathering real-time information

[0529] Server: Continuously collects real-time information from public transport and city management agencies (e.g., elevator malfunctions, road construction, etc.).

[0530] Server: Based on real-time information, recalculates the optimal route as needed.

[0531] Step 6: Providing the calculation results

[0532] Server: Sends the calculated optimal route information to the terminal.

[0533] Terminal: Visually displays route guidance to the user, such as detailed instructions like "Exit the east exit and walk 50 meters to the right to find the elevator."

[0534] Step 7: Real-time updates

[0535] Server: If an abnormality or failure (e.g. elevator malfunction) is detected, the server immediately recalculates the route based on the latest information and sends the results to the terminal.

[0536] Terminal: The latest recalculated route information is promptly displayed to the user, and the user is guided to the new route while on the move.

[0537] ---

[0538] In this way, by providing optimal route guidance with real-time updates to users with specific needs, it is possible to smooth travel in urban areas and improve user convenience.

[0539] Example 1

[0540] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0541] In modern urban environments, the use of barrier-free facilities such as elevators and ramps is extremely important for users with mobility difficulties (e.g., parents using strollers and wheelchair users). However, it is difficult for users to individually grasp the location of these facilities and available routes, and it is also difficult to respond to real-time changes (e.g., elevator malfunctions or construction). This has created a demand for a system that provides route guidance appropriate for users.

[0542] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0543] In this invention, the server includes means for registering usage status information of a specific user, means for acquiring predetermined map data and facility structure data, means for calculating an optimal route based on the usage status information of the user, means for updating the optimal route in real time, and means for providing the user with the optimal route updated in real time. This allows users to grasp the optimal route tailored to their needs in real time, enabling smooth travel in urban areas.

[0544] "Usage information" refers to information about the specific conditions and needs that users face when traveling, including the use of strollers, wheelchairs, carry-ons, etc.

[0545] "Map data" refers to electronic geographic information including location information for roads, buildings, facilities, etc. in a geographic area.

[0546] "Facility structure data" refers to information about the structure and equipment inside the facility, including information about the location and access methods of elevators, ramps, stairs, etc.

[0547] "Means for calculating the optimal route" refers to algorithms and programs that calculate the most efficient and comfortable travel route for users based on usage information, map data, and facility structure data.

[0548] "Means of updating in real time" refers to systems or programs that constantly monitor the latest traffic information and facility status, and have the ability to dynamically revise route guidance information.

[0549] "Means for providing routes to users" refers to devices or applications that visually or audibly communicate calculated optimal routes and real-time updated route information to users.

[0550] "Real-time updated optimal route" refers to a route that is dynamically recalculated taking into account the latest traffic conditions and equipment operation status, and is always optimized to suit the current situation.

[0551] This invention is a system that provides optimal route guidance to specific users. This system registers the user's usage information, calculates the optimal route based on that information, and updates and provides the information in real time.

[0552] User Registration

[0553] First, the user uses a smartphone or computer terminal to register their own usage information (e.g., stroller, wheelchair, carry-on suitcase, etc.). The terminal then sends this information to a server, which then stores the received usage information in a database. This makes it possible to provide personalized route information that reflects the user's needs.

[0554] Obtaining map information

[0555] The server uses a map provider API (e.g., Google Maps API) to collect the latest map data. It also obtains facility structure data such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. This provides the basic information for calculating the optimal route.

[0556] Route calculation

[0557] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered usage information, to the server. The server receives this information and uses map data and facility structure data to calculate the optimal route. Specifically, it generates a route that prioritizes elevators and ramps and avoids stairs and escalators.

[0558] Real-time updates

[0559] The server constantly monitors the latest information from public transportation agencies and city management organizations (e.g., traffic information, construction status, and facility operation status). This allows route information to be updated in real time. For example, if an elevator is out of order, a new route can be recalculated based on that information and provided to users.

[0560] Providing results

[0561] The calculated optimal route is sent from the server to the device. The device visually displays this route information to the user, allowing the user to follow detailed instructions to reach their destination. For example, specific instructions such as "Exit the east exit and walk 50 meters to the right to find the elevator" are displayed.

[0562] Specific examples

[0563] Example Scenario

[0564] A case will be described in which a user using a stroller travels from Shinjuku Station to Shibuya Hikarie.

[0565] 1. User Registration

[0566] Users register "stroller use" using a smartphone app, and the device sends this information to the server.

[0567] The server stores the user's needs information in a database.

[0568] 2. Route calculation that reflects usage status

[0569] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[0570] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route.For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to get to the platform, and then board the bus at a specific bus stop."

[0571] 3. Real-time updates

[0572] The server constantly receives the latest information from public transport operators and city management authorities, and if the route information is affected, it recalculates and updates the new route.

[0573] 4. Providing results

[0574] The calculated optimal route is sent to the terminal, which then provides visual route guidance to the user.

[0575] Prompt Sentence Examples

[0576] Calculate the optimal route for a stroller user traveling from Shinjuku Station to Shibuya Hikarie, prioritizing elevators and ramps and taking real-time traffic information into account.

[0577] Through the above process, the system of the present invention can provide optimal route guidance to users with specific needs, significantly facilitating smooth travel in urban areas. Real-time information updates also enable route guidance that reflects the latest conditions.

[0578] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0579] Step 1: User Registration

[0580] input

[0581] Users enter their own usage information into their smartphones or computer terminals.

[0582] concrete action

[0583] The user enters "stroller use" or "wheelchair use" in the app's "Usage status" form and presses the registration button.

[0584] Data processing and calculation

[0585] The terminal creates and sends a "POST" request to send the entered information to the server.

[0586] output

[0587] The usage status information sent by the terminal arrives at the server, which stores the information in a database and saves it as user usage status information.

[0588] Step 2: Obtaining map information and facility structure data

[0589] input

[0590] The server calls the map provider API (general name: map API) to send a request to obtain the latest map data. It also collects facility structure information from databases of public facilities and transportation facilities.

[0591] concrete action

[0592] The server accesses the map API using a "GET" request to receive the latest map data, and issues a "SELECT" query to the public facility database to retrieve facility data such as elevators and ramps.

[0593] Data processing and calculation

[0594] The JSON format map data received from the map API is combined with facility structure information obtained from the database and converted into a referenceable format.

[0595] output

[0596] The integrated map data and facility structure information are stored on the server and are available for use when calculating routes.

[0597] Step 3: Route calculation

[0598] input

[0599] The user inputs the starting point and destination into the terminal.

[0600] concrete action

[0601] The user inputs the starting point "Shinjuku Station" and the destination "Shibuya Hikarie" and presses the send button. The device then sends this information to the server.

[0602] Data processing and calculation

[0603] The server receives the starting point and destination information, and then uses map data, facility structure information, and usage information to run an algorithm to calculate the optimal route, which includes logic to prioritize elevators and ramps.

[0604] output

[0605] The server generates optimal route information as a result of route calculation, including which route the user should take at a specific location.

[0606] Step 4: Real-time updates

[0607] input

[0608] The server obtains the latest information on public transportation operations, construction status, and equipment operation status.

[0609] concrete action

[0610] The server periodically sends a "GET" request to the public transportation company's SAPI to receive the latest traffic information, construction status, and facility status.

[0611] Data processing and calculation

[0612] Based on the latest information received, the server evaluates whether the pre-calculated optimal route will be affected and recalculates the route if necessary.

[0613] output

[0614] The server generates updated optimal route information in real time.

[0615] Step 5: Delivering results

[0616] input

[0617] The server sends the calculated optimal route information to the terminal.

[0618] concrete action

[0619] The server sends route information in JSON format to the terminal, which receives and analyzes it.

[0620] Data processing and calculation

[0621] To visually display the received route information, the terminal draws the route on a map and provides guidance in a format that is easy for the user to understand.

[0622] output

[0623] Users can visually check detailed route guidance on their device, such as "Take the elevator from the east exit of Shinjuku Station, then use the slope to reach the platform."

[0624] (Application example 1)

[0625] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0626] Conventional route guidance systems have the problem of being unable to provide optimal routes tailored to specific user needs and circumstances. In particular, in situations such as food delivery, delivery personnel are required to calculate optimal routes based on their own means of transportation. Furthermore, delivery efficiency can be reduced due to insufficient route updates to reflect real-time changes in traffic and road construction information. The present invention aims to solve these problems.

[0627] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0628] In this invention, the server includes a means for registering status information of a specific user, a means for acquiring predetermined map data and traffic regulation data, a means for calculating an optimal route based on the status information of the user, a means for providing the optimal route to the user, and a means for updating the route information in real time. This allows delivery personnel to efficiently obtain an optimal route according to their own means of transportation and to adapt to the latest traffic information and road construction information in real time.

[0629] "Specific users" refers to individuals with specific needs or circumstances, such as delivery people.

[0630] "Status information" includes information about the means of transportation used by the user and the conditions of use.

[0631] "Map data" refers to digital map information including location information for roads, facilities, traffic regulations, etc.

[0632] "Traffic regulation data" refers to traffic regulation information such as one-way streets, no entry restrictions, and speed limits.

[0633] "Means for calculating a route" refers to a function that calculates the optimal travel route based on the input starting point and destination, as well as the user's situation information.

[0634] "Means of updating in real time" refers to the function of constantly updating route information in response to the latest environmental changes, such as traffic information and road construction information.

[0635] "Map Provider API" refers to an application program interface for obtaining map data from an external service.

[0636] "Server" refers to a computer system that receives requests from users, performs the necessary data processing, and returns the results.

[0637] "Public transportation database" refers to a database that includes operation information and facility information for public transportation such as buses and trains.

[0638] "Calculating a route with priority given to elevators and ramps" means calculating a route that avoids stairs and escalators and uses elevators and ramps as the primary means of transportation.

[0639] "Construction information and facility equipment status" refers to the latest information on facilities, such as the progress of transportation construction work and elevator malfunction status.

[0640] These are the definitions of important terms included in the scope of patent claims. Please check them.

[0641] The present invention is an invention of a system that provides optimal route guidance to specific users. It is designed especially for the food delivery field, enabling delivery personnel to perform their delivery work efficiently.

[0642] User Registration

[0643] First, the delivery person uses a smartphone app to register their own status information (e.g., bicycle, motorcycle, car, etc.). The device sends this information to the server, which then stores the received user status information in a database.

[0644] Obtaining map data

[0645] Next, the server uses the map provider API to collect the latest map data and retrieves traffic regulation information such as one-way streets and no-entry restrictions from the traffic regulation database. Based on this information, the server is ready to calculate a route tailored to the user's situation.

[0646] Route calculation

[0647] When a delivery person enters their starting point (restaurant) and destination (customer address) into the smartphone app, the device sends this information, along with pre-registered user status information, to a server. The server receives this information and uses map data and traffic regulation data to calculate the optimal route. For example, for delivery people who use bicycles, it generates a bicycle-only route that takes into account vehicle closures and one-way street restrictions.

[0648] Real-time updates

[0649] The server constantly monitors traffic and road construction information, allowing it to update route information in real time. For example, if a traffic accident occurs or a route change is required due to road construction, the server will recalculate a new route based on that information.

[0650] Providing results

[0651] The calculated optimal route is sent from the server to the terminal. The terminal visually displays this route information to the delivery person. The delivery person can travel to their destination efficiently by following detailed instructions (e.g., "Go straight down XX Street and turn right at △△ intersection").

[0652] Specific examples

[0653] This section explains the case where a delivery person delivers food using a bicycle.

[0654] 1. User Registration

[0655] The delivery person registers "using a bicycle" on a smartphone app, and the device sends this information to the server.

[0656] The server stores the user's status information in a database.

[0657] 2. Route calculation

[0658] The delivery person enters the starting point (Restaurant A) and destination (Customer B's address).

[0659] The device sends this information to a server, which then uses map data and traffic regulation data to calculate the optimal route. For example, it automatically generates a detailed route such as "use bicycle lanes and turn right at specific intersections."

[0660] 3. Real-time updates

[0661] The server constantly receives traffic and road construction information, and if the route information is affected, it recalculates and updates a new route.

[0662] 4. Providing results

[0663] The calculated optimal route is sent to the terminal, which provides visual route guidance to the delivery person.

[0664] This allows delivery personnel to efficiently obtain the optimal route based on their means of transportation, and to carry out delivery tasks while adapting to the latest traffic and road construction information in real time.

[0665] Example prompts to be input to the generative AI model

[0666] "A user needs to place an order from Restaurant A from home by bicycle and then deliver it directly to Customer B's address. How can I use Google Maps API to calculate the optimal route in bicycle mode and update the route information in real time through the server?"

[0667] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0668] Step 1:

[0669] User Registration

[0670] Input: The delivery person enters their situation information (e.g. bicycle, motorcycle, car, etc.) into the smartphone app.

[0671] Operation: The device sends the entered information to the server.

[0672] Data processing: None.

[0673] Output: The delivery person's status information is registered in the server-side database.

[0674] Step 2:

[0675] Obtaining map data

[0676] Input: The server periodically requests updates to map data and traffic control data.

[0677] How it works: The server uses the map provider API to get the latest map data and retrieves information from the traffic regulation database.

[0678] Data processing: Extract the necessary map information and traffic regulation information from the API response and store it in the server database.

[0679] Output: The latest map data and traffic regulation data are saved in the server database.

[0680] Step 3:

[0681] Route calculation

[0682] Input: The delivery person enters the starting point (restaurant) and destination (customer address) into the smartphone app.

[0683] Operation: The device sends this information and previously registered user status information to the server.

[0684] Data processing: The server uses map data and traffic regulation data to calculate the optimal route, creating routes tailored to specific modes of transportation (e.g., bicycle routes, car routes).

[0685] Output: The calculated optimal route is sent from the server to the device.

[0686] Step 4:

[0687] Real-time updates

[0688] Input: The server retrieves the latest traffic and road construction information.

[0689] Behavior: The server monitors this information and updates the routing information as needed.

[0690] Data processing: Recalculate a new optimal route based on updated traffic and road construction information.

[0691] Output: Updated route information is sent to the delivery driver's device (if necessary).

[0692] Step 5:

[0693] Providing results

[0694] Input: Route calculation result.

[0695] Operation: The terminal visually displays the calculated optimal route information to the delivery person.

[0696] Data processing: None.

[0697] Output: Detailed route instructions (e.g., "Go straight down XX Street and turn right at △△ intersection") are displayed to the delivery person.

[0698] The above is a detailed description of the processing steps of the system program that realizes the application example.

[0699] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0700] ---

[0701] The present invention is a system that provides optimal route guidance for a specific user and further acquires and customizes route guidance based on the user's emotional information. This system registers the user's needs information and emotional information, and calculates and provides the optimal route based on that information.

[0702] User Registration

[0703] First, the user uses a smartphone or computer terminal to register their usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information. The terminal then sends this information to the server, which then stores the received user needs and emotional information in a database.

[0704] Obtaining map information and facility structure information

[0705] The server collects the latest map data using the map provider API. It also obtains facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. Based on this information, it prepares to calculate a route that matches the user's needs and emotional information.

[0706] Route calculation

[0707] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered user needs and emotional information, to the server. The server receives this information and uses map information and facility structure information to calculate the optimal route. The server prioritizes elevators and ramps and selects routes that avoid stairs and escalators. It also provides routes that reduce stress (e.g., routes that avoid crowds) based on emotional information.

[0708] Collecting and using emotional information

[0709] The emotion engine uses facial recognition or voice analysis to obtain emotional information from the user. This emotional information is updated in real time and sent to the server, which then customizes route guidance based on this information to provide the user with the optimal travel experience.

[0710] Real-time updates

[0711] The server constantly monitors the latest information on public transport, construction status, and facility operation status, allowing route information to be updated in real time. For example, if an elevator is out of order or crowded, a new route will be recalculated based on that information.

[0712] Providing results

[0713] The calculated optimal route is sent from the server to the device, which then visually displays this route information to the user. The user can follow detailed instructions (e.g., "Exit the east exit and walk 50 meters to the right to find the elevator") to reduce stress while traveling.

[0714] Specific examples

[0715] Example Scenario

[0716] A method for reducing a user's stress level while traveling from Shinjuku Station to Shibuya Hikarie using a stroller will be described.

[0717] 1. User Registration

[0718] The user registers "stroller use" and permission to obtain emotional information using a smartphone app, and the device then sends this information to the server.

[0719] The server stores the user's needs information and emotion information in a database.

[0720] 2. Route calculation that reflects usage status

[0721] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[0722] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route. For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to head to the platform, and then board the bus at a specific bus stop." It also uses facial recognition and voice analysis to check the user's stress level and provide a route that avoids crowds.

[0723] 3. Real-time updates of emotional information

[0724] The emotion engine collects emotional information in real time through facial recognition and voice analysis of the user and transmits it to the server.

[0725] The server recalculates route guidance based on the emotional information received in real time, and changes the optimal route if stress is felt.

[0726] 4. Providing results

[0727] The calculated optimal route is sent to the terminal, which then visually displays route guidance to the user, allowing the user to enjoy a stress-free journey.

[0728] In this way, the system of the present invention can provide optimal route guidance based on emotional information for users with specific needs, realizing a comfortable and stress-free travel experience.In addition, real-time information updates allow it to flexibly respond to the latest situations.

[0729] The processing flow will be explained below.

[0730] ---

[0731] Step 1: Registering user needs and emotions

[0732] User: Launches the smartphone app and registers their usage status (e.g., stroller, wheelchair, carry case, etc.) and permission to obtain emotional information.

[0733] Device: Sends the registered usage status and permission to obtain emotion information to the server.

[0734] Server: Stores the received usage status and permission to obtain emotion information in a database.

[0735] Step 2: Obtaining map information and facility structure information

[0736] Server: Collects the latest map data using the map provider API.

[0737] Server: Obtains facility structural information such as elevators, ramps, and stairs from databases of public facilities and transportation facilities.

[0738] Step 3: Enter your departure and destination information

[0739] User: Enter the starting point and destination into the smartphone device.

[0740] Terminal: Sends the input starting point and destination, as well as pre-registered usage status and permission to obtain emotion information, to the server.

[0741] Step 4: Calculate the optimal route

[0742] Server: Based on the received information, the server uses map information and facility structure information to calculate the optimal route. In particular, it prioritizes elevators and ramps, and derives a route that avoids stairs and escalators.

[0743] Step 5: Collecting emotional information

[0744] Device: Uses a camera and microphone to recognize the user's face or perform voice analysis to obtain emotional information.

[0745] Terminal: Sends the acquired emotion information to the server.

[0746] Step 6: Customizing route guidance based on emotional information

[0747] Server: Determines the user's stress level and mood based on the received emotional information. Based on this information, route guidance is customized. For example, it suggests routes that avoid crowds or more convenient ways of traveling.

[0748] Step 7: Real-time information collection and route updates

[0749] Server: Continuously collects real-time information from public transport and city management agencies (e.g., elevator malfunctions, road construction, etc.).

[0750] Server: Based on real-time information, it recalculates the optimal route as needed and generates new route guidance that includes emotional information.

[0751] Step 8: Providing optimal routes

[0752] Server: Sends the calculated optimal route to the terminal.

[0753] Terminal: Visual route guidance is displayed to the user, such as "Exit the east exit and walk 50 meters to the right to find the elevator."

[0754] Step 9: Real-time updates of emotions and route guidance

[0755] Emotion engine: Collects emotional information in real time while the user is on the move using facial recognition and voice analysis.

[0756] Device: Sends updated emotion information to the server.

[0757] Server: Recalculates the route based on new emotional information and traffic conditions received in real time, and sends the latest route information to the device.

[0758] Terminal: Visually displays updated route information to the user and guides them to new routes.

[0759] ---

[0760] In this way, by providing real-time optimal route guidance to users with specific needs and emotional information, users can enjoy a comfortable and stress-free journey.

[0761] Example 2

[0762] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0763] Conventional route guidance systems can provide route guidance that reflects a user's specific needs, but they cannot provide routes that take into account the user's emotional state. As a result, users often feel stressed while traveling, which is particularly burdensome for users with disabilities and those traveling with children. Furthermore, they do not support real-time updates of the latest public transportation status or construction information, and sometimes cannot provide the latest route information.

[0764] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for registering need information and emotion information of a specific user, a means for acquiring predetermined map information and facility structure information, a means for calculating an optimal route based on the user's need information and emotion information, a means for collecting emotion information in real time using facial recognition or voice analysis, a means for providing the optimal route to the user, and a means for monitoring the latest information on public transportation, construction status, and facility operation status, and updating the route information in real time. This enables optimal route guidance that takes into account the user's needs and emotion state, thereby providing a comfortable and stress-free travel experience. Furthermore, real-time information updates enable route guidance that corresponds to the latest conditions.

[0765] "Specific user needs information" is information that includes special requirements or conditions that a user needs when traveling, such as information about the use of strollers or wheelchairs, the number and size of luggage, etc.

[0766] "Emotional information" is data that indicates the user's emotional state, including stress levels and mood states obtained through facial recognition and voice analysis.

[0767] "Map information" is data that indicates geographical locations, roads, facility locations, etc., and is obtained from a map provider API.

[0768] "Facility structure information" is information about the internal structure of public facilities and transportation facilities, and is data that indicates the location and status of elevators, ramps, stairs, etc.

[0769] An "optimal route" is a route that takes into account the user's needs and emotions and allows them to travel to their destination in the most efficient and comfortable way.

[0770] "Facial recognition" is a technology that takes a picture of a user's face with a camera and analyzes their facial features to determine their emotional state based on their facial expressions.

[0771] "Voice analysis" is a technology that records a user's voice and analyzes the voice data to determine their emotional state based on the tone and pitch of their voice.

[0772] "Latest information on public transportation" refers to transportation-related information provided in real time, such as the operation status of trains and buses, delay information, and notices of non-operating days.

[0773] "Construction status" refers to current status information about construction work, such as road construction and facility repairs, that affects traffic flow and facility use.

[0774] "Facility operating status" is information that indicates whether mechanical equipment such as elevators and escalators are operating normally.

[0775] The present invention is a system that provides optimal route guidance to a specific user, and further acquires the user's emotional information and customizes the route guidance based on that information. This system registers the user's needs information and emotional information, and calculates and provides the optimal route based on that information.

[0776] System configuration and hardware and software used

[0777] User Registration

[0778] Users use their smartphones or computer terminals to register their usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information (using facial recognition or voice analysis). The terminals send this information to a server, which then stores the received information in a database. The specific hardware and software used are shown below.

[0779] Hardware:

[0780] Smartphone

[0781] computer terminal

[0782] server

[0783] software:

[0784] Mobile or web applications (for entering user information)

[0785] Database System

[0786] Facial Recognition and Voice Analysis Software

[0787] Obtaining map information and facility structure information

[0788] The server obtains the latest map data using a map provider API (e.g., Google Maps API), and also collects facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation facilities.

[0789] Route calculation

[0790] The device sends the user's input starting point and destination, as well as the user's registered needs and emotional information, to the server. The server calculates the optimal route, prioritizing elevators and ramps, based on map information and facility structure information. It also takes emotional information into account and provides routes that reduce stress (e.g., routes that avoid crowds).

[0791] Collecting and using emotional information

[0792] The emotion engine uses facial recognition or voice analysis to obtain real-time emotional information from the user and transmits it to the server, which then customizes route guidance based on that information to provide the user with an optimal travel experience.

[0793] Real-time updates

[0794] The server constantly monitors the latest information on public transport, construction status, and facility operation status to update route information in real time. For example, if information on elevator malfunctions or congestion is obtained in real time, the server recalculates the optimal route based on that information and sends the results to the terminal.

[0795] Providing results

[0796] The terminal visually presents the optimal route sent from the server to the user, who can then follow the visual instructions to travel, enjoying a stress-free travel experience.

[0797] Specific examples

[0798] Example Scenario

[0799] A method for reducing the stress level of a user using a stroller while traveling from Shinjuku Station to Shibuya Hikarie will be specifically described.

[0800] 1. User Registration

[0801] The user registers "stroller use" and "permission to obtain emotional information" in the app on their smartphone, and the information is sent to the server.

[0802] The server stores the received user needs information and emotion information in a database.

[0803] Example prompt: "I'm using a stroller. Please tell me the best route from Shinjuku Station to Shibuya Hikarie. Also, please monitor my emotional information as I want to reduce stress during the trip."

[0804] 2. Route calculation that reflects usage status

[0805] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[0806] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route. For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to get to the platform, and then board the bus at a specific bus stop." It also provides routes that avoid crowds based on emotion information.

[0807] Example prompt: "Please tell me which bus stop I should take after taking the elevator from the east exit of Shinjuku Station to the platform."

[0808] 3. Real-time updates of emotional information

[0809] The emotion engine collects emotional information in real time through facial recognition and voice analysis of the user and sends it to the server.

[0810] The server recalculates route guidance based on the emotional information received in real time, and changes the optimal route if stress is felt.

[0811] Example prompt: "Based on my current stress level, please guide me to the most relaxing route."

[0812] 4. Providing results

[0813] The calculated optimal route is sent to the terminal, which then visually displays route guidance to the user, allowing the user to enjoy a stress-free journey.

[0814] Example prompt: "What's the next step on my current route?"

[0815] In this way, the system provides optimal route guidance based on emotional information for users with specific needs, realizing a comfortable and stress-free travel experience.In addition, real-time information updates enable the system to flexibly respond to the latest conditions.

[0816] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0817] Step 1: User Registration

[0818] Input: The user uses a smartphone or computer terminal to set the usage status of the stroller, wheelchair, etc. and whether facial recognition or voice analysis will be used.

[0819] Specific behavior:

[0820] The user selects "Stroller use" and "Allow emotional information acquisition" from the smartphone application screen.

[0821] The terminal sends this information to the server as a "POST" request.

[0822] Output: The server stores the received information in a database and returns a registration confirmation message to the terminal.

[0823] Step 2: Obtaining map information and facility structure information

[0824] Input: The server obtains map information using the map provider API and collects facility structure information from public facility and transportation databases.

[0825] Specific behavior:

[0826] The server sends a "GET" request to the map provider API to retrieve the latest map data.

[0827] The server obtains facility structural information such as elevators, ramps, and stairs from the public facility's API and integrates it with map data.

[0828] Output: The latest map information and facility structure information are stored on the server, ready for route calculation.

[0829] Step 3: Route calculation

[0830] Input: The user inputs the starting point and destination through the terminal, which then sends this to the server. The terminal also inputs previously registered needs and emotion information.

[0831] Specific behavior:

[0832] A user inputs a route request from "Shinjuku Station" to "Shibuya Hikarie" into a smartphone app.

[0833] The terminal sends the request to the server as a "POST" request.

[0834] The server calculates the optimal route based on map information, facility structure information, and user needs and emotions, taking into account stress levels and selecting routes that avoid congestion as necessary.

[0835] Output: The server converts the calculated optimal route into a data format and sends it to the terminal.

[0836] Step 4: Collecting and using emotional information

[0837] Input: The emotion engine obtains emotion information in real time using facial recognition or voice analysis of the user and sends it to the server.

[0838] Specific behavior:

[0839] The emotion engine uses the smartphone's camera or microphone to analyze the user's facial expressions and voice.

[0840] The acquired emotional information is sent to the server in real time.

[0841] Output: The server receives the emotion information, customizes route guidance in real time, and recalculates the optimal route if an update is needed.

[0842] Step 5: Real-time updates

[0843] Input: The server monitors public transport updates, construction status, and equipment operation status.

[0844] Specific behavior:

[0845] The server sends a "GET" request to the public transportation API to obtain information on operation status and delays.

[0846] The latest information is obtained from an API that monitors construction information and equipment operation status.

[0847] If necessary, the optimum route is recalculated based on this information.

[0848] Output: The server generates the latest route information and sends it to the terminal. If the route information is updated, the user is notified.

[0849] Step 6: Delivering results

[0850] Input: Optimal route information sent from the server.

[0851] Specific behavior:

[0852] The terminal analyzes the route information received from the server and visually displays it to the user.

[0853] Users can check detailed route guidance through the application and follow the instructions.

[0854] Output: The user will be presented with visual route guidance, enabling a less stressful travel experience.

[0855] (Application example 2)

[0856] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0857] Conventional systems that provide optimal route guidance for specific users based on their needs information have the problem of being unable to reduce stress during travel because they do not take into account the user's emotional state. Additionally, it has been difficult to provide users with a comfortable travel experience by appropriately responding to the changing conditions of public transportation and facilities in real time.

[0858] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering need information of a specific user, means for acquiring predetermined map information and facility structure information, means for calculating an optimal route based on the need information and emotional information of the user, means for providing the optimal route to the user, means for updating the route information in real time, and means for acquiring emotional information of the user and recalculating the optimal route based on that information. This enables route guidance that is tailored to the emotional state of the user, reducing stress during travel and providing a more comfortable and flexible travel experience.

[0859] "Specific users" refer to individual users who require optimal route guidance based on needs information and emotional information.

[0860] "Needs information" is information that indicates the requirements and conditions that a user needs while traveling (e.g., wheelchair, stroller, carry case, etc.).

[0861] "Emotion information" is data that represents the user's emotional state (e.g., stress, joy, anger, etc.) obtained via the emotion engine.

[0862] "Map information" is data that indicates geographic locations and traffic conditions, and is typically obtained from a map provider.

[0863] "Facility structure information" is data related to the physical structure of buildings and public facilities, such as elevators, ramps, and stairs.

[0864] "Means for calculating a route" refers to an algorithm or program that calculates the optimal travel route based on the user's needs information and emotional information.

[0865] "Route providing means" refers to a device or application that notifies the user of the calculated optimal route visually or audibly.

[0866] "Real-time update means" refers to technology that constantly monitors information and instantly recalculates and corrects route information in response to new conditions.

[0867] "Means for acquiring emotional information" refers to a system that uses sensors such as cameras and microphones to collect the user's emotional state through their facial expressions and voice.

[0868] "Means for recalculating the route" refers to an algorithm or program that sets a new route that is optimal for the user based on the acquired emotional information.

[0869] The present invention is a system that provides optimal route guidance to a specific user and further acquires the user's emotional information and customizes the route guidance based on that information. This system registers the user's needs information and emotional information, and calculates and provides the optimal route based on that information. Specific embodiments for implementing this system are described below.

[0870] 1. User Registration

[0871] Users use their smartphones or computer terminals to register their usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information. The terminals send this information to a server, which then stores the received user needs and emotional information in a database.

[0872] 2. Obtaining map information and facility structure information

[0873] The server collects the latest map data using a map provider API (e.g., Google Maps API), and also obtains facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. This prepares the server to calculate routes tailored to the user's needs and emotional information.

[0874] 3. Route calculation

[0875] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered user needs and emotional information, to the server. The server receives this information and uses map information and facility structure information to calculate the optimal route. For example, it may prioritize elevators and ramps and select a route that avoids stairs and escalators. It also provides routes that reduce stress (e.g., routes that avoid crowds) based on emotional information.

[0876] 4. Collection and Use of Emotional Information

[0877] An emotion engine (e.g., software that performs facial expression recognition and voice analysis) is used to obtain the user's emotional information. This emotional information is updated in real time and sent to the server. The server uses this information to further customize route guidance and provide the user with the optimal travel experience.

[0878] 5. Real-time updates

[0879] The server constantly monitors the latest information on public transportation, construction status, and facility operation status. This makes it possible to update route information in real time. For example, if an elevator is out of order or crowded, a new route will be recalculated based on that information.

[0880] 6. Providing Results

[0881] The calculated optimal route is sent from the server to the device, which then visually displays this route information to the user. The user can follow detailed instructions (e.g., "Exit the east exit and walk 50 meters to the right to find the elevator") and enjoy a stress-free journey.

[0882] Specific examples

[0883] Example Scenario

[0884] Consider a user with a stroller traveling from Shinjuku Station to Shibuya Hikarie. The steps are as follows:

[0885] 1. User Registration:

[0886] The user registers permission to use the stroller and obtain emotional information using the smartphone app, and the device sends this information to the server, which then stores the user's needs and emotional information in a database.

[0887] 2. Route planning based on usage:

[0888] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination. The device sends this information to the server, which then uses map information and facility structure information to calculate the optimal route. For example, the system automatically generates a detailed route, such as taking the elevator from the east exit of Shinjuku Station, then using the slope to reach the platform, and then boarding a bus from a specific bus stop. The system also uses facial recognition and voice analysis to check the user's stress level and provides routes that avoid crowds.

[0889] 3. Real-time update of emotional information:

[0890] The emotion engine collects emotional information in real time through facial recognition and voice analysis, and sends it to a server. The server then recalculates route guidance based on the emotional information received in real time, and changes the optimal route if stress is felt.

[0891] 4. Providing results:

[0892] The calculated optimal route is sent to the terminal, which then visually displays route guidance to the user, allowing the user to enjoy a stress-free journey.

[0893] Prompt Sentence Examples

[0894] "Calculate which route will cause the least amount of stress for the user."

[0895] "Show the user the most comfortable route from Shinjuku to Shibuya"

[0896] In this way, the system of the present invention can provide optimal route guidance based on emotional information for users with specific needs, realizing a comfortable and stress-free travel experience.In addition, real-time information updates allow it to flexibly respond to the latest situations.

[0897] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0898] Step 1:

[0899] User Registration

[0900] Users use devices such as smartphones to input their own usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information. The device sends this information to the server. The server processes the received user needs and emotional information and stores it in a database, and saves the user information as its output.

[0901] Step 2:

[0902] Obtaining map information and facility structure information

[0903] The server obtains map and traffic information via a map provider API (e.g., Google Maps API). Based on this input, the server processes the data by retrieving facility structure information such as elevators, ramps, and stairs from a database of designated map data and public facilities and transportation facilities, and stores this information in a database. This output is used for subsequent route calculations.

[0904] Step 3:

[0905] Route calculation

[0906] The user enters the starting point and destination into the device, and this information is sent to the server, which performs the following data calculations:

[0907] 1. Registered needs and emotions

[0908] 2. Acquired map information and facility structure information

[0909] Based on this, an algorithm is run to calculate the optimal route, and the output is route information that prioritizes elevators and ramps and avoids stairs and escalators.

[0910] Step 4:

[0911] Collecting and using emotional information

[0912] The device collects the user's emotional information in real time using the attached camera and microphone. This input data is analyzed through an emotion engine (e.g., facial expression recognition or voice analysis software), and the output is the user's emotional state. The acquired emotional information is sent to a server, which updates it repeatedly.

[0913] Step 5:

[0914] Real-time updates

[0915] The server constantly monitors information on public transportation, construction status, and the equipment status of facilities. If an elevator is out of order or is crowded, route information is recalculated in real time based on this input data (re-executing data calculations). The output is a new optimal route.

[0916] Step 6:

[0917] Providing results

[0918] The optimal route is sent from the server to the device, which then displays it visually and audibly to the user. Specifically, detailed guidance such as "Exit the east exit and walk 50 meters to the right to find the elevator" is provided. The resulting output is route guidance that allows the user to travel without stress.

[0919] Prompt Sentence Examples

[0920] "Calculate which route will cause the least amount of stress for the user."

[0921] "Show the user the most comfortable route from Shinjuku to Shibuya"

[0922] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0923] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0924] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0925] [Third embodiment]

[0926] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0927] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0928] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0929] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0930] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0931] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0932] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0933] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0934] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0935] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0936] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0937] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0938] ---

[0939] The present invention is a system that provides optimal route guidance to a specific user. This system registers the user's needs information, calculates the optimal route based on that information, and provides the optimal route.

[0940] User Registration

[0941] First, the user uses a smartphone or computer terminal to register their own usage status (e.g., stroller, wheelchair, carry case, etc.). The terminal then sends this information to the server, which then stores the received user needs information in a database.

[0942] Obtaining map information

[0943] The server uses the map provider API to collect the latest map data. It also obtains facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. Based on this information, it prepares to calculate routes tailored to the user's needs.

[0944] Route calculation

[0945] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered user needs information, to the server. The server receives this information and uses map information and facility structure information to calculate the optimal route. In particular, it generates a route that prioritizes elevators and ramps and avoids stairs and escalators.

[0946] Real-time updates

[0947] The server constantly monitors the latest information on public transport, construction status, and facility operation status, allowing route information to be updated in real time. For example, if an elevator is out of order, a new route can be recalculated based on that information.

[0948] Providing results

[0949] The calculated optimal route is sent from the server to the device, which then visually displays this route information to the user. The user can then follow detailed instructions (e.g., "Exit the east exit and walk 50 meters to the right to find the elevator") to reach their destination.

[0950] Specific examples

[0951] Example Scenario

[0952] A case will be described in which a user using a stroller travels from Shinjuku Station to Shibuya Hikarie.

[0953] 1. User Registration

[0954] Users register "stroller use" using a smartphone app, and the device sends this information to the server.

[0955] The server stores the user's needs information in a database.

[0956] 2. Route calculation that reflects usage status

[0957] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[0958] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route.For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to get to the platform, and then board the bus at a specific bus stop."

[0959] 3. Real-time updates

[0960] The server constantly receives the latest information from public transport operators and city management authorities, and if the route information is affected, it recalculates and updates the new route.

[0961] 4. Providing results

[0962] The calculated optimal route is sent to the terminal, which then provides visual route guidance to the user.

[0963] In this way, the system of the present invention can provide optimal route guidance to users with specific needs, significantly facilitating smooth travel in urban areas. Furthermore, real-time information updates enable route guidance that reflects the latest conditions.

[0964] The processing flow will be explained below.

[0965] ---

[0966] Step 1: Register user needs information

[0967] User: Launches the smartphone app and registers the usage of strollers, wheelchairs, carry-on bags, etc.

[0968] Terminal: Sends registered usage information to the server.

[0969] Server: Saves the received usage status in a database.

[0970] Step 2: Obtaining map information and facility structure information

[0971] Server: Connects to the map provider API and collects the latest map data.

[0972] Server: Obtain detailed facility structure information such as elevators, ramps, and stairs from public facilities and transportation facilities.

[0973] Step 3: Receiving a request from the user

[0974] User: Enter starting point and destination.

[0975] Terminal: Sends the entered departure point and destination information, as well as pre-registered usage status, to the server.

[0976] Step 4: Calculate the optimal route

[0977] Server: Based on the received information, it combines map information and facility structure information to calculate the optimal route.

[0978] In this case, prioritize elevators and ramps and select a route that avoids stairs and escalators.

[0979] Step 5: Gathering real-time information

[0980] Server: Continuously collects real-time information from public transport and city management agencies (e.g., elevator malfunctions, road construction, etc.).

[0981] Server: Based on real-time information, recalculates the optimal route as needed.

[0982] Step 6: Providing the calculation results

[0983] Server: Sends the calculated optimal route information to the terminal.

[0984] Terminal: Visually displays route guidance to the user, such as detailed instructions like "Exit the east exit and walk 50 meters to the right to find the elevator."

[0985] Step 7: Real-time updates

[0986] Server: If an abnormality or failure (e.g. elevator malfunction) is detected, the server immediately recalculates the route based on the latest information and sends the results to the terminal.

[0987] Terminal: The latest recalculated route information is promptly displayed to the user, and the user is guided to the new route while on the move.

[0988] ---

[0989] In this way, by providing optimal route guidance with real-time updates to users with specific needs, it is possible to smooth travel in urban areas and improve user convenience.

[0990] Example 1

[0991] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0992] In modern urban environments, the use of barrier-free facilities such as elevators and ramps is extremely important for users with mobility difficulties (e.g., parents using strollers and wheelchair users). However, it is difficult for users to individually grasp the location of these facilities and available routes, and it is also difficult to respond to real-time changes (e.g., elevator malfunctions or construction). This has created a demand for a system that provides route guidance appropriate for users.

[0993] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0994] In this invention, the server includes means for registering usage status information of a specific user, means for acquiring predetermined map data and facility structure data, means for calculating an optimal route based on the usage status information of the user, means for updating the optimal route in real time, and means for providing the user with the optimal route updated in real time. This allows users to grasp the optimal route tailored to their needs in real time, enabling smooth travel in urban areas.

[0995] "Usage information" refers to information about the specific conditions and needs that users face when traveling, including the use of strollers, wheelchairs, carry-ons, etc.

[0996] "Map data" refers to electronic geographic information including location information for roads, buildings, facilities, etc. in a geographic area.

[0997] "Facility structure data" refers to information about the structure and equipment inside the facility, including information about the location and access methods of elevators, ramps, stairs, etc.

[0998] "Means for calculating the optimal route" refers to algorithms and programs that calculate the most efficient and comfortable travel route for users based on usage information, map data, and facility structure data.

[0999] "Means of updating in real time" refers to systems or programs that constantly monitor the latest traffic information and facility status, and have the ability to dynamically revise route guidance information.

[1000] "Means for providing routes to users" refers to devices or applications that visually or audibly communicate calculated optimal routes and real-time updated route information to users.

[1001] "Real-time updated optimal route" refers to a route that is dynamically recalculated taking into account the latest traffic conditions and equipment operation status, and is always optimized to suit the current situation.

[1002] This invention is a system that provides optimal route guidance to specific users. This system registers the user's usage information, calculates the optimal route based on that information, and updates and provides the information in real time.

[1003] User Registration

[1004] First, the user uses a smartphone or computer terminal to register their own usage information (e.g., stroller, wheelchair, carry-on suitcase, etc.). The terminal then sends this information to a server, which then stores the received usage information in a database. This makes it possible to provide personalized route information that reflects the user's needs.

[1005] Obtaining map information

[1006] The server uses a map provider API (e.g., Google Maps API) to collect the latest map data. It also obtains facility structure data such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. This provides the basic information for calculating the optimal route.

[1007] Route calculation

[1008] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered usage information, to the server. The server receives this information and uses map data and facility structure data to calculate the optimal route. Specifically, it generates a route that prioritizes elevators and ramps and avoids stairs and escalators.

[1009] Real-time updates

[1010] The server constantly monitors the latest information from public transportation agencies and city management organizations (e.g., traffic information, construction status, and facility operation status). This allows route information to be updated in real time. For example, if an elevator is out of order, a new route can be recalculated based on that information and provided to users.

[1011] Providing results

[1012] The calculated optimal route is sent from the server to the device. The device visually displays this route information to the user, allowing the user to follow detailed instructions to reach their destination. For example, specific instructions such as "Exit the east exit and walk 50 meters to the right to find the elevator" are displayed.

[1013] Specific examples

[1014] Example Scenario

[1015] A case will be described in which a user using a stroller travels from Shinjuku Station to Shibuya Hikarie.

[1016] 1. User Registration

[1017] Users register "stroller use" using a smartphone app, and the device sends this information to the server.

[1018] The server stores the user's needs information in a database.

[1019] 2. Route calculation that reflects usage status

[1020] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[1021] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route.For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to get to the platform, and then board the bus at a specific bus stop."

[1022] 3. Real-time updates

[1023] The server constantly receives the latest information from public transport operators and city management authorities, and if the route information is affected, it recalculates and updates the new route.

[1024] 4. Providing results

[1025] The calculated optimal route is sent to the terminal, which then provides visual route guidance to the user.

[1026] Prompt Sentence Examples

[1027] Calculate the optimal route for a stroller user traveling from Shinjuku Station to Shibuya Hikarie, prioritizing elevators and ramps and taking real-time traffic information into account.

[1028] Through the above process, the system of the present invention can provide optimal route guidance to users with specific needs, significantly facilitating smooth travel in urban areas. Real-time information updates also enable route guidance that reflects the latest conditions.

[1029] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1030] Step 1: User Registration

[1031] input

[1032] Users enter their own usage information into their smartphones or computer terminals.

[1033] concrete action

[1034] The user enters "stroller use" or "wheelchair use" in the app's "Usage status" form and presses the registration button.

[1035] Data processing and calculation

[1036] The terminal creates and sends a "POST" request to send the entered information to the server.

[1037] output

[1038] The usage status information sent by the terminal arrives at the server, which stores the information in a database and saves it as user usage status information.

[1039] Step 2: Obtaining map information and facility structure data

[1040] input

[1041] The server calls the map provider API (general name: map API) to send a request to obtain the latest map data. It also collects facility structure information from databases of public facilities and transportation facilities.

[1042] concrete action

[1043] The server accesses the map API using a "GET" request to receive the latest map data, and issues a "SELECT" query to the public facility database to retrieve facility data such as elevators and ramps.

[1044] Data processing and calculation

[1045] The JSON format map data received from the map API is combined with facility structure information obtained from the database and converted into a referenceable format.

[1046] output

[1047] The integrated map data and facility structure information are stored on the server and are available for use when calculating routes.

[1048] Step 3: Route calculation

[1049] input

[1050] The user inputs the starting point and destination into the terminal.

[1051] concrete action

[1052] The user inputs the starting point "Shinjuku Station" and the destination "Shibuya Hikarie" and presses the send button. The device then sends this information to the server.

[1053] Data processing and calculation

[1054] The server receives the starting point and destination information, and then uses map data, facility structure information, and usage information to run an algorithm to calculate the optimal route, which includes logic to prioritize elevators and ramps.

[1055] output

[1056] The server generates optimal route information as a result of route calculation, including which route the user should take at a specific location.

[1057] Step 4: Real-time updates

[1058] input

[1059] The server obtains the latest information on public transportation operations, construction status, and equipment operation status.

[1060] concrete action

[1061] The server periodically sends a "GET" request to the public transportation company's SAPI to receive the latest traffic information, construction status, and facility status.

[1062] Data processing and calculation

[1063] Based on the latest information received, the server evaluates whether the pre-calculated optimal route will be affected and recalculates the route if necessary.

[1064] output

[1065] The server generates updated optimal route information in real time.

[1066] Step 5: Delivering results

[1067] input

[1068] The server sends the calculated optimal route information to the terminal.

[1069] concrete action

[1070] The server sends route information in JSON format to the terminal, which receives and analyzes it.

[1071] Data processing and calculation

[1072] To visually display the received route information, the terminal draws the route on a map and provides guidance in a format that is easy for the user to understand.

[1073] output

[1074] Users can visually check detailed route guidance on their device, such as "Take the elevator from the east exit of Shinjuku Station, then use the slope to reach the platform."

[1075] (Application example 1)

[1076] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1077] Conventional route guidance systems have the problem of being unable to provide optimal routes tailored to specific user needs and circumstances. In particular, in situations such as food delivery, delivery personnel are required to calculate optimal routes based on their own means of transportation. Furthermore, delivery efficiency can be reduced due to insufficient route updates to reflect real-time changes in traffic and road construction information. The present invention aims to solve these problems.

[1078] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1079] In this invention, the server includes a means for registering status information of a specific user, a means for acquiring predetermined map data and traffic regulation data, a means for calculating an optimal route based on the status information of the user, a means for providing the optimal route to the user, and a means for updating the route information in real time. This allows delivery personnel to efficiently obtain an optimal route according to their own means of transportation and to adapt to the latest traffic information and road construction information in real time.

[1080] "Specific users" refers to individuals with specific needs or circumstances, such as delivery people.

[1081] "Status information" includes information about the means of transportation used by the user and the conditions of use.

[1082] "Map data" refers to digital map information including location information for roads, facilities, traffic regulations, etc.

[1083] "Traffic regulation data" refers to traffic regulation information such as one-way streets, no entry restrictions, and speed limits.

[1084] "Means for calculating a route" refers to a function that calculates the optimal travel route based on the input starting point and destination, as well as the user's situation information.

[1085] "Means of updating in real time" refers to the function of constantly updating route information in response to the latest environmental changes, such as traffic information and road construction information.

[1086] "Map Provider API" refers to an application program interface for obtaining map data from an external service.

[1087] "Server" refers to a computer system that receives requests from users, performs the necessary data processing, and returns the results.

[1088] "Public transportation database" refers to a database that includes operation information and facility information for public transportation such as buses and trains.

[1089] "Calculating a route with priority given to elevators and ramps" means calculating a route that avoids stairs and escalators and uses elevators and ramps as the primary means of transportation.

[1090] "Construction information and facility equipment status" refers to the latest information on facilities, such as the progress of transportation construction work and elevator malfunction status.

[1091] These are the definitions of important terms included in the scope of patent claims. Please check them.

[1092] The present invention is an invention of a system that provides optimal route guidance to specific users. It is designed especially for the food delivery field, enabling delivery personnel to perform their delivery work efficiently.

[1093] User Registration

[1094] First, the delivery person uses a smartphone app to register their own status information (e.g., bicycle, motorcycle, car, etc.). The device sends this information to the server, which then stores the received user status information in a database.

[1095] Obtaining map data

[1096] Next, the server uses the map provider API to collect the latest map data and retrieves traffic regulation information such as one-way streets and no-entry restrictions from the traffic regulation database. Based on this information, the server is ready to calculate a route tailored to the user's situation.

[1097] Route calculation

[1098] When a delivery person enters their starting point (restaurant) and destination (customer address) into the smartphone app, the device sends this information, along with pre-registered user status information, to a server. The server receives this information and uses map data and traffic regulation data to calculate the optimal route. For example, for delivery people who use bicycles, it generates a bicycle-only route that takes into account vehicle closures and one-way street restrictions.

[1099] Real-time updates

[1100] The server constantly monitors traffic and road construction information, allowing it to update route information in real time. For example, if a traffic accident occurs or a route change is required due to road construction, the server will recalculate a new route based on that information.

[1101] Providing results

[1102] The calculated optimal route is sent from the server to the terminal. The terminal visually displays this route information to the delivery person. The delivery person can travel to their destination efficiently by following detailed instructions (e.g., "Go straight down XX Street and turn right at △△ intersection").

[1103] Specific examples

[1104] This section explains the case where a delivery person delivers food using a bicycle.

[1105] 1. User Registration

[1106] The delivery person registers "using a bicycle" on a smartphone app, and the device sends this information to the server.

[1107] The server stores the user's status information in a database.

[1108] 2. Route calculation

[1109] The delivery person enters the starting point (Restaurant A) and destination (Customer B's address).

[1110] The device sends this information to a server, which then uses map data and traffic regulation data to calculate the optimal route. For example, it automatically generates a detailed route such as "use bicycle lanes and turn right at specific intersections."

[1111] 3. Real-time updates

[1112] The server constantly receives traffic and road construction information, and if the route information is affected, it recalculates and updates a new route.

[1113] 4. Providing results

[1114] The calculated optimal route is sent to the terminal, which provides visual route guidance to the delivery person.

[1115] This allows delivery personnel to efficiently obtain the optimal route based on their means of transportation, and to carry out delivery tasks while adapting to the latest traffic and road construction information in real time.

[1116] Example prompts to be input to the generative AI model

[1117] "A user needs to place an order from Restaurant A from home by bicycle and then deliver it directly to Customer B's address. How can I use Google Maps API to calculate the optimal route in bicycle mode and update the route information in real time through the server?"

[1118] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1119] Step 1:

[1120] User Registration

[1121] Input: The delivery person enters their situation information (e.g. bicycle, motorcycle, car, etc.) into the smartphone app.

[1122] Operation: The device sends the entered information to the server.

[1123] Data processing: None.

[1124] Output: The delivery person's status information is registered in the server-side database.

[1125] Step 2:

[1126] Obtaining map data

[1127] Input: The server periodically requests updates to map data and traffic control data.

[1128] How it works: The server uses the map provider API to get the latest map data and retrieves information from the traffic regulation database.

[1129] Data processing: Extract the necessary map information and traffic regulation information from the API response and store it in the server database.

[1130] Output: The latest map data and traffic regulation data are saved in the server database.

[1131] Step 3:

[1132] Route calculation

[1133] Input: The delivery person enters the starting point (restaurant) and destination (customer address) into the smartphone app.

[1134] Operation: The device sends this information and previously registered user status information to the server.

[1135] Data processing: The server uses map data and traffic regulation data to calculate the optimal route, creating routes tailored to specific modes of transportation (e.g., bicycle routes, car routes).

[1136] Output: The calculated optimal route is sent from the server to the device.

[1137] Step 4:

[1138] Real-time updates

[1139] Input: The server retrieves the latest traffic and road construction information.

[1140] Behavior: The server monitors this information and updates the routing information as needed.

[1141] Data processing: Recalculate a new optimal route based on updated traffic and road construction information.

[1142] Output: Updated route information is sent to the delivery driver's device (if necessary).

[1143] Step 5:

[1144] Providing results

[1145] Input: Route calculation result.

[1146] Operation: The terminal visually displays the calculated optimal route information to the delivery person.

[1147] Data processing: None.

[1148] Output: Detailed route instructions (e.g., "Go straight down XX Street and turn right at △△ intersection") are displayed to the delivery person.

[1149] The above is a detailed description of the processing steps of the system program that realizes the application example.

[1150] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1151] ---

[1152] The present invention is a system that provides optimal route guidance for a specific user and further acquires and customizes route guidance based on the user's emotional information. This system registers the user's needs information and emotional information, and calculates and provides the optimal route based on that information.

[1153] User Registration

[1154] First, the user uses a smartphone or computer terminal to register their usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information. The terminal then sends this information to the server, which then stores the received user needs and emotional information in a database.

[1155] Obtaining map information and facility structure information

[1156] The server collects the latest map data using the map provider API. It also obtains facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. Based on this information, it prepares to calculate a route that matches the user's needs and emotional information.

[1157] Route calculation

[1158] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered user needs and emotional information, to the server. The server receives this information and uses map information and facility structure information to calculate the optimal route. The server prioritizes elevators and ramps and selects routes that avoid stairs and escalators. It also provides routes that reduce stress (e.g., routes that avoid crowds) based on emotional information.

[1159] Collecting and using emotional information

[1160] The emotion engine uses facial recognition or voice analysis to obtain emotional information from the user. This emotional information is updated in real time and sent to the server, which then customizes route guidance based on this information to provide the user with the optimal travel experience.

[1161] Real-time updates

[1162] The server constantly monitors the latest information on public transport, construction status, and facility operation status, allowing route information to be updated in real time. For example, if an elevator is out of order or crowded, a new route will be recalculated based on that information.

[1163] Providing results

[1164] The calculated optimal route is sent from the server to the device, which then visually displays this route information to the user. The user can follow detailed instructions (e.g., "Exit the east exit and walk 50 meters to the right to find the elevator") to reduce stress while traveling.

[1165] Specific examples

[1166] Example Scenario

[1167] A method for reducing a user's stress level while traveling from Shinjuku Station to Shibuya Hikarie using a stroller will be described.

[1168] 1. User Registration

[1169] The user registers "stroller use" and permission to obtain emotional information using a smartphone app, and the device then sends this information to the server.

[1170] The server stores the user's needs information and emotion information in a database.

[1171] 2. Route calculation that reflects usage status

[1172] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[1173] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route. For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to head to the platform, and then board the bus at a specific bus stop." It also uses facial recognition and voice analysis to check the user's stress level and provide a route that avoids crowds.

[1174] 3. Real-time updates of emotional information

[1175] The emotion engine collects emotional information in real time through facial recognition and voice analysis of the user and transmits it to the server.

[1176] The server recalculates route guidance based on the emotional information received in real time, and changes the optimal route if stress is felt.

[1177] 4. Providing results

[1178] The calculated optimal route is sent to the terminal, which then visually displays route guidance to the user, allowing the user to enjoy a stress-free journey.

[1179] In this way, the system of the present invention can provide optimal route guidance based on emotional information for users with specific needs, realizing a comfortable and stress-free travel experience.In addition, real-time information updates allow it to flexibly respond to the latest situations.

[1180] The processing flow will be explained below.

[1181] ---

[1182] Step 1: Registering user needs and emotions

[1183] User: Launches the smartphone app and registers their usage status (e.g., stroller, wheelchair, carry case, etc.) and permission to obtain emotional information.

[1184] Device: Sends the registered usage status and permission to obtain emotion information to the server.

[1185] Server: Stores the received usage status and permission to obtain emotion information in a database.

[1186] Step 2: Obtaining map information and facility structure information

[1187] Server: Collects the latest map data using the map provider API.

[1188] Server: Obtains facility structural information such as elevators, ramps, and stairs from databases of public facilities and transportation facilities.

[1189] Step 3: Enter your departure and destination information

[1190] User: Enter the starting point and destination into the smartphone device.

[1191] Terminal: Sends the input starting point and destination, as well as pre-registered usage status and permission to obtain emotion information, to the server.

[1192] Step 4: Calculate the optimal route

[1193] Server: Based on the received information, the server uses map information and facility structure information to calculate the optimal route. In particular, it prioritizes elevators and ramps, and derives a route that avoids stairs and escalators.

[1194] Step 5: Collecting emotional information

[1195] Device: Uses a camera and microphone to recognize the user's face or perform voice analysis to obtain emotional information.

[1196] Terminal: Sends the acquired emotion information to the server.

[1197] Step 6: Customizing route guidance based on emotional information

[1198] Server: Determines the user's stress level and mood based on the received emotional information. Based on this information, route guidance is customized. For example, it suggests routes that avoid crowds or more convenient ways of traveling.

[1199] Step 7: Real-time information collection and route updates

[1200] Server: Continuously collects real-time information from public transport and city management agencies (e.g., elevator malfunctions, road construction, etc.).

[1201] Server: Based on real-time information, it recalculates the optimal route as needed and generates new route guidance that includes emotional information.

[1202] Step 8: Providing optimal routes

[1203] Server: Sends the calculated optimal route to the terminal.

[1204] Terminal: Visual route guidance is displayed to the user, such as "Exit the east exit and walk 50 meters to the right to find the elevator."

[1205] Step 9: Real-time updates of emotions and route guidance

[1206] Emotion engine: Collects emotional information in real time while the user is on the move using facial recognition and voice analysis.

[1207] Device: Sends updated emotion information to the server.

[1208] Server: Recalculates the route based on new emotional information and traffic conditions received in real time, and sends the latest route information to the device.

[1209] Terminal: Visually displays updated route information to the user and guides them to new routes.

[1210] ---

[1211] In this way, by providing real-time optimal route guidance to users with specific needs and emotional information, users can enjoy a comfortable and stress-free journey.

[1212] Example 2

[1213] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1214] Conventional route guidance systems can provide route guidance that reflects a user's specific needs, but they cannot provide routes that take into account the user's emotional state. As a result, users often feel stressed while traveling, which is particularly burdensome for users with disabilities and those traveling with children. Furthermore, they do not support real-time updates of the latest public transportation status or construction information, and sometimes cannot provide the latest route information.

[1215] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for registering need information and emotion information of a specific user, a means for acquiring predetermined map information and facility structure information, a means for calculating an optimal route based on the user's need information and emotion information, a means for collecting emotion information in real time using facial recognition or voice analysis, a means for providing the optimal route to the user, and a means for monitoring the latest information on public transportation, construction status, and facility operation status, and updating the route information in real time. This enables optimal route guidance that takes into account the user's needs and emotion state, thereby providing a comfortable and stress-free travel experience. Furthermore, real-time information updates enable route guidance that corresponds to the latest conditions.

[1216] "Specific user needs information" is information that includes special requirements or conditions that a user needs when traveling, such as information about the use of strollers or wheelchairs, the number and size of luggage, etc.

[1217] "Emotional information" is data that indicates the user's emotional state, including stress levels and mood states obtained through facial recognition and voice analysis.

[1218] "Map information" is data that indicates geographical locations, roads, facility locations, etc., and is obtained from a map provider API.

[1219] "Facility structure information" is information about the internal structure of public facilities and transportation facilities, and is data that indicates the location and status of elevators, ramps, stairs, etc.

[1220] An "optimal route" is a route that takes into account the user's needs and emotions and allows them to travel to their destination in the most efficient and comfortable way.

[1221] "Facial recognition" is a technology that takes a picture of a user's face with a camera and analyzes their facial features to determine their emotional state based on their facial expressions.

[1222] "Voice analysis" is a technology that records a user's voice and analyzes the voice data to determine their emotional state based on the tone and pitch of their voice.

[1223] "Latest information on public transportation" refers to transportation-related information provided in real time, such as the operation status of trains and buses, delay information, and notices of non-operating days.

[1224] "Construction status" refers to current status information about construction work, such as road construction and facility repairs, that affects traffic flow and facility use.

[1225] "Facility operating status" is information that indicates whether mechanical equipment such as elevators and escalators are operating normally.

[1226] The present invention is a system that provides optimal route guidance to a specific user, and further acquires the user's emotional information and customizes the route guidance based on that information. This system registers the user's needs information and emotional information, and calculates and provides the optimal route based on that information.

[1227] System configuration and hardware and software used

[1228] User Registration

[1229] Users use their smartphones or computer terminals to register their usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information (using facial recognition or voice analysis). The terminals send this information to a server, which then stores the received information in a database. The specific hardware and software used are shown below.

[1230] Hardware:

[1231] Smartphone

[1232] computer terminal

[1233] server

[1234] software:

[1235] Mobile or web applications (for entering user information)

[1236] Database System

[1237] Facial Recognition and Voice Analysis Software

[1238] Obtaining map information and facility structure information

[1239] The server obtains the latest map data using a map provider API (e.g., Google Maps API), and also collects facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation facilities.

[1240] Route calculation

[1241] The device sends the user's input starting point and destination, as well as the user's registered needs and emotional information, to the server. The server calculates the optimal route, prioritizing elevators and ramps, based on map information and facility structure information. It also takes emotional information into account and provides routes that reduce stress (e.g., routes that avoid crowds).

[1242] Collecting and using emotional information

[1243] The emotion engine uses facial recognition or voice analysis to obtain real-time emotional information from the user and transmits it to the server, which then customizes route guidance based on that information to provide the user with an optimal travel experience.

[1244] Real-time updates

[1245] The server constantly monitors the latest information on public transport, construction status, and facility operation status to update route information in real time. For example, if information on elevator malfunctions or congestion is obtained in real time, the server recalculates the optimal route based on that information and sends the results to the terminal.

[1246] Providing results

[1247] The terminal visually presents the optimal route sent from the server to the user, who can then follow the visual instructions to travel, enjoying a stress-free travel experience.

[1248] Specific examples

[1249] Example Scenario

[1250] A method for reducing the stress level of a user using a stroller while traveling from Shinjuku Station to Shibuya Hikarie will be specifically described.

[1251] 1. User Registration

[1252] The user registers "stroller use" and "permission to obtain emotional information" in the app on their smartphone, and the information is sent to the server.

[1253] The server stores the received user needs information and emotion information in a database.

[1254] Example prompt: "I'm using a stroller. Please tell me the best route from Shinjuku Station to Shibuya Hikarie. Also, please monitor my emotional information as I want to reduce stress during the trip."

[1255] 2. Route calculation that reflects usage status

[1256] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[1257] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route. For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to get to the platform, and then board the bus at a specific bus stop." It also provides routes that avoid crowds based on emotion information.

[1258] Example prompt: "Please tell me which bus stop I should take after taking the elevator from the east exit of Shinjuku Station to the platform."

[1259] 3. Real-time updates of emotional information

[1260] The emotion engine collects emotional information in real time through facial recognition and voice analysis of the user and sends it to the server.

[1261] The server recalculates route guidance based on the emotional information received in real time, and changes the optimal route if stress is felt.

[1262] Example prompt: "Based on my current stress level, please guide me to the most relaxing route."

[1263] 4. Providing results

[1264] The calculated optimal route is sent to the terminal, which then visually displays route guidance to the user, allowing the user to enjoy a stress-free journey.

[1265] Example prompt: "What's the next step on my current route?"

[1266] In this way, the system provides optimal route guidance based on emotional information for users with specific needs, realizing a comfortable and stress-free travel experience.In addition, real-time information updates enable the system to flexibly respond to the latest conditions.

[1267] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1268] Step 1: User Registration

[1269] Input: The user uses a smartphone or computer terminal to set the usage status of the stroller, wheelchair, etc. and whether facial recognition or voice analysis will be used.

[1270] Specific behavior:

[1271] The user selects "Stroller use" and "Allow emotional information acquisition" from the smartphone application screen.

[1272] The terminal sends this information to the server as a "POST" request.

[1273] Output: The server stores the received information in a database and returns a registration confirmation message to the terminal.

[1274] Step 2: Obtaining map information and facility structure information

[1275] Input: The server obtains map information using the map provider API and collects facility structure information from public facility and transportation databases.

[1276] Specific behavior:

[1277] The server sends a "GET" request to the map provider API to retrieve the latest map data.

[1278] The server obtains facility structural information such as elevators, ramps, and stairs from the public facility's API and integrates it with map data.

[1279] Output: The latest map information and facility structure information are stored on the server, ready for route calculation.

[1280] Step 3: Route calculation

[1281] Input: The user inputs the starting point and destination through the terminal, which then sends this to the server. The terminal also inputs previously registered needs and emotion information.

[1282] Specific behavior:

[1283] A user inputs a route request from "Shinjuku Station" to "Shibuya Hikarie" into a smartphone app.

[1284] The terminal sends the request to the server as a "POST" request.

[1285] The server calculates the optimal route based on map information, facility structure information, and user needs and emotions, taking into account stress levels and selecting routes that avoid congestion as necessary.

[1286] Output: The server converts the calculated optimal route into a data format and sends it to the terminal.

[1287] Step 4: Collecting and using emotional information

[1288] Input: The emotion engine obtains emotion information in real time using facial recognition or voice analysis of the user and sends it to the server.

[1289] Specific behavior:

[1290] The emotion engine uses the smartphone's camera or microphone to analyze the user's facial expressions and voice.

[1291] The acquired emotional information is sent to the server in real time.

[1292] Output: The server receives the emotion information, customizes route guidance in real time, and recalculates the optimal route if an update is needed.

[1293] Step 5: Real-time updates

[1294] Input: The server monitors public transport updates, construction status, and equipment operation status.

[1295] Specific behavior:

[1296] The server sends a "GET" request to the public transportation API to obtain information on operation status and delays.

[1297] The latest information is obtained from an API that monitors construction information and equipment operation status.

[1298] If necessary, the optimum route is recalculated based on this information.

[1299] Output: The server generates the latest route information and sends it to the terminal. If the route information is updated, the user is notified.

[1300] Step 6: Delivering results

[1301] Input: Optimal route information sent from the server.

[1302] Specific behavior:

[1303] The terminal analyzes the route information received from the server and visually displays it to the user.

[1304] Users can check detailed route guidance through the application and follow the instructions.

[1305] Output: The user will be presented with visual route guidance, enabling a less stressful travel experience.

[1306] (Application example 2)

[1307] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1308] Conventional systems that provide optimal route guidance for specific users based on their needs information have the problem of being unable to reduce stress during travel because they do not take into account the user's emotional state. Additionally, it has been difficult to provide users with a comfortable travel experience by appropriately responding to the changing conditions of public transportation and facilities in real time.

[1309] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering need information of a specific user, means for acquiring predetermined map information and facility structure information, means for calculating an optimal route based on the need information and emotional information of the user, means for providing the optimal route to the user, means for updating the route information in real time, and means for acquiring emotional information of the user and recalculating the optimal route based on that information. This enables route guidance that is tailored to the emotional state of the user, reducing stress during travel and providing a more comfortable and flexible travel experience.

[1310] "Specific users" refer to individual users who require optimal route guidance based on needs information and emotional information.

[1311] "Needs information" is information that indicates the requirements and conditions that a user needs while traveling (e.g., wheelchair, stroller, carry case, etc.).

[1312] "Emotion information" is data that represents the user's emotional state (e.g., stress, joy, anger, etc.) obtained via the emotion engine.

[1313] "Map information" is data that indicates geographic locations and traffic conditions, and is typically obtained from a map provider.

[1314] "Facility structure information" is data related to the physical structure of buildings and public facilities, such as elevators, ramps, and stairs.

[1315] "Means for calculating a route" refers to an algorithm or program that calculates the optimal travel route based on the user's needs information and emotional information.

[1316] "Route providing means" refers to a device or application that notifies the user of the calculated optimal route visually or audibly.

[1317] "Real-time update means" refers to technology that constantly monitors information and instantly recalculates and corrects route information in response to new conditions.

[1318] "Means for acquiring emotional information" refers to a system that uses sensors such as cameras and microphones to collect the user's emotional state through their facial expressions and voice.

[1319] "Means for recalculating the route" refers to an algorithm or program that sets a new route that is optimal for the user based on the acquired emotional information.

[1320] The present invention is a system that provides optimal route guidance to a specific user and further acquires the user's emotional information and customizes the route guidance based on that information. This system registers the user's needs information and emotional information, and calculates and provides the optimal route based on that information. Specific embodiments for implementing this system are described below.

[1321] 1. User Registration

[1322] Users use their smartphones or computer terminals to register their usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information. The terminals send this information to a server, which then stores the received user needs and emotional information in a database.

[1323] 2. Obtaining map information and facility structure information

[1324] The server collects the latest map data using a map provider API (e.g., Google Maps API), and also obtains facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. This prepares the server to calculate routes tailored to the user's needs and emotional information.

[1325] 3. Route calculation

[1326] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered user needs and emotional information, to the server. The server receives this information and uses map information and facility structure information to calculate the optimal route. For example, it may prioritize elevators and ramps and select a route that avoids stairs and escalators. It also provides routes that reduce stress (e.g., routes that avoid crowds) based on emotional information.

[1327] 4. Collection and Use of Emotional Information

[1328] An emotion engine (e.g., software that performs facial expression recognition and voice analysis) is used to obtain the user's emotional information. This emotional information is updated in real time and sent to the server. The server uses this information to further customize route guidance and provide the user with the optimal travel experience.

[1329] 5. Real-time updates

[1330] The server constantly monitors the latest information on public transportation, construction status, and facility operation status. This makes it possible to update route information in real time. For example, if an elevator is out of order or crowded, a new route will be recalculated based on that information.

[1331] 6. Providing Results

[1332] The calculated optimal route is sent from the server to the device, which then visually displays this route information to the user. The user can follow detailed instructions (e.g., "Exit the east exit and walk 50 meters to the right to find the elevator") and enjoy a stress-free journey.

[1333] Specific examples

[1334] Example Scenario

[1335] Consider a user with a stroller traveling from Shinjuku Station to Shibuya Hikarie. The steps are as follows:

[1336] 1. User Registration:

[1337] The user registers permission to use the stroller and obtain emotional information using the smartphone app, and the device sends this information to the server, which then stores the user's needs and emotional information in a database.

[1338] 2. Route planning based on usage:

[1339] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination. The device sends this information to the server, which then uses map information and facility structure information to calculate the optimal route. For example, the system automatically generates a detailed route, such as taking the elevator from the east exit of Shinjuku Station, then using the slope to reach the platform, and then boarding a bus from a specific bus stop. The system also uses facial recognition and voice analysis to check the user's stress level and provides routes that avoid crowds.

[1340] 3. Real-time update of emotional information:

[1341] The emotion engine collects emotional information in real time through facial recognition and voice analysis, and sends it to a server. The server then recalculates route guidance based on the emotional information received in real time, and changes the optimal route if stress is felt.

[1342] 4. Providing results:

[1343] The calculated optimal route is sent to the terminal, which then visually displays route guidance to the user, allowing the user to enjoy a stress-free journey.

[1344] Prompt Sentence Examples

[1345] "Calculate which route will cause the least amount of stress for the user."

[1346] "Show the user the most comfortable route from Shinjuku to Shibuya"

[1347] In this way, the system of the present invention can provide optimal route guidance based on emotional information for users with specific needs, realizing a comfortable and stress-free travel experience.In addition, real-time information updates allow it to flexibly respond to the latest situations.

[1348] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1349] Step 1:

[1350] User Registration

[1351] Users use devices such as smartphones to input their own usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information. The device sends this information to the server. The server processes the received user needs and emotional information and stores it in a database, and saves the user information as its output.

[1352] Step 2:

[1353] Obtaining map information and facility structure information

[1354] The server obtains map and traffic information via a map provider API (e.g., Google Maps API). Based on this input, the server processes the data by retrieving facility structure information such as elevators, ramps, and stairs from a database of designated map data and public facilities and transportation facilities, and stores this information in a database. This output is used for subsequent route calculations.

[1355] Step 3:

[1356] Route calculation

[1357] The user enters the starting point and destination into the device, and this information is sent to the server, which performs the following data calculations:

[1358] 1. Registered needs and emotions

[1359] 2. Acquired map information and facility structure information

[1360] Based on this, an algorithm is run to calculate the optimal route, and the output is route information that prioritizes elevators and ramps and avoids stairs and escalators.

[1361] Step 4:

[1362] Collecting and using emotional information

[1363] The device collects the user's emotional information in real time using the attached camera and microphone. This input data is analyzed through an emotion engine (e.g., facial expression recognition or voice analysis software), and the output is the user's emotional state. The acquired emotional information is sent to a server, which updates it repeatedly.

[1364] Step 5:

[1365] Real-time updates

[1366] The server constantly monitors information on public transportation, construction status, and the equipment status of facilities. If an elevator is out of order or is crowded, route information is recalculated in real time based on this input data (re-executing data calculations). The output is a new optimal route.

[1367] Step 6:

[1368] Providing results

[1369] The optimal route is sent from the server to the device, which then displays it visually and audibly to the user. Specifically, detailed guidance such as "Exit the east exit and walk 50 meters to the right to find the elevator" is provided. The resulting output is route guidance that allows the user to travel without stress.

[1370] Prompt Sentence Examples

[1371] "Calculate which route will cause the least amount of stress for the user."

[1372] "Show the user the most comfortable route from Shinjuku to Shibuya"

[1373] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1374] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1375] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1376] [Fourth embodiment]

[1377] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1378] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1379] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1380] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1381] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1382] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1383] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1384] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1385] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1386] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1387] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1388] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1389] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1390] ---

[1391] The present invention is a system that provides optimal route guidance to a specific user. This system registers the user's needs information, calculates the optimal route based on that information, and provides the optimal route.

[1392] User Registration

[1393] First, the user uses a smartphone or computer terminal to register their own usage status (e.g., stroller, wheelchair, carry case, etc.). The terminal then sends this information to the server, which then stores the received user needs information in a database.

[1394] Obtaining map information

[1395] The server uses the map provider API to collect the latest map data. It also obtains facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. Based on this information, it prepares to calculate routes tailored to the user's needs.

[1396] Route calculation

[1397] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered user needs information, to the server. The server receives this information and uses map information and facility structure information to calculate the optimal route. In particular, it generates a route that prioritizes elevators and ramps and avoids stairs and escalators.

[1398] Real-time updates

[1399] The server constantly monitors the latest information on public transport, construction status, and facility operation status, allowing route information to be updated in real time. For example, if an elevator is out of order, a new route can be recalculated based on that information.

[1400] Providing results

[1401] The calculated optimal route is sent from the server to the device, which then visually displays this route information to the user. The user can then follow detailed instructions (e.g., "Exit the east exit and walk 50 meters to the right to find the elevator") to reach their destination.

[1402] Specific examples

[1403] Example Scenario

[1404] A case will be described in which a user using a stroller travels from Shinjuku Station to Shibuya Hikarie.

[1405] 1. User Registration

[1406] Users register "stroller use" using a smartphone app, and the device sends this information to the server.

[1407] The server stores the user's needs information in a database.

[1408] 2. Route calculation that reflects usage status

[1409] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[1410] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route.For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to get to the platform, and then board the bus at a specific bus stop."

[1411] 3. Real-time updates

[1412] The server constantly receives the latest information from public transport operators and city management authorities, and if the route information is affected, it recalculates and updates the new route.

[1413] 4. Providing results

[1414] The calculated optimal route is sent to the terminal, which then provides visual route guidance to the user.

[1415] In this way, the system of the present invention can provide optimal route guidance to users with specific needs, significantly facilitating smooth travel in urban areas. Furthermore, real-time information updates enable route guidance that reflects the latest conditions.

[1416] The processing flow will be explained below.

[1417] ---

[1418] Step 1: Register user needs information

[1419] User: Launches the smartphone app and registers the usage of strollers, wheelchairs, carry-on bags, etc.

[1420] Terminal: Sends registered usage information to the server.

[1421] Server: Saves the received usage status in a database.

[1422] Step 2: Obtaining map information and facility structure information

[1423] Server: Connects to the map provider API and collects the latest map data.

[1424] Server: Obtain detailed facility structure information such as elevators, ramps, and stairs from public facilities and transportation facilities.

[1425] Step 3: Receiving a request from the user

[1426] User: Enter starting point and destination.

[1427] Terminal: Sends the entered departure point and destination information, as well as pre-registered usage status, to the server.

[1428] Step 4: Calculate the optimal route

[1429] Server: Based on the received information, it combines map information and facility structure information to calculate the optimal route.

[1430] In this case, prioritize elevators and ramps and select a route that avoids stairs and escalators.

[1431] Step 5: Gathering real-time information

[1432] Server: Continuously collects real-time information from public transport and city management agencies (e.g., elevator malfunctions, road construction, etc.).

[1433] Server: Based on real-time information, recalculates the optimal route as needed.

[1434] Step 6: Providing the calculation results

[1435] Server: Sends the calculated optimal route information to the terminal.

[1436] Terminal: Visually displays route guidance to the user, such as detailed instructions like "Exit the east exit and walk 50 meters to the right to find the elevator."

[1437] Step 7: Real-time updates

[1438] Server: If an abnormality or failure (e.g. elevator malfunction) is detected, the server immediately recalculates the route based on the latest information and sends the results to the terminal.

[1439] Terminal: The latest recalculated route information is promptly displayed to the user, and the user is guided to the new route while on the move.

[1440] ---

[1441] In this way, by providing optimal route guidance with real-time updates to users with specific needs, it is possible to smooth travel in urban areas and improve user convenience.

[1442] Example 1

[1443] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1444] In modern urban environments, the use of barrier-free facilities such as elevators and ramps is extremely important for users with mobility difficulties (e.g., parents using strollers and wheelchair users). However, it is difficult for users to individually grasp the location of these facilities and available routes, and it is also difficult to respond to real-time changes (e.g., elevator malfunctions or construction). This has created a demand for a system that provides route guidance appropriate for users.

[1445] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1446] In this invention, the server includes means for registering usage status information of a specific user, means for acquiring predetermined map data and facility structure data, means for calculating an optimal route based on the usage status information of the user, means for updating the optimal route in real time, and means for providing the user with the optimal route updated in real time. This allows users to grasp the optimal route tailored to their needs in real time, enabling smooth travel in urban areas.

[1447] "Usage information" refers to information about the specific conditions and needs that users face when traveling, including the use of strollers, wheelchairs, carry-ons, etc.

[1448] "Map data" refers to electronic geographic information including location information for roads, buildings, facilities, etc. in a geographic area.

[1449] "Facility structure data" refers to information about the structure and equipment inside the facility, including information about the location and access methods of elevators, ramps, stairs, etc.

[1450] "Means for calculating the optimal route" refers to algorithms and programs that calculate the most efficient and comfortable travel route for users based on usage information, map data, and facility structure data.

[1451] "Means of updating in real time" refers to systems or programs that constantly monitor the latest traffic information and facility status, and have the ability to dynamically revise route guidance information.

[1452] "Means for providing routes to users" refers to devices or applications that visually or audibly communicate calculated optimal routes and real-time updated route information to users.

[1453] "Real-time updated optimal route" refers to a route that is dynamically recalculated taking into account the latest traffic conditions and equipment operation status, and is always optimized to suit the current situation.

[1454] This invention is a system that provides optimal route guidance to specific users. This system registers the user's usage information, calculates the optimal route based on that information, and updates and provides the information in real time.

[1455] User Registration

[1456] First, the user uses a smartphone or computer terminal to register their own usage information (e.g., stroller, wheelchair, carry-on suitcase, etc.). The terminal then sends this information to a server, which then stores the received usage information in a database. This makes it possible to provide personalized route information that reflects the user's needs.

[1457] Obtaining map information

[1458] The server uses a map provider API (e.g., Google Maps API) to collect the latest map data. It also obtains facility structure data such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. This provides the basic information for calculating the optimal route.

[1459] Route calculation

[1460] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered usage information, to the server. The server receives this information and uses map data and facility structure data to calculate the optimal route. Specifically, it generates a route that prioritizes elevators and ramps and avoids stairs and escalators.

[1461] Real-time updates

[1462] The server constantly monitors the latest information from public transportation agencies and city management organizations (e.g., traffic information, construction status, and facility operation status). This allows route information to be updated in real time. For example, if an elevator is out of order, a new route can be recalculated based on that information and provided to users.

[1463] Providing results

[1464] The calculated optimal route is sent from the server to the device. The device visually displays this route information to the user, allowing the user to follow detailed instructions to reach their destination. For example, specific instructions such as "Exit the east exit and walk 50 meters to the right to find the elevator" are displayed.

[1465] Specific examples

[1466] Example Scenario

[1467] A case will be described in which a user using a stroller travels from Shinjuku Station to Shibuya Hikarie.

[1468] 1. User Registration

[1469] Users register "stroller use" using a smartphone app, and the device sends this information to the server.

[1470] The server stores the user's needs information in a database.

[1471] 2. Route calculation that reflects usage status

[1472] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[1473] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route.For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to get to the platform, and then board the bus at a specific bus stop."

[1474] 3. Real-time updates

[1475] The server constantly receives the latest information from public transport operators and city management authorities, and if the route information is affected, it recalculates and updates the new route.

[1476] 4. Providing results

[1477] The calculated optimal route is sent to the terminal, which then provides visual route guidance to the user.

[1478] Prompt Sentence Examples

[1479] Calculate the optimal route for a stroller user traveling from Shinjuku Station to Shibuya Hikarie, prioritizing elevators and ramps and taking real-time traffic information into account.

[1480] Through the above process, the system of the present invention can provide optimal route guidance to users with specific needs, significantly facilitating smooth travel in urban areas. Real-time information updates also enable route guidance that reflects the latest conditions.

[1481] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1482] Step 1: User Registration

[1483] input

[1484] Users enter their own usage information into their smartphones or computer terminals.

[1485] concrete action

[1486] The user enters "stroller use" or "wheelchair use" in the app's "Usage status" form and presses the registration button.

[1487] Data processing and calculation

[1488] The terminal creates and sends a "POST" request to send the entered information to the server.

[1489] output

[1490] The usage status information sent by the terminal arrives at the server, which stores the information in a database and saves it as user usage status information.

[1491] Step 2: Obtaining map information and facility structure data

[1492] input

[1493] The server calls the map provider API (general name: map API) to send a request to obtain the latest map data. It also collects facility structure information from databases of public facilities and transportation facilities.

[1494] concrete action

[1495] The server accesses the map API using a "GET" request to receive the latest map data, and issues a "SELECT" query to the public facility database to retrieve facility data such as elevators and ramps.

[1496] Data processing and calculation

[1497] The JSON format map data received from the map API is combined with facility structure information obtained from the database and converted into a referenceable format.

[1498] output

[1499] The integrated map data and facility structure information are stored on the server and are available for use when calculating routes.

[1500] Step 3: Route calculation

[1501] input

[1502] The user inputs the starting point and destination into the terminal.

[1503] concrete action

[1504] The user inputs the starting point "Shinjuku Station" and the destination "Shibuya Hikarie" and presses the send button. The device then sends this information to the server.

[1505] Data processing and calculation

[1506] The server receives the starting point and destination information, and then uses map data, facility structure information, and usage information to run an algorithm to calculate the optimal route, which includes logic to prioritize elevators and ramps.

[1507] output

[1508] The server generates optimal route information as a result of route calculation, including which route the user should take at a specific location.

[1509] Step 4: Real-time updates

[1510] input

[1511] The server obtains the latest information on public transportation operations, construction status, and equipment operation status.

[1512] concrete action

[1513] The server periodically sends a "GET" request to the public transportation company's SAPI to receive the latest traffic information, construction status, and facility status.

[1514] Data processing and calculation

[1515] Based on the latest information received, the server evaluates whether the pre-calculated optimal route will be affected and recalculates the route if necessary.

[1516] output

[1517] The server generates updated optimal route information in real time.

[1518] Step 5: Delivering results

[1519] input

[1520] The server sends the calculated optimal route information to the terminal.

[1521] concrete action

[1522] The server sends route information in JSON format to the terminal, which receives and analyzes it.

[1523] Data processing and calculation

[1524] To visually display the received route information, the terminal draws the route on a map and provides guidance in a format that is easy for the user to understand.

[1525] output

[1526] Users can visually check detailed route guidance on their device, such as "Take the elevator from the east exit of Shinjuku Station, then use the slope to reach the platform."

[1527] (Application example 1)

[1528] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1529] Conventional route guidance systems have the problem of being unable to provide optimal routes tailored to specific user needs and circumstances. In particular, in situations such as food delivery, delivery personnel are required to calculate optimal routes based on their own means of transportation. Furthermore, delivery efficiency can be reduced due to insufficient route updates to reflect real-time changes in traffic and road construction information. The present invention aims to solve these problems.

[1530] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1531] In this invention, the server includes a means for registering status information of a specific user, a means for acquiring predetermined map data and traffic regulation data, a means for calculating an optimal route based on the status information of the user, a means for providing the optimal route to the user, and a means for updating the route information in real time. This allows delivery personnel to efficiently obtain an optimal route according to their own means of transportation and to adapt to the latest traffic information and road construction information in real time.

[1532] "Specific users" refers to individuals with specific needs or circumstances, such as delivery people.

[1533] "Status information" includes information about the means of transportation used by the user and the conditions of use.

[1534] "Map data" refers to digital map information including location information for roads, facilities, traffic regulations, etc.

[1535] "Traffic regulation data" refers to traffic regulation information such as one-way streets, no entry restrictions, and speed limits.

[1536] "Means for calculating a route" refers to a function that calculates the optimal travel route based on the input starting point and destination, as well as the user's situation information.

[1537] "Means of updating in real time" refers to the function of constantly updating route information in response to the latest environmental changes, such as traffic information and road construction information.

[1538] "Map Provider API" refers to an application program interface for obtaining map data from an external service.

[1539] "Server" refers to a computer system that receives requests from users, performs the necessary data processing, and returns the results.

[1540] "Public transportation database" refers to a database that includes operation information and facility information for public transportation such as buses and trains.

[1541] "Calculating a route with priority given to elevators and ramps" means calculating a route that avoids stairs and escalators and uses elevators and ramps as the primary means of transportation.

[1542] "Construction information and facility equipment status" refers to the latest information on facilities, such as the progress of transportation construction work and elevator malfunction status.

[1543] These are the definitions of important terms included in the scope of patent claims. Please check them.

[1544] The present invention is an invention of a system that provides optimal route guidance to specific users. It is designed especially for the food delivery field, enabling delivery personnel to perform their delivery work efficiently.

[1545] User Registration

[1546] First, the delivery person uses a smartphone app to register their own status information (e.g., bicycle, motorcycle, car, etc.). The device sends this information to the server, which then stores the received user status information in a database.

[1547] Obtaining map data

[1548] Next, the server uses the map provider API to collect the latest map data and retrieves traffic regulation information such as one-way streets and no-entry restrictions from the traffic regulation database. Based on this information, the server is ready to calculate a route tailored to the user's situation.

[1549] Route calculation

[1550] When a delivery person enters their starting point (restaurant) and destination (customer address) into the smartphone app, the device sends this information, along with pre-registered user status information, to a server. The server receives this information and uses map data and traffic regulation data to calculate the optimal route. For example, for delivery people who use bicycles, it generates a bicycle-only route that takes into account vehicle closures and one-way street restrictions.

[1551] Real-time updates

[1552] The server constantly monitors traffic and road construction information, allowing it to update route information in real time. For example, if a traffic accident occurs or a route change is required due to road construction, the server will recalculate a new route based on that information.

[1553] Providing results

[1554] The calculated optimal route is sent from the server to the terminal. The terminal visually displays this route information to the delivery person. The delivery person can travel to their destination efficiently by following detailed instructions (e.g., "Go straight down XX Street and turn right at △△ intersection").

[1555] Specific examples

[1556] This section explains the case where a delivery person delivers food using a bicycle.

[1557] 1. User Registration

[1558] The delivery person registers "using a bicycle" on a smartphone app, and the device sends this information to the server.

[1559] The server stores the user's status information in a database.

[1560] 2. Route calculation

[1561] The delivery person enters the starting point (Restaurant A) and destination (Customer B's address).

[1562] The device sends this information to a server, which then uses map data and traffic regulation data to calculate the optimal route. For example, it automatically generates a detailed route such as "use bicycle lanes and turn right at specific intersections."

[1563] 3. Real-time updates

[1564] The server constantly receives traffic and road construction information, and if the route information is affected, it recalculates and updates a new route.

[1565] 4. Providing results

[1566] The calculated optimal route is sent to the terminal, which provides visual route guidance to the delivery person.

[1567] This allows delivery personnel to efficiently obtain the optimal route based on their means of transportation, and to carry out delivery tasks while adapting to the latest traffic and road construction information in real time.

[1568] Example prompts to be input to the generative AI model

[1569] "A user needs to place an order from Restaurant A from home by bicycle and then deliver it directly to Customer B's address. How can I use Google Maps API to calculate the optimal route in bicycle mode and update the route information in real time through the server?"

[1570] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1571] Step 1:

[1572] User Registration

[1573] Input: The delivery person enters their situation information (e.g. bicycle, motorcycle, car, etc.) into the smartphone app.

[1574] Operation: The device sends the entered information to the server.

[1575] Data processing: None.

[1576] Output: The delivery person's status information is registered in the server-side database.

[1577] Step 2:

[1578] Obtaining map data

[1579] Input: The server periodically requests updates to map data and traffic control data.

[1580] How it works: The server uses the map provider API to get the latest map data and retrieves information from the traffic regulation database.

[1581] Data processing: Extract the necessary map information and traffic regulation information from the API response and store it in the server database.

[1582] Output: The latest map data and traffic regulation data are saved in the server database.

[1583] Step 3:

[1584] Route calculation

[1585] Input: The delivery person enters the starting point (restaurant) and destination (customer address) into the smartphone app.

[1586] Operation: The device sends this information and previously registered user status information to the server.

[1587] Data processing: The server uses map data and traffic regulation data to calculate the optimal route, creating routes tailored to specific modes of transportation (e.g., bicycle routes, car routes).

[1588] Output: The calculated optimal route is sent from the server to the device.

[1589] Step 4:

[1590] Real-time updates

[1591] Input: The server retrieves the latest traffic and road construction information.

[1592] Behavior: The server monitors this information and updates the routing information as needed.

[1593] Data processing: Recalculate a new optimal route based on updated traffic and road construction information.

[1594] Output: Updated route information is sent to the delivery driver's device (if necessary).

[1595] Step 5:

[1596] Providing results

[1597] Input: Route calculation result.

[1598] Operation: The terminal visually displays the calculated optimal route information to the delivery person.

[1599] Data processing: None.

[1600] Output: Detailed route instructions (e.g., "Go straight down XX Street and turn right at △△ intersection") are displayed to the delivery person.

[1601] The above is a detailed description of the processing steps of the system program that realizes the application example.

[1602] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1603] ---

[1604] The present invention is a system that provides optimal route guidance for a specific user and further acquires and customizes route guidance based on the user's emotional information. This system registers the user's needs information and emotional information, and calculates and provides the optimal route based on that information.

[1605] User Registration

[1606] First, the user uses a smartphone or computer terminal to register their usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information. The terminal then sends this information to the server, which then stores the received user needs and emotional information in a database.

[1607] Obtaining map information and facility structure information

[1608] The server collects the latest map data using the map provider API. It also obtains facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. Based on this information, it prepares to calculate a route that matches the user's needs and emotional information.

[1609] Route calculation

[1610] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered user needs and emotional information, to the server. The server receives this information and uses map information and facility structure information to calculate the optimal route. The server prioritizes elevators and ramps and selects routes that avoid stairs and escalators. It also provides routes that reduce stress (e.g., routes that avoid crowds) based on emotional information.

[1611] Collecting and using emotional information

[1612] The emotion engine uses facial recognition or voice analysis to obtain emotional information from the user. This emotional information is updated in real time and sent to the server, which then customizes route guidance based on this information to provide the user with the optimal travel experience.

[1613] Real-time updates

[1614] The server constantly monitors the latest information on public transport, construction status, and facility operation status, allowing route information to be updated in real time. For example, if an elevator is out of order or crowded, a new route will be recalculated based on that information.

[1615] Providing results

[1616] The calculated optimal route is sent from the server to the device, which then visually displays this route information to the user. The user can follow detailed instructions (e.g., "Exit the east exit and walk 50 meters to the right to find the elevator") to reduce stress while traveling.

[1617] Specific examples

[1618] Example Scenario

[1619] A method for reducing a user's stress level while traveling from Shinjuku Station to Shibuya Hikarie using a stroller will be described.

[1620] 1. User Registration

[1621] The user registers "stroller use" and permission to obtain emotional information using a smartphone app, and the device then sends this information to the server.

[1622] The server stores the user's needs information and emotion information in a database.

[1623] 2. Route calculation that reflects usage status

[1624] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[1625] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route. For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to head to the platform, and then board the bus at a specific bus stop." It also uses facial recognition and voice analysis to check the user's stress level and provide a route that avoids crowds.

[1626] 3. Real-time updates of emotional information

[1627] The emotion engine collects emotional information in real time through facial recognition and voice analysis of the user and transmits it to the server.

[1628] The server recalculates route guidance based on the emotional information received in real time, and changes the optimal route if stress is felt.

[1629] 4. Providing results

[1630] The calculated optimal route is sent to the terminal, which then visually displays route guidance to the user, allowing the user to enjoy a stress-free journey.

[1631] In this way, the system of the present invention can provide optimal route guidance based on emotional information for users with specific needs, realizing a comfortable and stress-free travel experience.In addition, real-time information updates allow it to flexibly respond to the latest situations.

[1632] The processing flow will be explained below.

[1633] ---

[1634] Step 1: Registering user needs and emotions

[1635] User: Launches the smartphone app and registers their usage status (e.g., stroller, wheelchair, carry case, etc.) and permission to obtain emotional information.

[1636] Device: Sends the registered usage status and permission to obtain emotion information to the server.

[1637] Server: Stores the received usage status and permission to obtain emotion information in a database.

[1638] Step 2: Obtaining map information and facility structure information

[1639] Server: Collects the latest map data using the map provider API.

[1640] Server: Obtains facility structural information such as elevators, ramps, and stairs from databases of public facilities and transportation facilities.

[1641] Step 3: Enter your departure and destination information

[1642] User: Enter the starting point and destination into the smartphone device.

[1643] Terminal: Sends the input starting point and destination, as well as pre-registered usage status and permission to obtain emotion information, to the server.

[1644] Step 4: Calculate the optimal route

[1645] Server: Based on the received information, the server uses map information and facility structure information to calculate the optimal route. In particular, it prioritizes elevators and ramps, and derives a route that avoids stairs and escalators.

[1646] Step 5: Collecting emotional information

[1647] Device: Uses a camera and microphone to recognize the user's face or perform voice analysis to obtain emotional information.

[1648] Terminal: Sends the acquired emotion information to the server.

[1649] Step 6: Customizing route guidance based on emotional information

[1650] Server: Determines the user's stress level and mood based on the received emotional information. Based on this information, route guidance is customized. For example, it suggests routes that avoid crowds or more convenient ways of traveling.

[1651] Step 7: Real-time information collection and route updates

[1652] Server: Continuously collects real-time information from public transport and city management agencies (e.g., elevator malfunctions, road construction, etc.).

[1653] Server: Based on real-time information, it recalculates the optimal route as needed and generates new route guidance that includes emotional information.

[1654] Step 8: Providing optimal routes

[1655] Server: Sends the calculated optimal route to the terminal.

[1656] Terminal: Visual route guidance is displayed to the user, such as "Exit the east exit and walk 50 meters to the right to find the elevator."

[1657] Step 9: Real-time updates of emotions and route guidance

[1658] Emotion engine: Collects emotional information in real time while the user is on the move using facial recognition and voice analysis.

[1659] Device: Sends updated emotion information to the server.

[1660] Server: Recalculates the route based on new emotional information and traffic conditions received in real time, and sends the latest route information to the device.

[1661] Terminal: Visually displays updated route information to the user and guides them to new routes.

[1662] ---

[1663] In this way, by providing real-time optimal route guidance to users with specific needs and emotional information, users can enjoy a comfortable and stress-free journey.

[1664] Example 2

[1665] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1666] Conventional route guidance systems can provide route guidance that reflects a user's specific needs, but they cannot provide routes that take into account the user's emotional state. As a result, users often feel stressed while traveling, which is particularly burdensome for users with disabilities and those traveling with children. Furthermore, they do not support real-time updates of the latest public transportation status or construction information, and sometimes cannot provide the latest route information.

[1667] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for registering need information and emotion information of a specific user, a means for acquiring predetermined map information and facility structure information, a means for calculating an optimal route based on the user's need information and emotion information, a means for collecting emotion information in real time using facial recognition or voice analysis, a means for providing the optimal route to the user, and a means for monitoring the latest information on public transportation, construction status, and facility operation status, and updating the route information in real time. This enables optimal route guidance that takes into account the user's needs and emotion state, thereby providing a comfortable and stress-free travel experience. Furthermore, real-time information updates enable route guidance that corresponds to the latest conditions.

[1668] "Specific user needs information" is information that includes special requirements or conditions that a user needs when traveling, such as information about the use of strollers or wheelchairs, the number and size of luggage, etc.

[1669] "Emotional information" is data that indicates the user's emotional state, including stress levels and mood states obtained through facial recognition and voice analysis.

[1670] "Map information" is data that indicates geographical locations, roads, facility locations, etc., and is obtained from a map provider API.

[1671] "Facility structure information" is information about the internal structure of public facilities and transportation facilities, and is data that indicates the location and status of elevators, ramps, stairs, etc.

[1672] An "optimal route" is a route that takes into account the user's needs and emotions and allows them to travel to their destination in the most efficient and comfortable way.

[1673] "Facial recognition" is a technology that takes a picture of a user's face with a camera and analyzes their facial features to determine their emotional state based on their facial expressions.

[1674] "Voice analysis" is a technology that records a user's voice and analyzes the voice data to determine their emotional state based on the tone and pitch of their voice.

[1675] "Latest information on public transportation" refers to transportation-related information provided in real time, such as the operation status of trains and buses, delay information, and notices of non-operating days.

[1676] "Construction status" refers to current status information about construction work, such as road construction and facility repairs, that affects traffic flow and facility use.

[1677] "Facility operating status" is information that indicates whether mechanical equipment such as elevators and escalators are operating normally.

[1678] The present invention is a system that provides optimal route guidance to a specific user, and further acquires the user's emotional information and customizes the route guidance based on that information. This system registers the user's needs information and emotional information, and calculates and provides the optimal route based on that information.

[1679] System configuration and hardware and software used

[1680] User Registration

[1681] Users use their smartphones or computer terminals to register their usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information (using facial recognition or voice analysis). The terminals send this information to a server, which then stores the received information in a database. The specific hardware and software used are shown below.

[1682] Hardware:

[1683] Smartphone

[1684] computer terminal

[1685] server

[1686] software:

[1687] Mobile or web applications (for entering user information)

[1688] Database System

[1689] Facial Recognition and Voice Analysis Software

[1690] Obtaining map information and facility structure information

[1691] The server obtains the latest map data using a map provider API (e.g., Google Maps API), and also collects facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation facilities.

[1692] Route calculation

[1693] The device sends the user's input starting point and destination, as well as the user's registered needs and emotional information, to the server. The server calculates the optimal route, prioritizing elevators and ramps, based on map information and facility structure information. It also takes emotional information into account and provides routes that reduce stress (e.g., routes that avoid crowds).

[1694] Collecting and using emotional information

[1695] The emotion engine uses facial recognition or voice analysis to obtain real-time emotional information from the user and transmits it to the server, which then customizes route guidance based on that information to provide the user with an optimal travel experience.

[1696] Real-time updates

[1697] The server constantly monitors the latest information on public transport, construction status, and facility operation status to update route information in real time. For example, if information on elevator malfunctions or congestion is obtained in real time, the server recalculates the optimal route based on that information and sends the results to the terminal.

[1698] Providing results

[1699] The terminal visually presents the optimal route sent from the server to the user, who can then follow the visual instructions to travel, enjoying a stress-free travel experience.

[1700] Specific examples

[1701] Example Scenario

[1702] A method for reducing the stress level of a user using a stroller while traveling from Shinjuku Station to Shibuya Hikarie will be specifically described.

[1703] 1. User Registration

[1704] The user registers "stroller use" and "permission to obtain emotional information" in the app on their smartphone, and the information is sent to the server.

[1705] The server stores the received user needs information and emotion information in a database.

[1706] Example prompt: "I'm using a stroller. Please tell me the best route from Shinjuku Station to Shibuya Hikarie. Also, please monitor my emotional information as I want to reduce stress during the trip."

[1707] 2. Route calculation that reflects usage status

[1708] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination.

[1709] The device sends this information to a server, which then uses map information and facility structure information to calculate the optimal route. For example, it can automatically generate a detailed route such as "take the elevator from the east exit of Shinjuku Station, then use the slope to get to the platform, and then board the bus at a specific bus stop." It also provides routes that avoid crowds based on emotion information.

[1710] Example prompt: "Please tell me which bus stop I should take after taking the elevator from the east exit of Shinjuku Station to the platform."

[1711] 3. Real-time updates of emotional information

[1712] The emotion engine collects emotional information in real time through facial recognition and voice analysis of the user and sends it to the server.

[1713] The server recalculates route guidance based on the emotional information received in real time, and changes the optimal route if stress is felt.

[1714] Example prompt: "Based on my current stress level, please guide me to the most relaxing route."

[1715] 4. Providing results

[1716] The calculated optimal route is sent to the terminal, which then visually displays route guidance to the user, allowing the user to enjoy a stress-free journey.

[1717] Example prompt: "What's the next step on my current route?"

[1718] In this way, the system provides optimal route guidance based on emotional information for users with specific needs, realizing a comfortable and stress-free travel experience.In addition, real-time information updates enable the system to flexibly respond to the latest conditions.

[1719] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1720] Step 1: User Registration

[1721] Input: The user uses a smartphone or computer terminal to set the usage status of the stroller, wheelchair, etc. and whether facial recognition or voice analysis will be used.

[1722] Specific behavior:

[1723] The user selects "Stroller use" and "Allow emotional information acquisition" from the smartphone application screen.

[1724] The terminal sends this information to the server as a "POST" request.

[1725] Output: The server stores the received information in a database and returns a registration confirmation message to the terminal.

[1726] Step 2: Obtaining map information and facility structure information

[1727] Input: The server obtains map information using the map provider API and collects facility structure information from public facility and transportation databases.

[1728] Specific behavior:

[1729] The server sends a "GET" request to the map provider API to retrieve the latest map data.

[1730] The server obtains facility structural information such as elevators, ramps, and stairs from the public facility's API and integrates it with map data.

[1731] Output: The latest map information and facility structure information are stored on the server, ready for route calculation.

[1732] Step 3: Route calculation

[1733] Input: The user inputs the starting point and destination through the terminal, which then sends this to the server. The terminal also inputs previously registered needs and emotion information.

[1734] Specific behavior:

[1735] A user inputs a route request from "Shinjuku Station" to "Shibuya Hikarie" into a smartphone app.

[1736] The terminal sends the request to the server as a "POST" request.

[1737] The server calculates the optimal route based on map information, facility structure information, and user needs and emotions, taking into account stress levels and selecting routes that avoid congestion as necessary.

[1738] Output: The server converts the calculated optimal route into a data format and sends it to the terminal.

[1739] Step 4: Collecting and using emotional information

[1740] Input: The emotion engine obtains emotion information in real time using facial recognition or voice analysis of the user and sends it to the server.

[1741] Specific behavior:

[1742] The emotion engine uses the smartphone's camera or microphone to analyze the user's facial expressions and voice.

[1743] The acquired emotional information is sent to the server in real time.

[1744] Output: The server receives the emotion information, customizes route guidance in real time, and recalculates the optimal route if an update is needed.

[1745] Step 5: Real-time updates

[1746] Input: The server monitors public transport updates, construction status, and equipment operation status.

[1747] Specific behavior:

[1748] The server sends a "GET" request to the public transportation API to obtain information on operation status and delays.

[1749] The latest information is obtained from an API that monitors construction information and equipment operation status.

[1750] If necessary, the optimum route is recalculated based on this information.

[1751] Output: The server generates the latest route information and sends it to the terminal. If the route information is updated, the user is notified.

[1752] Step 6: Delivering results

[1753] Input: Optimal route information sent from the server.

[1754] Specific behavior:

[1755] The terminal analyzes the route information received from the server and visually displays it to the user.

[1756] Users can check detailed route guidance through the application and follow the instructions.

[1757] Output: The user will be presented with visual route guidance, enabling a less stressful travel experience.

[1758] (Application example 2)

[1759] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1760] Conventional systems that provide optimal route guidance for specific users based on their needs information have the problem of being unable to reduce stress during travel because they do not take into account the user's emotional state. Additionally, it has been difficult to provide users with a comfortable travel experience by appropriately responding to the changing conditions of public transportation and facilities in real time.

[1761] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering need information of a specific user, means for acquiring predetermined map information and facility structure information, means for calculating an optimal route based on the need information and emotional information of the user, means for providing the optimal route to the user, means for updating the route information in real time, and means for acquiring emotional information of the user and recalculating the optimal route based on that information. This enables route guidance that is tailored to the emotional state of the user, reducing stress during travel and providing a more comfortable and flexible travel experience.

[1762] "Specific users" refer to individual users who require optimal route guidance based on needs information and emotional information.

[1763] "Needs information" is information that indicates the requirements and conditions that a user needs while traveling (e.g., wheelchair, stroller, carry case, etc.).

[1764] "Emotion information" is data that represents the user's emotional state (e.g., stress, joy, anger, etc.) obtained via the emotion engine.

[1765] "Map information" is data that indicates geographic locations and traffic conditions, and is typically obtained from a map provider.

[1766] "Facility structure information" is data related to the physical structure of buildings and public facilities, such as elevators, ramps, and stairs.

[1767] "Means for calculating a route" refers to an algorithm or program that calculates the optimal travel route based on the user's needs information and emotional information.

[1768] "Route providing means" refers to a device or application that notifies the user of the calculated optimal route visually or audibly.

[1769] "Real-time update means" refers to technology that constantly monitors information and instantly recalculates and corrects route information in response to new conditions.

[1770] "Means for acquiring emotional information" refers to a system that uses sensors such as cameras and microphones to collect the user's emotional state through their facial expressions and voice.

[1771] "Means for recalculating the route" refers to an algorithm or program that sets a new route that is optimal for the user based on the acquired emotional information.

[1772] The present invention is a system that provides optimal route guidance to a specific user and further acquires the user's emotional information and customizes the route guidance based on that information. This system registers the user's needs information and emotional information, and calculates and provides the optimal route based on that information. Specific embodiments for implementing this system are described below.

[1773] 1. User Registration

[1774] Users use their smartphones or computer terminals to register their usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information. The terminals send this information to a server, which then stores the received user needs and emotional information in a database.

[1775] 2. Obtaining map information and facility structure information

[1776] The server collects the latest map data using a map provider API (e.g., Google Maps API), and also obtains facility structure information such as elevators, ramps, and stairs from databases of public facilities and transportation agencies. This prepares the server to calculate routes tailored to the user's needs and emotional information.

[1777] 3. Route calculation

[1778] When a user inputs their starting point and destination into the device, the device sends this information, along with pre-registered user needs and emotional information, to the server. The server receives this information and uses map information and facility structure information to calculate the optimal route. For example, it may prioritize elevators and ramps and select a route that avoids stairs and escalators. It also provides routes that reduce stress (e.g., routes that avoid crowds) based on emotional information.

[1779] 4. Collection and Use of Emotional Information

[1780] An emotion engine (e.g., software that performs facial expression recognition and voice analysis) is used to obtain the user's emotional information. This emotional information is updated in real time and sent to the server. The server uses this information to further customize route guidance and provide the user with the optimal travel experience.

[1781] 5. Real-time updates

[1782] The server constantly monitors the latest information on public transportation, construction status, and facility operation status. This makes it possible to update route information in real time. For example, if an elevator is out of order or crowded, a new route will be recalculated based on that information.

[1783] 6. Providing Results

[1784] The calculated optimal route is sent from the server to the device, which then visually displays this route information to the user. The user can follow detailed instructions (e.g., "Exit the east exit and walk 50 meters to the right to find the elevator") and enjoy a stress-free journey.

[1785] Specific examples

[1786] Example Scenario

[1787] Consider a user with a stroller traveling from Shinjuku Station to Shibuya Hikarie. The steps are as follows:

[1788] 1. User Registration:

[1789] The user registers permission to use the stroller and obtain emotional information using the smartphone app, and the device sends this information to the server, which then stores the user's needs and emotional information in a database.

[1790] 2. Route planning based on usage:

[1791] The user inputs "Shinjuku Station" as the starting point and "Shibuya Hikarie" as the destination. The device sends this information to the server, which then uses map information and facility structure information to calculate the optimal route. For example, the system automatically generates a detailed route, such as taking the elevator from the east exit of Shinjuku Station, then using the slope to reach the platform, and then boarding a bus from a specific bus stop. The system also uses facial recognition and voice analysis to check the user's stress level and provides routes that avoid crowds.

[1792] 3. Real-time update of emotional information:

[1793] The emotion engine collects emotional information in real time through facial recognition and voice analysis, and sends it to a server. The server then recalculates route guidance based on the emotional information received in real time, and changes the optimal route if stress is felt.

[1794] 4. Providing results:

[1795] The calculated optimal route is sent to the terminal, which then visually displays route guidance to the user, allowing the user to enjoy a stress-free journey.

[1796] Prompt Sentence Examples

[1797] "Calculate which route will cause the least amount of stress for the user."

[1798] "Show the user the most comfortable route from Shinjuku to Shibuya"

[1799] In this way, the system of the present invention can provide optimal route guidance based on emotional information for users with specific needs, realizing a comfortable and stress-free travel experience.In addition, real-time information updates allow it to flexibly respond to the latest situations.

[1800] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1801] Step 1:

[1802] User Registration

[1803] Users use devices such as smartphones to input their own usage status (e.g., stroller, wheelchair, carry case, etc.) and emotional information. The device sends this information to the server. The server processes the received user needs and emotional information and stores it in a database, and saves the user information as its output.

[1804] Step 2:

[1805] Obtaining map information and facility structure information

[1806] The server obtains map and traffic information via a map provider API (e.g., Google Maps API). Based on this input, the server processes the data by retrieving facility structure information such as elevators, ramps, and stairs from a database of designated map data and public facilities and transportation facilities, and stores this information in a database. This output is used for subsequent route calculations.

[1807] Step 3:

[1808] Route calculation

[1809] The user enters the starting point and destination into the device, and this information is sent to the server, which performs the following data calculations:

[1810] 1. Registered needs and emotions

[1811] 2. Acquired map information and facility structure information

[1812] Based on this, an algorithm is run to calculate the optimal route, and the output is route information that prioritizes elevators and ramps and avoids stairs and escalators.

[1813] Step 4:

[1814] Collecting and using emotional information

[1815] The device collects the user's emotional information in real time using the attached camera and microphone. This input data is analyzed through an emotion engine (e.g., facial expression recognition or voice analysis software), and the output is the user's emotional state. The acquired emotional information is sent to a server, which updates it repeatedly.

[1816] Step 5:

[1817] Real-time updates

[1818] The server constantly monitors information on public transportation, construction status, and the equipment status of facilities. If an elevator is out of order or is crowded, route information is recalculated in real time based on this input data (re-executing data calculations). The output is a new optimal route.

[1819] Step 6:

[1820] Providing results

[1821] The optimal route is sent from the server to the device, which then displays it visually and audibly to the user. Specifically, detailed guidance such as "Exit the east exit and walk 50 meters to the right to find the elevator" is provided. The resulting output is route guidance that allows the user to travel without stress.

[1822] Prompt Sentence Examples

[1823] "Calculate which route will cause the least amount of stress for the user."

[1824] "Show the user the most comfortable route from Shinjuku to Shibuya"

[1825] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1826] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1827] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1828] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1829] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1830] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1831] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1832] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1833] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1834] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1835] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1836] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1837] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1838] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1839] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1840] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1841] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1842] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1843] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1844] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1845] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1846] The following is further disclosed regarding the above embodiment.

[1847] (Claim 1)

[1848] A means for registering the needs information of a specific user;

[1849] means for acquiring predetermined map information and facility structure information;

[1850] A means for calculating an optimal route based on the user's needs information;

[1851] means for providing the optimal route to a user;

[1852] means for updating the route information in real time;

[1853] A system including:

[1854] (Claim 2)

[1855] 2. The system according to claim 1, wherein the means for calculating the optimum route calculates the route by giving priority to elevators and ramps.

[1856] (Claim 3)

[1857] 2. The system according to claim 1, wherein the real-time updating means monitors construction information and facility equipment status and recalculates the optimal route.

[1858] "Example 1"

[1859] (Claim 1)

[1860] A means for registering usage status information of a specific user;

[1861] A means for acquiring predetermined map data and facility structure data;

[1862] A means for calculating an optimal route based on the user's usage status information;

[1863] means for updating the optimum route in real time;

[1864] means for providing the user with the optimum route updated in real time;

[1865] A system including:

[1866] (Claim 2)

[1867] 2. The system according to claim 1, wherein the means for calculating the optimum route calculates the route by giving priority to elevators and barrier-free facilities.

[1868] (Claim 3)

[1869] 2. The system of claim 1, wherein the real-time updating means monitors traffic information and construction status and recalculates the optimal route.

[1870] "Application Example 1"

[1871] (Claim 1)

[1872] A means for registering the needs information of a specific user;

[1873] means for acquiring predetermined map information and facility structure information;

[1874] A means for calculating an optimal route based on the user's needs information;

[1875] means for providing the optimal route to a user;

[1876] means for updating the route information in real time;

[1877] A system including:

[1878] (Claim 2)

[1879] 2. The system according to claim 1, wherein the means for calculating the optimum route calculates the route by giving priority to elevators and ramps.

[1880] (Claim 3)

[1881] 2. The system according to claim 1, wherein the real-time updating means monitors construction information and facility equipment status and recalculates the optimal route.

[1882] New inventions extracted from the application examples

[1883] (Claim 1)

[1884] A means for registering status information of a specific user;

[1885] means for acquiring predetermined map data and traffic regulation data;

[1886] A means for calculating an optimal route based on the user's situation information;

[1887] means for providing the optimal route to a user;

[1888] means for updating the route information in real time;

[1889] A system including:

[1890] (Claim 2)

[1891] 2. The system according to claim 1, wherein the means for calculating the optimum route calculates a route according to the user's mode of transportation.

[1892] (Claim 3)

[1893] 2. The system of claim 1, wherein said real-time updating means monitors traffic and road construction information and recalculates the optimal route.

[1894] "Example 2: Combining Emotion Engines"

[1895] (Claim 1)

[1896] A means for registering the needs information and emotion information of a specific user;

[1897] means for acquiring predetermined map information and facility structure information;

[1898] means for calculating an optimal route based on the user's needs information and emotion information;

[1899] a means for collecting emotional information in real time using facial recognition or voice analysis;

[1900] means for providing the optimal route to a user;

[1901] a means for monitoring the latest information on public transportation, construction status, and facility operation status, and updating the route information in real time;

[1902] A system including:

[1903] (Claim 2)

[1904] 2. The system according to claim 1, wherein the means for calculating the optimum route calculates the route by giving priority to elevators and ramps.

[1905] (Claim 3)

[1906] 2. The system according to claim 1, wherein the real-time updating means monitors construction information and equipment status and recalculates the optimal route.

[1907] "Application example 2 when combining emotion engines"

[1908] (Claim 1)

[1909] A means for registering the needs information of a specific user;

[1910] means for acquiring predetermined map information and facility structure information;

[1911] A means for calculating an optimal route based on the user's needs information and emotion information;

[1912] means for providing the optimal route to a user;

[1913] means for updating the route information in real time;

[1914] means for acquiring emotion information of the user and recalculating an optimal route based on the emotion information;

[1915] A system including:

[1916] (Claim 2)

[1917] 2. The system according to claim 1, wherein the means for calculating the optimum route calculates the route by giving priority to elevators and ramps.

[1918] (Claim 3)

[1919] 2. The system of claim 1, wherein the real-time updating means monitors public transport information and facility availability and recalculates the optimal route. [Explanation of symbols]

[1920] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for registering the needs information of a specific user; means for acquiring predetermined map information and facility structure information; A means for calculating an optimal route based on the user's needs information; means for providing the optimal route to a user; means for updating the route information in real time; A system including:

2. 2. The system according to claim 1, wherein the means for calculating the optimum route calculates the route by giving priority to elevators and ramps.

3. 2. The system according to claim 1, wherein said real-time updating means monitors construction information and facility equipment status and recalculates the optimum route.

Citation Information

Patent Citations

  • Persona chatbot control method and system

    JP2022180282A