System

Abstract

A system is provided.SOLUTION: A system comprising: means for acquiring current location information; means for acquiring destination information; means for calculating an optimal route based on the current location information and the destination information; an eyewear device for visual route guidance even in unstable communication environments; means for transmitting route guidance information to the eyewear device; means for visually presenting the route guidance information to a user; means for collecting and updating real-time traffic, congestion, and weather information; and means for re-evaluating the calculated route based on the collected information and re-calculating the route if necessary.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When using public transportation, problems include obtaining location information in places with unstable communication environments and getting lost in complex station premises. Furthermore, traffic volume, congestion, weather, and other factors often prevent people from reaching their destination as planned. These situations are particularly stressful for people visiting from far away, the elderly, and those who are not confident in their mobility. There is a need for a navigation system that can solve these issues and enable everyone to reach their destination smoothly. [Means for solving the problem]

[0005] The present invention provides a navigation system that includes a means for acquiring current location information, a means for acquiring destination information, and a means for calculating an optimal route based on the current location information and the destination information. It also provides an eyeglass device for visually providing route guidance even in locations with unstable communication environments, and a means for transmitting route guidance information to the eyeglass device. The system also includes a means for visually presenting the route guidance information to a user, a means for collecting and updating traffic volume, congestion status, and weather information in real time, and a means for reevaluating the calculated route based on the collected information and recalculating the route as necessary, thereby enabling users to smoothly reach their destination. The system also includes a means for collecting traffic volume data, public transportation congestion status data, and weather data, and uses a smartphone device as a means for transmitting route guidance information, thereby providing appropriate guidance in real time.

[0006] "Current location information" is information that indicates the geographic coordinates where the user's device is located and the surrounding locations.

[0007] "Destination information" is information that indicates a geographical point or location that the user is heading for.

[0008] The "optimal route" is a route that indicates the most efficient and quickest route from the current location to the destination.

[0009] "Areas with unstable communication environments" refers to locations or areas where internet connections or network communications are interrupted or weakened.

[0010] An "eyeglasses device" is a glasses-type wearable device that is worn by a user to display visual information and digital data.

[0011] "Route guidance information" is detailed information for visually or audibly guiding the user on the optimal route.

[0012] "Real-time" refers to a state in which data is updated at approximately the current time with little time delay.

[0013] "Traffic volume" is information indicating the amount of vehicular and pedestrian movement measured within a specific road or area over a certain period of time.

[0014] "Congestion status" is information that indicates the concentration of people and vehicles on public transportation or in a specific area.

[0015] "Weather information" is information that indicates current and future weather conditions.

[0016] "Method of calculating optimal route" refers to the process of using algorithms or software to select and calculate the optimal route from your current location to your destination.

[0017] "Information collection means" refers to methods and devices for obtaining traffic volume data, congestion data, weather data, etc.

[0018] "Means for transmitting guidance information" refers to the device or protocol used to transmit optimal route data and guidance information to the glasses device. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6]FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0021] First, the terms used in the following description will be explained.

[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0027] [First embodiment]

[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0040] In order to implement this invention, a specific system configuration and its operation using the following means will be described. This system includes a means for acquiring current location information, a means for acquiring destination information, a means for calculating an optimal route, an eyeglass device for visually guiding a route even in places with an unstable communication environment, a means for transmitting route guidance information to the eyeglass device, a means for visually presenting a route to a user, a means for collecting and updating traffic volume, congestion status, and weather information in real time, and a means for reevaluating and recalculating. Below, specific examples of each step and program processing are explained in natural language.

[0041] Initial Setup Procedure

[0042] server

[0043] The server periodically collects data on traffic volume, congestion, weather, delays, etc. This data is obtained from various APIs and stored in a database.

[0044] The server prepares to obtain current location and destination information in response to a request from the user's smartphone.

[0045] Terminal

[0046] The device will launch a dedicated app and enable the GPS function to prepare to obtain current location information.

[0047] User

[0048] The user launches a dedicated app on their smartphone and enters their destination.

[0049] Acquiring and sending location information

[0050] Terminal

[0051] When the user enters a destination, the device uses GPS to determine the current location, and this information is sent to the server.

[0052] server

[0053] The server receives the current location and destination information sent from the device and prepares to calculate the optimal route.

[0054] Optimal route calculation and guidance

[0055] server

[0056] The server retrieves the latest traffic, congestion, and weather information from a database, and then uses a specific algorithm to calculate the optimal route.

[0057] For example, if a route from Shinjuku Station to Shibuya Station is calculated and it is determined that the route using the Yamanote Line is optimal, that route is selected.

[0058] server

[0059] After the optimal route is determined, visual guidance data (e.g., arrows and movement instructions) is generated and sent to the device.

[0060] Terminal

[0061] The terminal transmits the received route guidance information to a dedicated eyeglass device.

[0062] User

[0063] The user checks the guidance information visually displayed through the eyeglass device and moves along the presented route.

[0064] Real-time updates and rerouting

[0065] server

[0066] The server continues to collect real-time data on traffic volume, congestion, weather, and other factors and updates the database, thereby maintaining the most up-to-date information.

[0067] If new delays or congestion occur, the route will be reevaluated and recalculated.

[0068] server

[0069] By sending updated route guidance information to the terminal, the latest travel information is provided to the user.

[0070] Terminal

[0071] The terminal receives the updated information from the server and transmits it again to the dedicated glasses device.

[0072] User

[0073] The user continues to travel along the appropriate route based on guidance information updated in real time.

[0074] Specific examples

[0075] 1. Initial Setup and Data Collection

[0076] The user arrives at Shinjuku Station and launches a dedicated app to head to Shibuya Station.

[0077] The device uses GPS to notify the server that the user is at Shinjuku Station.

[0078] The server collects the latest traffic conditions and congestion information between Shinjuku Station and Shibuya Station and stores it in a database.

[0079] 2. Route calculation and guidance

[0080] When a user inputs their destination, the server calculates the optimal route and generates visual guidance data, such as suggesting a route from Shinjuku Station to Shibuya Station using the Yamanote Line.

[0081] The generated guidance information is transmitted to the terminal, which then presents it to the user by displaying it on a dedicated eyeglass device.

[0082] 3. Real-time updates and rerouting

[0083] When a user departs Shinjuku Station, the server analyzes traffic data to check for delays and congestion.

[0084] If the Yamanote Line is delayed, the server calculates an alternative route and suggests a new route, for example using another line. This information is sent to the terminal and displayed again on the glasses device, allowing the user to follow the new route.

[0085] This system allows users to reach their destination efficiently even in areas with unstable communication environments, providing a stress-free travel experience. Real-time updated data always presents the optimal route, supporting smooth travel for users.

[0086] The processing flow will be explained below.

[0087] Step 1:

[0088] User

[0089] The user launches a dedicated app on their smartphone and enters destination information.

[0090] Step 2:

[0091] Terminal

[0092] The device enables the GPS function to obtain the user's current location information.

[0093] Current location information and destination information are sent to the server.

[0094] Step 3:

[0095] server

[0096] The server analyzes the current location information and destination information received from the terminal.

[0097] The server retrieves the latest traffic, congestion, and weather information from a database.

[0098] Based on this information, an algorithm is run to calculate the optimal route.

[0099] Step 4:

[0100] server

[0101] Visual guidance data is generated based on the calculated optimal route.

[0102] The generated guidance data is transmitted to the terminal.

[0103] Step 5:

[0104] Terminal

[0105] The terminal transmits the visual guidance data received from the server to a dedicated glasses device.

[0106] Step 6:

[0107] User

[0108] The user checks the visual guidance information displayed through the glasses device.

[0109] The user follows the guidance information to head to the destination.

[0110] Step 7:

[0111] server

[0112] The server collects real-time traffic, congestion and weather data and updates the database.

[0113] If new delays or congestion occur, the server recalculates the optimal route.

[0114] Step 8:

[0115] server

[0116] Send updated route guidance information to the device.

[0117] Step 9:

[0118] Terminal

[0119] The terminal transmits the updated information received from the server again to the dedicated glasses device.

[0120] Step 10:

[0121] User

[0122] The user continues to travel along the appropriate route, following guidance information updated in real time.

[0123] These specific processing steps enable users to receive optimal navigation in real time even in places with unstable communication environments, and also enable smooth travel by adapting to changes in traffic conditions and weather.

[0124] Example 1

[0125] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0126] In systems that present and visually guide optimal routes based on the current location and destination, there is a need to establish technology that can update information in real time and perform rerouting even in places with unstable communication environments. Another issue is providing guidance that reflects the latest traffic and weather information so that users can travel efficiently from their current location to their destination.

[0127] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0128] In this invention, the server includes means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route based on the current location information and the destination information, a visual device for visually providing route guidance even in places with an unstable communication environment, means for transmitting route guidance information to the visual device, means for visually presenting the route guidance information to the user, means for collecting and updating traffic volume, congestion status, and weather information in real time, means for reevaluating the calculated route based on the collected information and recalculating the route as necessary, means for processing the collected data using a specific algorithm to derive an optimal route, and means for generating guidance information to be displayed on the visual device. This allows the user to always receive optimal route guidance based on the latest traffic and weather information, enabling them to smoothly reach their destination even in places with an unstable communication environment.

[0129] "Current location information" is data indicating the location where the user is located.

[0130] "Destination information" is data indicating the location where the user wants to arrive.

[0131] An "optimal route" is a route calculated to allow the user to travel efficiently from the current location to the destination.

[0132] A "visual device" is a device for providing visual information to a user.

[0133] "Route guidance information" is data such as instructions and maps to help the user navigate the most optimal route.

[0134] "Traffic volume" is data that indicates the number of vehicles or people on a particular road or route.

[0135] "Crowding" is data that shows the density of people and the difficulty of movement on public transportation or in specific locations.

[0136] "Weather information" is data that indicates the current weather and meteorological conditions.

[0137] An "algorithm" is a computational procedure or method used to solve a particular problem.

[0138] "Real-time" means being able to handle the latest information immediately.

[0139] The specific system configuration and operation for implementing this invention will be described below. This system provides the user with the optimal route from their current location to their destination, and supports efficient travel based on traffic and weather information updated in real time.

[0140] Hardware and software used

[0141] Hardware

[0142] Smartphones (portable information terminals)

[0143] GPS Modules

[0144] Visual devices (e.g., smart glasses)

[0145] software

[0146] Dedicated application (for smartphones)

[0147] Server software

[0148] Database (e.g. MySQL (registered trademark))

[0149] API (e.g., Google (registered trademark) Maps API, Weather API)

[0150] Libraries (e.g. OpenCV)

[0151] Program processing

[0152] server

[0153] The server periodically collects data such as traffic volume, congestion, and weather information using an API and stores this data in a MySQL database.

[0154] The server receives the current location and destination information sent from the user's smartphone and retrieves the latest information from the database.

[0155] The server calculates the optimal route using Dijkstra's algorithm or A algorithm, and sends the generated visual guidance data to the smartphone.

[0156] The server collects new delay and congestion data in real time and reevaluates and recalculates routes as needed.

[0157] Terminal

[0158] The user launches a dedicated application, enables GPS, and obtains current location information.

[0159] The device sends the current location and destination information to the server.

[0160] The terminal receives the visual guidance data sent from the server and sends it to the visual device, which then presents the guidance information to the user.

[0161] User

[0162] The user launches a dedicated smartphone application and inputs their destination, such as "from Shinjuku Station to Shibuya Station."

[0163] The user wears a visual device and follows the guidance information to their destination, correcting their direction as needed based on the guidance information updated in real time.

[0164] Specific examples

[0165] 1. Data Collection

[0166] The server uses the Google Maps API to collect traffic data and store it in a database, and also uses the Weather API to collect current weather data.

[0167] Example: The server calls an API every hour to get the latest traffic and weather information and update the database.

[0168] 2. Route calculation and guidance

[0169] When a user enters "from Shinjuku Station to Shibuya Station" into the dedicated application, the device sends current location information and destination information to the server.

[0170] The server calculates the optimal route using Dijkstra's algorithm and A algorithm based on the latest traffic volume, congestion status, and weather information.

[0171] Example: From the database, it is determined that the Yamanote Line route from Shinjuku Station to Shibuya Station is optimal, and visual guidance data for that route is generated and sent to the terminal.

[0172] 3. Real-time updates

[0173] When a user departs Shinjuku Station, the server continuously collects traffic data and detects delays and changes in congestion.

[0174] Example: If there is a delay on the Yamanote Line, the server will calculate an alternative route using the Chuo Line and send the latest guidance information to the terminal.

[0175] Prompt Sentence Examples

[0176] A system description can be generated by inputting the following prompt sentence into the generative AI model:

[0177] Please explain in natural language the processing of the system's program. The system calculates the optimal route from the user's current location to their destination and provides visual guidance through a dedicated visual device. The hardware uses a smartphone and the visual device, and the software uses the Google Maps API and a MySQL database. The specific steps and process are shown below.

[0178] 1. Initial Setup Procedure

[0179] The server collects data from the Google Maps API and Weather API and stores it in a MySQL database.

[0180] It works in conjunction with the user's smartphone to prepare to obtain current location and destination information.

[0181] 2. Acquisition and transmission of location information

[0182] The device uses GPS to determine its current location and sends this information to the server.

[0183] 3. Calculation and guidance of optimal routes

[0184] The server obtains the latest traffic, congestion, and weather information and calculates the optimal route using Dijkstra's algorithm or A algorithm.

[0185] The calculated route guidance information is sent to the terminal and displayed on the visual device.

[0186] 4. Real-time updates and rerouting

[0187] The server collects data in real time and reevaluates and recalculates routes as needed.

[0188] Updates are sent to the terminal and displayed on the visual device.

[0189] This system ensures that users always have the most up-to-date information and the best route available.

[0190] In accordance with the above, this invention provides a multi-layered approach to help users reach their destinations efficiently. Real-time updated data allows users to always be presented with the most up-to-date and optimal route, supporting smooth travel even in areas with unstable communication environments.

[0191] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0192] Program processing steps

[0193] Step 1: Initial Setup

[0194] server

[0195] The server periodically collects traffic, congestion, and weather data using the Google Maps API and Weather API, and stores this data in a MySQL database.

[0196] Input: Traffic volume data, congestion data, and weather data obtained from the API

[0197] Output: Updated database

[0198] For example, you can call an API every hour to get the latest data for a specific region and store it in a database.

[0199] Terminal

[0200] Launch the dedicated application and enable GPS.

[0201] Input: User-initiated application launch

[0202] Output: GPS enabled device

[0203] User

[0204] The user launches a dedicated app on their smartphone and enters their destination.

[0205] Input: Enter your destination using the application

[0206] Output: Destination information is saved on the device

[0207] Step 2: Obtaining and sending location information

[0208] Terminal

[0209] The device uses GPS to obtain its current location information and sends this information to the server.

[0210] Input: Current location information via GPS

[0211] Output: Current location information sent to the server

[0212] For example, location information such as "current latitude: 35.6895, longitude: 139.6917" is obtained and sent to the server.

[0213] server

[0214] The server receives the current location information and destination information sent from the terminal.

[0215] Input: Current location and destination information sent from the device

[0216] Output: All the information necessary for route calculation is available

[0217] For example, you might receive data such as "Current location: 35.6895, 139.6917" and "Destination: 35.658, 139.701."

[0218] Step 3: Calculate the optimal route

[0219] server

[0220] The server retrieves the latest traffic, congestion, and weather information from the database and calculates the optimal route using Dijkstra's algorithm or A algorithm.

[0221] Input: Latest traffic volume data, congestion data, weather data, current location information, destination information

[0222] Output: Optimal route information

[0223] For example, it calculates results such as "The Yamanote Line route from Shinjuku Station to Shibuya Station is optimal."

[0224] Step 4: Generate and send visual guidance data

[0225] server

[0226] The server generates visual guidance data (e.g., arrows, movement instructions) based on the optimal route. Image data can be generated using libraries such as OpenCV.

[0227] Input: Optimal route information

[0228] Output: Visual guidance data

[0229] For example, image data including an arrow indicating the direction of travel and detailed station information is generated.

[0230] server

[0231] Visual guidance data is sent to the terminal.

[0232] Input: Visual guidance data

[0233] Output: Visual guidance data is sent to the terminal.

[0234] For example, the generated visual guide image is transmitted to the terminal.

[0235] Terminal

[0236] The terminal transmits the received visual guidance data to the visual device.

[0237] Input: Visual guidance data received from the server

[0238] Output: Visual guidance data sent to the vision device

[0239] User

[0240] The user wears the visual device and checks the guidance information.

[0241] Input: Guidance information presented through visual devices

[0242] Output: Move based on visual guidance information

[0243] For example, the driver confirms the direction of travel by following the arrow displayed on the visual device.

[0244] Step 5: Real-time updates and rerouting

[0245] server

[0246] The server continuously collects real-time traffic, congestion, and weather data and updates the database, reevaluating and recalculating routes as needed.

[0247] Input: Latest traffic data, congestion data, weather data

[0248] Output: Updated database, recalculated route information if necessary

[0249] For example, recalculations are made such as "There will be delays on the Yamanote Line" or "The new Chuo Line route is optimal."

[0250] server

[0251] The updated route guidance information is sent to the terminal.

[0252] Input: Recalculated route information

[0253] Output: Updated route information sent to the device

[0254] Terminal

[0255] The terminal receives the updated information from the server and transmits it back to the vision device.

[0256] Input: Updated route information received from the server

[0257] Output: Updated path information sent to the vision device

[0258] User

[0259] The user reviews the updated guidance information and follows the appropriate route.

[0260] Input: Updated route information displayed on a visual device

[0261] Output: Move based on updated guidance information

[0262] For example, follow new instructions such as "Avoid delays on the Yamanote Line and use the Chuo Line."

[0263] By following the above steps, the present invention can provide the user with optimal route guidance that reflects the latest traffic and weather information, allowing the user to smoothly reach their destination even in places with unstable communication environments.

[0264] (Application example 1)

[0265] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0266] In recent years, advances in autonomous driving technology have led to an increasing demand for vehicle navigation systems. However, existing systems often lack the ability to update information in locations with unstable communication environments or provide optimal route guidance in real time. Furthermore, there are limited means to intuitively and efficiently provide route guidance information to help users reach their destinations. Therefore, there is a need for a system that can collect and update information on traffic volume, congestion, weather, and other factors in real time, and provide appropriate route guidance to autonomous vehicles.

[0267] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0268] In this invention, the server includes: means for acquiring current location information; means for acquiring destination information; means for calculating an optimal route based on the current location information and the destination information; a display device for visually providing route guidance even in locations with an unstable communication environment; means for transmitting route guidance information to the display device; means for visually presenting the route guidance information to the user; means for collecting and updating traffic volume, congestion, and weather information in real time; means for reevaluating the calculated route based on the collected information and recalculating the route as necessary; means for integrating the real-time route guidance information into the control system of the autonomous vehicle; and means for displaying the received route guidance information on a smart display of the autonomous vehicle. This enables a system that enables users to efficiently reach their destination even in locations with an unstable communication environment.

[0269] The "means for acquiring current location information" refers to a device or method for identifying the user's current location and providing that information to the system.

[0270] The "means for acquiring destination information" refers to a device or method for collecting destination information set by the user and importing that data into the system.

[0271] The "means for calculating the optimum route" is a device or method for calculating the optimum travel route based on current location information and destination information, taking into consideration traffic volume, congestion, and weather information.

[0272] A "display device for visually providing route guidance even in locations where the communication environment is unstable" is a device that provides users with visual route guidance even in situations where communication is unstable.

[0273] The "means for transmitting route guidance information to a display device" is a device or method for transmitting optimal route guidance information to a display device.

[0274] The "means for visually presenting route guidance information to a user" refers to a device or method for visually displaying the transmitted route guidance information to a user.

[0275] "Means for collecting and updating traffic volume, congestion status, and weather information in real time" refers to a device or method for constantly collecting the latest traffic volume, congestion status, and weather information and updating the data within the system.

[0276] "Means for re-evaluating and, if necessary, recalculating the calculated route based on collected information" means a device or method for re-evaluating an existing route based on collected real-time information and re-calculating a new optimal route.

[0277] A "means for integrating real-time route guidance information into an automated vehicle control system" is a device or method that links a calculated optimal route to an automated vehicle control system.

[0278] "Means for displaying received route guidance information on a smart display of an autonomous vehicle" refers to a device or method for displaying optimal route guidance information on a smart display of an autonomous vehicle and visually providing it to the user.

[0279] MODE FOR CARRYING OUT THE INVENTION

[0280] A specific system configuration for implementing the present invention is shown below.

[0281] System Program Overview

[0282] server

[0283] The server processes data using the following hardware and software:

[0284] Hardware: High-performance server

[0285] Software: Database systems (e.g., PostgreSQL), traffic data APIs (e.g., Google Maps API, Here API), generative AI models (e.g., GPT-4 (registered trademark))

[0286] The server performs the following data manipulation and calculations:

[0287] 1. Data Collection and Storage

[0288] The server periodically obtains traffic volume, congestion status, and weather information and stores it in a database. For this purpose, it uses a traffic data API.

[0289] 2. Route calculation

[0290] The server calculates the optimal route based on the current location and destination information sent by the user, using the latest traffic information, and employs a specific algorithm (e.g., Dijkstra, A).

[0291] 3. Real-time updates

[0292] The server reflects the information obtained in real time, reevaluates and recalculates the route, and always provides the latest route according to changes in traffic conditions.

[0293] Terminals (smartphones and display devices)

[0294] The smartphone and display device use the following hardware and software:

[0295] Hardware: Smartphone, display device (e.g. smart display)

[0296] Software: Dedicated app, GPS function

[0297] The terminal performs the following data manipulations and calculations:

[0298] 1. Obtaining location information

[0299] The smartphone uses its GPS function to obtain current location information and transmits it to the server.

[0300] 2. Enter and submit destination information

[0301] The user inputs their destination using a dedicated app, and the input data is sent to the server.

[0302] 3. Visual route guidance

[0303] The smartphone that receives the optimal route information then sends the information to the smart display of the autonomous vehicle, where it is visually presented to the user.

[0304] Autonomous vehicle control system

[0305] Autonomous vehicles use the following hardware and software:

[0306] Hardware: Autonomous vehicle control systems, smart displays

[0307] Software: Operating systems for autonomous vehicles (e.g., Apollo, Autoware)

[0308] The vehicle's control system performs the following data processing and calculations:

[0309] 1. Route Integration

[0310] Real-time route guidance information sent from the server is integrated into the control system of the autonomous vehicle.

[0311] 2. Display route guidance

[0312] The received route guidance information is displayed on a smart display and provided to the user.

[0313] Specific examples

[0314] As a specific example, a scenario will be described in which a user uses an autonomous vehicle to travel from their home to a station.

[0315] 1. The user opens the dedicated app on their smartphone, enables the GPS function, and enters the destination from "home" to "station."

[0316] 2. The vehicle's control server receives the current location and destination data and calculates the optimal route.

[0317] 3. The vehicle is now instructed on the quickest route, avoiding busy roads, and the information is displayed on the smart display.

[0318] 4. Users can visually check the smart display in the vehicle, relax and enjoy the journey.

[0319] This system allows users to reach their destination efficiently even in areas with unstable communication environments. It also provides the most optimal route based on the latest traffic information, making for a more comfortable and stress-free travel experience.

[0320] Example prompt sentence:

[0321] A user opens a smartphone app and wants to set up route guidance from their current location (home) to their destination (train station). The app should use GPS data to determine their current location, calculate the optimal route based on the latest traffic information, and display it on the autonomous vehicle's smart display. Write program code to monitor traffic volume, weather, and congestion conditions in real time, and reevaluate and recalculate as necessary.

[0322] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0323] Step 1:

[0324] Initial Setup and Data Collection

[0325] The server periodically collects data such as traffic volume, congestion status, and weather information, and stores it in a database. For this purpose, a traffic data API (e.g., Google Maps API, Here API) is used. The server receives this data as input and processes it to store it in the database. The input data is traffic volume data, congestion status data, and weather data, and it quickly imports this data and performs data processing and storage operations to store it in the database. As an output, the latest traffic information is accumulated in the database.

[0326] Step 2:

[0327] Acquiring and sending location information

[0328] The device (smartphone) obtains current location information when the user launches a dedicated app and enables the GPS function. The user then enters their destination into the smartphone app and sends that information to the server. The input data is the user's current location and destination, and the current location information obtained from the GPS device and the destination information entered by the user into the app are sent to the server. This inputs the location information data on the server side, and the server is ready to perform processing based on that information.

[0329] Step 3:

[0330] Calculating the best route

[0331] The server calculates the optimal route by retrieving the latest traffic volume, congestion, and weather information from a database based on the current location and destination information sent from the terminal. Here, a specific algorithm (e.g., Dijkstra, A) is used to perform data calculations. The input data is the current location information, destination information, and the latest traffic information, and the output is optimal route information. This route information includes specific travel instructions such as route selection and travel time prediction.

[0332] Step 4:

[0333] Send directions

[0334] The server generates the calculated optimal route guidance information and sends the data to the terminal. The input data is the optimal route information, and the generated visual guidance data (e.g., arrows and movement instructions) is sent. As an output, the route guidance information is sent to the terminal and used for subsequent processing.

[0335] Step 5:

[0336] Visual directions

[0337] The terminal sends the received route guidance information to the smart display of the autonomous vehicle and presents it visually to the user. The input data is the route guidance information sent from the server, and the terminal sends the data to the display and processes it for display. The output is the route guidance displayed on the smart display, and the user follows it to move.

[0338] Step 6:

[0339] Real-time information gathering and updating

[0340] The server continues to collect traffic volume, congestion status, and weather information in real time and updates the database. The input data is new information obtained from the traffic data API, and the database is updated based on this. The output is the latest traffic information stored in the database, which is always kept up to date.

[0341] Step 7:

[0342] Reevaluate and recalculate routes

[0343] The server reevaluates the existing route based on the updated information in real time and recalculates a new optimal route if necessary. Here, the algorithm is used again to calculate the data. The input data is the updated traffic information, and the output is the recalculated new optimal route information. This newly calculated route guidance information is then sent to the terminal again.

[0344] Step 8:

[0345] View updated directions

[0346] The terminal receives the updated route guidance information sent again from the server and displays it on the smart display of the autonomous vehicle. The input data is the updated route guidance information from the server, which is displayed on the display. As an output, the user can continue traveling along the appropriate route based on the updated guidance information.

[0347] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0348] To specifically implement this invention, we will explain the system configuration and operation using the following means and steps. This system includes a combination of means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route, an eyeglass device for visually guiding a route even in places with an unstable communication environment, means for transmitting route guidance information to the eyeglass device, means for visually presenting a route to a user, means for collecting and updating traffic volume, congestion status, and weather information in real time, means for recalculation, and an emotion engine.

[0349] Initial Setup Procedure

[0350] server

[0351] The server periodically obtains traffic data, public transport congestion data, weather data, etc. from various APIs and stores it in a database.

[0352] The server receives a request for current location and destination information from the user's smartphone and prepares to calculate the optimal route.

[0353] Terminal

[0354] When the dedicated app is launched, the device enables the GPS function and prepares to obtain the user's current location information.

[0355] User

[0356] The user launches a dedicated app on their smartphone and enters destination information.

[0357] Acquiring and sending location information

[0358] Terminal

[0359] When the user inputs destination information, the terminal uses GPS to identify the current location and sends it to the server.

[0360] server

[0361] The server analyzes the current location information and destination information received from the device and prepares to calculate the optimal route.

[0362] Optimal route calculation and guidance

[0363] server

[0364] The server retrieves the latest traffic, congestion and weather data from a database and runs an algorithm to calculate the optimal route based on this.

[0365] For example, if it is determined that using the Yamanote Line is the best route to take when traveling from Shinjuku Station to Shibuya Station, this route will be selected.

[0366] server

[0367] After the optimal route is determined, visual guidance data is generated and transmitted to the terminal.

[0368] Emotion recognition and guidance adjustment

[0369] Eyeglasses Device

[0370] The glasses device is equipped with an emotion engine that analyzes the user's facial expressions and recognizes their emotions. This emotion engine analyzes the user's emotions (e.g., tension, anxiety, joy) in real time.

[0371] server

[0372] The system receives user emotion data sent from the emotion engine and adjusts the content and display of route guidance. For example, if the user is nervous, the system displays guidance information more simply and clearly.

[0373] Get directions

[0374] Terminal

[0375] The terminal transmits visual guidance to a dedicated eyeglass device based on the route guidance data and emotion recognition data received from the server.

[0376] User

[0377] The user checks the visual guidance information displayed through the glasses device and travels according to the presented route. The guidance information, which is soothed by the emotion engine, reduces stress during travel.

[0378] Real-time updates and rerouting

[0379] server

[0380] The server collects real-time traffic, congestion, and weather data and updates the database. If new delays or congestion information is discovered, the optimal route is recalculated.

[0381] server

[0382] Send updated route guidance information to the device.

[0383] Terminal

[0384] The terminal transmits the updated information received from the server again to the dedicated glasses device.

[0385] User

[0386] The user continues to move along the appropriate route based on guidance information updated in real time, and the emotion engine continuously adjusts the guidance information according to changes in the user's emotions.

[0387] Specific examples

[0388] 1. Initial Setup and Data Collection

[0389] The user arrives at Shinjuku Station and launches a dedicated app to head to Shibuya Station.

[0390] The device uses GPS to notify the server that it is at Shinjuku Station.

[0391] The server collects the latest traffic conditions and congestion information between Shinjuku Station and Shibuya Station and stores it in a database.

[0392] 2. Route calculation and guidance

[0393] Once the user enters their destination, the server calculates the optimal route and generates visual guidance data, such as the best train transfer information from Shinjuku Station to Shibuya Station.

[0394] The generated guidance information is transmitted to the terminal, which then displays it on the dedicated glasses device.

[0395] 3. Emotion recognition and regulation

[0396] While the user is moving, the emotion engine analyzes the user's facial expressions in real time to detect tension or anxiety.

[0397] The server then simplifies the guidance information accordingly, making it easier to understand, and simultaneously displays multimedia content that has a relaxing effect.

[0398] 4. Real-time updates and rerouting

[0399] When a user boards the Yamanote Line from Shinjuku Station, the server analyzes traffic data in real time to check delays and congestion.

[0400] If the Yamanote Line is delayed, the server calculates an alternative route and suggests a new route, for example using another line. This information is sent to the terminal and displayed again on the glasses device, allowing the user to follow the new route.

[0401] This system allows users to receive optimal navigation in real time, even in areas with unstable communication environments. The emotion engine analyzes the user's emotions and provides appropriately adjusted guidance information, reducing stress during travel. The system also responds to changes in traffic conditions and weather, ensuring smooth travel.

[0402] The processing flow will be explained below.

[0403] Step 1:

[0404] User

[0405] The user launches a dedicated app on their smartphone and enters destination information.

[0406] Step 2:

[0407] Terminal

[0408] The device enables the GPS function to obtain the user's current location information.

[0409] The terminal transmits the acquired current location information and destination information to the server.

[0410] Step 3:

[0411] server

[0412] The server analyzes the current location information and destination information received from the terminal.

[0413] The server retrieves the latest traffic, congestion and weather data from a database.

[0414] Based on this information, an algorithm is run to calculate the optimal route.

[0415] Step 4:

[0416] server

[0417] Visual guidance data is generated based on the calculated optimal route.

[0418] The generated visual guidance data is transmitted to the terminal.

[0419] Step 5:

[0420] Terminal

[0421] The terminal transmits the visual guidance data received from the server to a dedicated glasses device.

[0422] Step 6:

[0423] User

[0424] The user checks the visual guidance information displayed through the glasses device and moves according to the presented route.

[0425] Step 7:

[0426] Eyeglasses Device

[0427] The emotion engine installed in the glasses device analyzes the user's facial expressions in real time.

[0428] The emotion engine recognizes the user's emotions (e.g., tension, anxiety, joy).

[0429] Step 8:

[0430] server

[0431] The server receives the user's emotional data sent from the emotion engine and adjusts the content and display method of the guidance. For example, if the user is nervous, the guidance information will be displayed more simply and clearly.

[0432] Step 9:

[0433] server

[0434] The server collects real-time traffic, congestion and weather data and updates the database.

[0435] If new delay or congestion information is discovered, the server will recalculate the optimal route.

[0436] Step 10:

[0437] server

[0438] The server sends updated route guidance information to the terminal.

[0439] Step 11:

[0440] Terminal

[0441] The terminal transmits the update information received from the server to the glasses device again.

[0442] Step 12:

[0443] User

[0444] Users can view real-time updated guidance information and continue traveling based on the appropriate route.

[0445] The emotion engine of the glasses device continues to adjust the guidance information according to changes in the user's emotions.

[0446] These steps allow users to receive optimal navigation in real time even in places with unstable communication environments. Furthermore, the emotion engine analyzes the user's emotions and provides appropriately tailored guidance information, reducing stress during travel and ensuring a smooth journey.

[0447] Example 2

[0448] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0449] Conventional navigation systems are not capable of handling unstable communication environments, unexpected congestion, or sudden changes in weather. Furthermore, they do not provide guidance information that takes into account the user's emotions, making it difficult for users to reach their destination without stress.

[0450] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: means for acquiring current location information; means for acquiring destination information; means for calculating an optimal route based on the current location information and the destination information; a head-mounted display for visually providing route guidance even in places with an unstable communication environment; means for transmitting route guidance information to the head-mounted display; means for visually presenting the route guidance information to the user; means for collecting and updating traffic volume, congestion status, and weather information in real time; means for reevaluating the calculated route based on the collected information and recalculating the route as necessary; and means for analyzing the user's emotions and adjusting the route guidance information. This enables optimal navigation in real time even in places with an unstable communication environment, and by providing guidance information that takes the user's emotions into consideration, stress during travel is reduced and smooth travel is achieved.

[0451] "Current location information" is location data that indicates the user's current location and is obtained using GPS or other location information services.

[0452] "Destination information" is location data indicating where the user wants to go, which is manually entered by the user or obtained by other means.

[0453] "Means for calculating the optimal route" refers to an algorithm or system that calculates the route that will allow the user to reach their destination most efficiently, based on current location information and destination information, taking into account traffic volume, congestion, weather information, etc.

[0454] A "head-mounted display" is a display device that is worn on the user's head and is a device for visually presenting information.

[0455] The "means for transmitting route guidance information" refers to a communication means for transferring the calculated optimal route information to a head-mounted display or other presentation device.

[0456] The term "means for visually presenting to the user" refers to a method or device for displaying the calculated route information so that the user can visually confirm it.

[0457] "Means for collecting and updating traffic, congestion, and weather information in real time" refers to a system or method that obtains current traffic, congestion, and weather conditions from external sources at any time and reflects them in a database.

[0458] "Means for re-evaluating and recalculating routes" refers to algorithms or systems that review existing routes and, if necessary, calculate new optimal routes based on new information collected in real time.

[0459] "Means for analyzing user emotions" refers to a system or algorithm that analyzes the user's facial expressions and behavior using sensors or other devices to determine the user's current emotional state (e.g., tension, anxiety, joy).

[0460] "Means for adjusting route guidance information" refers to a system or method that changes the display content and presentation method of guidance information based on the results of user emotion analysis, and provides information in an optimal form to the user.

[0461] To specifically implement this invention, a system configuration and its operation using the following means and steps will be described. This system includes a combination of means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route, a head-mounted display for visually guiding the route even in places with an unstable communication environment, means for transmitting route guidance information to the head-mounted display, means for visually presenting the route to the user, means for collecting and updating traffic volume, congestion status, and weather information in real time, means for reevaluating and recalculating, and an emotion engine.

[0462] Initial Setup

[0463] server

[0464] The server periodically obtains traffic data, public transport congestion data, weather data, etc. from various APIs (such as Google Maps API and OpenWeatherMap API) and stores them in a database. The server receives requests for current location and destination information from the user's smartphone and prepares to calculate the optimal route.

[0465] Terminal

[0466] When the dedicated app is launched, the device activates the GPS function and prepares to acquire the user's current location information, for example, by using the location information services of ANDROID (registered trademark) or iOS.

[0467] User

[0468] The user launches a dedicated smartphone app and enters destination information, including manually entering the destination into the app's input form.

[0469] Acquiring and sending location information

[0470] Terminal

[0471] When the user inputs destination information, the device uses GPS to identify the current location and sends it to the server. Specifically, the device sends the current location information to the server as JSON format data.

[0472] server

[0473] The server analyzes the current location information and destination information received from the device, temporarily stores it in a database, and prepares it for analysis.

[0474] Calculating the best route

[0475] server

[0476] The server retrieves the latest traffic volume, congestion, and weather data from the database and runs an algorithm to calculate the optimal route based on this. Specifically, it uses route optimization algorithms such as Dijkstra and A. For example, when calculating a route from Shinjuku Station to Shibuya Station, the Yamanote Line is determined to be the best route, taking into account the current traffic conditions.

[0477] Generate and send visual guidance

[0478] server

[0479] After determining the optimal route, visual guidance data is generated and sent to the device, including map images and text directions.

[0480] Emotion recognition and guidance adjustment

[0481] Eyeglasses Device

[0482] The glasses device is equipped with an emotion engine that analyzes the user's facial expressions and recognizes their emotions. This emotion engine analyzes the user's emotions (e.g., tension, anxiety, joy) in real time. It detects smiles and wrinkles between the eyebrows to analyze the level of tension or relief.

[0483] server

[0484] The server receives the user's emotion data sent from the emotion engine and adjusts the content and display method of the route guidance. Specifically, if it detects a state of tension, it generates simplified guidance.

[0485] Get directions

[0486] Terminal

[0487] The device sends visual guidance to a dedicated eyeglass device based on route guidance data and emotion recognition data received from the server. For example, if the user is nervous, specific and simple direction instructions will be displayed.

[0488] User

[0489] The user checks the visual guidance information displayed through the glasses device and travels according to the presented route. The guidance information is appropriately adjusted by the emotion engine, reducing stress during travel.

[0490] Real-time updates and rerouting

[0491] server

[0492] The server collects real-time traffic, congestion, and weather data and updates the database. For example, if the Yamanote Line is delayed, the server recalculates the route based on the new data and suggests an alternative route.

[0493] server

[0494] Send updated route guidance information to the device.

[0495] Terminal

[0496] The terminal transmits the update information received from the server again to the dedicated glasses device.

[0497] User

[0498] The user continues to navigate along the appropriate route based on guidance information updated in real time, and the emotion engine responds to changes in the user's emotions and continuously adjusts the guidance information.

[0499] Specific examples

[0500] 1. Initial Setup and Data Collection

[0501] The user arrives at Shinjuku Station and launches a dedicated app to head to Shibuya Station.

[0502] The device uses GPS to notify the server that it is at Shinjuku Station.

[0503] The server collects the latest traffic conditions and congestion information between Shinjuku Station and Shibuya Station and stores it in a database.

[0504] 2. Route calculation and guidance

[0505] Once the user enters their destination, the server calculates the optimal route and generates visual guidance data, such as the best train transfer information from Shinjuku Station to Shibuya Station.

[0506] The generated guidance information is transmitted to the terminal, which then displays it on the dedicated glasses device.

[0507] 3. Emotion recognition and regulation

[0508] While the user is moving, the emotion engine analyzes the user's facial expressions in real time to detect tension or anxiety.

[0509] The server then simplifies the guidance information accordingly, making it easier to understand, and simultaneously displays multimedia content that has a relaxing effect.

[0510] 4. Real-time updates and rerouting

[0511] When a user boards the Yamanote Line from Shinjuku Station, the server analyzes traffic data in real time to check delays and congestion.

[0512] If the Yamanote Line is delayed, the server calculates an alternative route and suggests a new route, for example using another line. This information is sent to the terminal and displayed again on the glasses device, allowing the user to follow the new route.

[0513] Prompt Sentence Examples

[0514] Example of initial setting: "Arrived at Shinjuku Station. Prepare to calculate the optimal route to Shibuya Station."

[0515] Example of location information transmission: "After entering a destination, send the current location to the server using GPS."

[0516] Route guidance example: "Calculating the optimal route from Shinjuku Station to Shibuya Station and generating visual guidance"

[0517] Emotion recognition example: "Recognize emotions while traveling and adjust guidance information"

[0518] Example of real-time update: "Yamanote Line is delayed. An alternative route will be calculated and displayed on the glasses device."

[0519] This system allows users to receive optimal navigation in real time, even in areas with unstable communication environments. The emotion engine analyzes the user's emotions and provides appropriately adjusted guidance information, reducing stress during travel. The system also responds to changes in traffic conditions and weather, ensuring smooth travel.

[0520] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0521] Processing Steps

[0522] Step 1: Initial Setup

[0523] server

[0524] The server periodically obtains traffic volume, congestion status of public transport, and weather data using various APIs and stores them in a database. Specifically, it obtains traffic data from the Google Maps API, congestion data from the public transport API, and weather data from the OpenWeatherMap API. This allows the server to maintain the latest information.

[0525] Terminal

[0526] When the dedicated app installed on the device is launched, it activates the GPS function and prepares to obtain the user's current location information. Specifically, it uses the location information services of Android and iOS to identify the user's current location.

[0527] User

[0528] The user starts the dedicated app and enters the destination in text format, which prepares the app to send the destination information to the server.

[0529] Step 2: Obtaining and sending location information

[0530] Terminal

[0531] When the user enters destination information and presses the send button, the device uses GPS to obtain current location information. This obtained current location information is converted into JSON format and sent to the server along with the destination information. This allows the server to grasp the user's current location and destination.

[0532] server

[0533] The server analyzes the current location and destination information received from the device and temporarily stores it in a database, so that the server has all the data necessary to calculate the next route.

[0534] Step 3: Calculate the optimal route

[0535] server

[0536] The server retrieves the latest traffic volume, congestion, and weather data from the database and calculates the optimal route based on this data. Specifically, it uses route optimization algorithms such as Dijkstra and A. This algorithm calculates the route that will allow the user to reach the destination in the shortest and most optimal time based on the input current location, destination, and the latest traffic information. After calculation, the optimal route information is generated and saved on the server in JSON format.

[0537] Step 4: Generate and send visual guidance

[0538] server

[0539] After the optimal route is calculated, the server generates visual guidance data, including map images and text directions. The generated guidance data is sent to the device, allowing the user to receive guidance information that is easy to understand visually.

[0540] Step 5: Emotion recognition and guidance adjustment

[0541] Eyeglasses Device

[0542] The glasses device is equipped with an emotion engine that analyzes the user's facial expressions in real time to detect emotions such as tension or anxiety. For example, by detecting smiles and frowns, the emotional state can be quantified.

[0543] server

[0544] The server receives the user's emotion data sent from the emotion engine and adjusts the content and display method of the route guidance. Specifically, if tension is detected, the guidance information is simplified and simpler direction instructions are generated. This adjusted guidance information is then sent back to the device.

[0545] Step 6: Get directions

[0546] Terminal

[0547] The device sends visual guidance to the dedicated eyeglasses device based on the route guidance data and emotion recognition data received from the server. Specifically, it provides more specific and concise guidance information to users who are nervous.

[0548] User

[0549] The user checks the visual guidance information displayed through the glasses device and begins moving. By following the guidance information appropriately adjusted by the emotion engine, the user can reduce stress during their journey.

[0550] Step 7: Real-time updates and rerouting

[0551] server

[0552] The server collects real-time traffic, congestion, and weather data and updates the database. For example, if a particular route is delayed, the server recalculates the optimal route based on the new information.

[0553] server

[0554] The updated route guidance information is then sent back to the terminal, allowing the user to always receive optimal route guidance.

[0555] Terminal

[0556] The terminal then sends the updated information received from the server back to the dedicated eyeglass device, allowing the user to check the latest guidance information in real time.

[0557] User

[0558] The user continues traveling along the appropriate route based on the updated guidance information. The emotion engine responds to the user's emotional changes and continuously adjusts the guidance information, further reducing stress during travel.

[0559] This allows users to receive optimal navigation in real time even in places with unstable communication environments, and the emotion engine provides guidance information that corresponds to the user's emotions, allowing them to travel with peace of mind.

[0560] (Application example 2)

[0561] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0562] Food delivery services require drivers to be provided with optimal route guidance in real time to ensure they deliver efficiently and safely. There are also concerns that drivers' emotional states can increase stress and compromise safety. Therefore, by analyzing drivers' emotional states and providing appropriate guidance information, it is necessary to reduce driving stress and improve safety and efficiency.

[0563] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route, viewing means, means for transmitting route guidance information, means for visually presenting the route guidance information to the user, means for collecting and updating traffic volume, congestion status, and weather information, means for reevaluating the calculated route based on the collected information and recalculating the route as necessary, means for analyzing the user's emotional state, and means for adjusting the content and display method of the route guidance information based on the analyzed emotional state. This not only enables the driver to receive optimal navigation in real time, but also reduces stress by providing information tailored to the driver's emotions, enabling safe and efficient delivery.

[0564] "Current location information" is location data of the user's current location.

[0565] "Destination information" is location data of a place where the user wants to go.

[0566] The "optimal route" is the most efficient route based on current location information and destination information, taking into account traffic conditions and weather information.

[0567] An "eyeglass device" is a wearable device that is worn by a user and is used for the purpose of visually displaying information.

[0568] "Route guidance information" is navigation data presented to the user based on a calculated optimal route.

[0569] "Visual guidance" is a means of visually presenting route guidance information to a user, and is information displayed through an eyeglass device.

[0570] "Traffic volume information" refers to data on the flow of vehicles and congestion on roads and transportation infrastructure.

[0571] "Crowding information" is data on crowd density and waiting times on public transport or in specific areas.

[0572] "Weather information" is data about current and forecast weather.

[0573] "Recalculation" is the process of reviewing current plans based on new information and making necessary adjustments.

[0574] "Emotional state" is data that indicates the psychological or emotional state of a user.

[0575] "Emotion analysis" is the process of determining a user's emotional state using sensors and data analysis techniques.

[0576] The following describes an embodiment of the present invention. The present invention is a navigation system for enabling drivers in food delivery services to deliver food efficiently and safely. Specifically, the system provides optimal route guidance calculated based on current location information and destination information, and adjusts guidance information appropriately by analyzing the driver's emotional state.

[0577] 1. Hardware Configuration

[0578] - Server: Periodically obtains traffic data, public transport congestion data, weather data, etc. from various APIs (e.g., traffic data API, weather data API) and stores it in a database. Receives requests for user current location and destination information and calculates the optimal route.

[0579] - Device: On the driver's smartphone, start the dedicated app and enable the GPS function to obtain current location information.

[0580] - Eyeglasses device: Route guidance information is visually presented using smart glasses (e.g., Google Glass (registered trademark)).

[0581] 2. Software Configuration

[0582] - Route calculation algorithm: Software that calculates the optimal route on the server side based on current location information, destination information, and traffic volume, congestion, and weather information collected in real time.

[0583] - Emotion Analysis Engine: Software that uses the built-in camera of the glasses device to collect data on the user's facial expressions and analyze their emotional state (e.g., tension, anxiety, joy). It then adjusts the guidance information based on the emotional data.

[0584] 3. Specific Examples

[0585] For example, a delivery driver launches a dedicated app on their smartphone and enters the customer's address as the destination. The smart glasses automatically connect to GPS to obtain the driver's current location information. The server calculates the optimal route based on real-time traffic and weather information and sends this information to the smart glasses. While the driver is driving, the smart glasses' camera sends the driver's face to an emotion analysis engine, and route guidance information is displayed according to the driver's emotional state. For example, if the driver is nervous, the guidance information is simplified. Furthermore, if the route is changed in real time, new route guidance is provided in a timely manner, allowing the driver to reach their destination smoothly.

[0586] 4. Examples of prompts

[0587] The following example prompt sentences could be considered as input to the generating AI model:

[0588] "I would like to develop an application for smart glasses that provides emotion analysis and real-time route guidance for delivery drivers. Please provide a concrete implementation example and code for a system that combines appropriate route calculation, traffic information collection, and emotion recognition to help drivers reach their destinations without stress."

[0589] This invention allows delivery drivers to receive optimal navigation in real time even in places with unstable communication environments, and provides information based on emotion analysis to reduce stress, enabling safe and efficient deliveries.

[0590] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0591] Step 1:

[0592] The user launches the delivery app on their smartphone and enters the customer's address as the destination. The entered destination information is saved as internal data on the smartphone.

[0593] Step 2:

[0594] The device enables the GPS function and acquires the current location information. The acquired current location information is sent to the server. The input is the device's GPS data, and the output is the current location information sent to the server.

[0595] Step 3:

[0596] The server receives the current location and destination information sent from the device and calculates the optimal route based on this. The calculation algorithm uses real-time traffic volume data, congestion data, and weather data. The inputs are current location information, destination information, traffic data, congestion data, and weather data, and the output is optimal route information.

[0597] Step 4:

[0598] The server generates optimal route information and sends it to the terminal. The input is the optimal route information, and the output is the route guidance data sent to the terminal.

[0599] Step 5:

[0600] The terminal transmits the received route guidance data to the smart glasses device and visually displays the route guidance. Specifically, the route information is displayed on the display of the glasses device. The input is the route guidance data from the server, and the output is the information displayed on the smart glasses.

[0601] Step 6:

[0602] When the user starts driving, the camera in the smart glasses analyzes the user's facial expressions in real time and sends them to the emotion engine. The input is the facial expression data captured by the camera, and the output is the emotional state.

[0603] Step 7:

[0604] The server receives the emotional state data sent from the emotion engine and adjusts the content and display method of the route guidance information based on that data. For example, if the user is in a tense state, the server displays route guidance information in a simpler and easier-to-understand manner. The input is the emotional state data, and the output is the adjusted route guidance information.

[0605] Step 8:

[0606] The server collects traffic, congestion, and weather data in real time and recalculates the optimal route as needed. When new route guidance information is generated, it is sent to the device and displayed on the smart glasses. The input is the latest traffic and weather data and the recalculated route, and the output is the updated route guidance information.

[0607] Step 9:

[0608] The user continues driving according to the latest route guidance information displayed on the smart glasses. The emotion engine continuously monitors the user's emotional state in real time and adjusts the guidance information again as necessary. The input is continuous emotional state data, and the output is continuously adjusted route guidance information.

[0609] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0610] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0611] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0612] [Second embodiment]

[0613] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0614] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0615] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0616] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0617] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0618] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0619] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0620] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0621] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0622] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0623] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0624] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0625] In order to implement this invention, a specific system configuration and its operation using the following means will be described. This system includes a means for acquiring current location information, a means for acquiring destination information, a means for calculating an optimal route, an eyeglass device for visually guiding a route even in places with an unstable communication environment, a means for transmitting route guidance information to the eyeglass device, a means for visually presenting a route to a user, a means for collecting and updating traffic volume, congestion status, and weather information in real time, and a means for reevaluating and recalculating. Below, specific examples of each step and program processing are explained in natural language.

[0626] Initial Setup Procedure

[0627] server

[0628] The server periodically collects data on traffic volume, congestion, weather, delays, etc. This data is obtained from various APIs and stored in a database.

[0629] The server prepares to obtain current location and destination information in response to a request from the user's smartphone.

[0630] Terminal

[0631] The device will launch a dedicated app and enable the GPS function to prepare to obtain current location information.

[0632] User

[0633] The user launches a dedicated app on their smartphone and enters their destination.

[0634] Acquiring and sending location information

[0635] Terminal

[0636] When the user enters a destination, the device uses GPS to determine the current location, and this information is sent to the server.

[0637] server

[0638] The server receives the current location and destination information sent from the device and prepares to calculate the optimal route.

[0639] Optimal route calculation and guidance

[0640] server

[0641] The server retrieves the latest traffic, congestion, and weather information from a database, and then uses a specific algorithm to calculate the optimal route.

[0642] For example, if a route from Shinjuku Station to Shibuya Station is calculated and it is determined that the route using the Yamanote Line is optimal, that route is selected.

[0643] server

[0644] After the optimal route is determined, visual guidance data (e.g., arrows and movement instructions) is generated and sent to the device.

[0645] Terminal

[0646] The terminal transmits the received route guidance information to a dedicated eyeglass device.

[0647] User

[0648] The user checks the guidance information visually displayed through the eyeglass device and moves along the presented route.

[0649] Real-time updates and rerouting

[0650] server

[0651] The server continues to collect real-time data on traffic volume, congestion, weather, and other factors and updates the database, thereby maintaining the most up-to-date information.

[0652] If new delays or congestion occur, the route will be reevaluated and recalculated.

[0653] server

[0654] By sending updated route guidance information to the terminal, the latest travel information is provided to the user.

[0655] Terminal

[0656] The terminal receives the updated information from the server and transmits it again to the dedicated glasses device.

[0657] User

[0658] The user continues to travel along the appropriate route based on guidance information updated in real time.

[0659] Specific examples

[0660] 1. Initial Setup and Data Collection

[0661] The user arrives at Shinjuku Station and launches a dedicated app to head to Shibuya Station.

[0662] The device uses GPS to notify the server that the user is at Shinjuku Station.

[0663] The server collects the latest traffic conditions and congestion information between Shinjuku Station and Shibuya Station and stores it in a database.

[0664] 2. Route calculation and guidance

[0665] When a user inputs their destination, the server calculates the optimal route and generates visual guidance data, such as suggesting a route from Shinjuku Station to Shibuya Station using the Yamanote Line.

[0666] The generated guidance information is transmitted to the terminal, which then presents it to the user by displaying it on a dedicated eyeglass device.

[0667] 3. Real-time updates and rerouting

[0668] When a user departs Shinjuku Station, the server analyzes traffic data to check for delays and congestion.

[0669] If the Yamanote Line is delayed, the server calculates an alternative route and suggests a new route, for example using another line. This information is sent to the terminal and displayed again on the glasses device, allowing the user to follow the new route.

[0670] This system allows users to reach their destination efficiently even in areas with unstable communication environments, providing a stress-free travel experience. Real-time updated data always presents the optimal route, supporting smooth travel for users.

[0671] The processing flow will be explained below.

[0672] Step 1:

[0673] User

[0674] The user launches a dedicated app on their smartphone and enters destination information.

[0675] Step 2:

[0676] Terminal

[0677] The device enables the GPS function to obtain the user's current location information.

[0678] Current location information and destination information are sent to the server.

[0679] Step 3:

[0680] server

[0681] The server analyzes the current location information and destination information received from the terminal.

[0682] The server retrieves the latest traffic, congestion, and weather information from a database.

[0683] Based on this information, an algorithm is run to calculate the optimal route.

[0684] Step 4:

[0685] server

[0686] Visual guidance data is generated based on the calculated optimal route.

[0687] The generated guidance data is transmitted to the terminal.

[0688] Step 5:

[0689] Terminal

[0690] The terminal transmits the visual guidance data received from the server to a dedicated glasses device.

[0691] Step 6:

[0692] User

[0693] The user checks the visual guidance information displayed through the glasses device.

[0694] The user follows the guidance information to head to the destination.

[0695] Step 7:

[0696] server

[0697] The server collects real-time traffic, congestion and weather data and updates the database.

[0698] If new delays or congestion occur, the server recalculates the optimal route.

[0699] Step 8:

[0700] server

[0701] Send updated route guidance information to the device.

[0702] Step 9:

[0703] Terminal

[0704] The terminal transmits the updated information received from the server again to the dedicated glasses device.

[0705] Step 10:

[0706] User

[0707] The user continues to travel along the appropriate route, following guidance information updated in real time.

[0708] These specific processing steps enable users to receive optimal navigation in real time even in places with unstable communication environments, and also enable smooth travel by adapting to changes in traffic conditions and weather.

[0709] Example 1

[0710] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0711] In systems that present and visually guide optimal routes based on the current location and destination, there is a need to establish technology that can update information and reroute in real time, even in places with unstable communication environments. Another issue is providing guidance that reflects the latest traffic and weather information so that users can travel efficiently from their current location to their destination.

[0712] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0713] In this invention, the server includes means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route based on the current location information and the destination information, a visual device for visually providing route guidance even in places with an unstable communication environment, means for transmitting route guidance information to the visual device, means for visually presenting the route guidance information to the user, means for collecting and updating traffic volume, congestion status, and weather information in real time, means for reevaluating the calculated route based on the collected information and recalculating the route as necessary, means for processing the collected data using a specific algorithm to derive an optimal route, and means for generating guidance information to be displayed on the visual device. This allows the user to always receive optimal route guidance based on the latest traffic and weather information, enabling them to smoothly reach their destination even in places with an unstable communication environment.

[0714] "Current location information" is data indicating the location where the user is located.

[0715] "Destination information" is data indicating the location where the user wants to arrive.

[0716] An "optimal route" is a route calculated to allow the user to travel efficiently from the current location to the destination.

[0717] A "visual device" is a device for providing visual information to a user.

[0718] "Route guidance information" is data such as instructions and maps to help the user navigate the most optimal route.

[0719] "Traffic volume" is data that indicates the number of vehicles or people on a particular road or route.

[0720] "Crowding" is data that shows the density of people and the difficulty of movement on public transportation or in specific locations.

[0721] "Weather information" is data that indicates the current weather and meteorological conditions.

[0722] An "algorithm" is a computational procedure or method used to solve a particular problem.

[0723] "Real-time" means being able to handle the latest information immediately.

[0724] The specific system configuration and operation for implementing this invention will be described below. This system provides the user with the optimal route from their current location to their destination, and supports efficient travel based on traffic and weather information updated in real time.

[0725] Hardware and software used

[0726] Hardware

[0727] Smartphones (portable information terminals)

[0728] GPS Modules

[0729] Visual devices (e.g., smart glasses)

[0730] software

[0731] Dedicated application (for smartphones)

[0732] Server software

[0733] Database (e.g. MySQL)

[0734] API (e.g. Google Maps API, Weather API)

[0735] Libraries (e.g. OpenCV)

[0736] Program processing

[0737] server

[0738] The server periodically collects data such as traffic volume, congestion, and weather information using an API and stores this data in a MySQL database.

[0739] The server receives the current location and destination information sent from the user's smartphone and retrieves the latest information from the database.

[0740] The server calculates the optimal route using Dijkstra's algorithm or A algorithm, and sends the generated visual guidance data to the smartphone.

[0741] The server collects new delay and congestion data in real time and reevaluates and recalculates routes as needed.

[0742] Terminal

[0743] The user launches a dedicated application, enables GPS, and obtains current location information.

[0744] The device sends the current location and destination information to the server.

[0745] The terminal receives the visual guidance data sent from the server and sends it to the visual device, which then presents the guidance information to the user.

[0746] User

[0747] The user launches a dedicated smartphone application and inputs their destination, such as "from Shinjuku Station to Shibuya Station."

[0748] The user wears a visual device and follows the guidance information to their destination, correcting their direction as needed based on the guidance information updated in real time.

[0749] Specific examples

[0750] 1. Data Collection

[0751] The server uses the Google Maps API to collect traffic data and store it in a database, and also uses the Weather API to collect current weather data.

[0752] Example: The server calls an API every hour to get the latest traffic and weather information and update the database.

[0753] 2. Route calculation and guidance

[0754] When a user enters "from Shinjuku Station to Shibuya Station" into the dedicated application, the device sends current location information and destination information to the server.

[0755] The server calculates the optimal route using the Dijkstra algorithm and A algorithm based on the latest traffic volume, congestion status, and weather information.

[0756] Example: From the database, it is determined that the Yamanote Line route from Shinjuku Station to Shibuya Station is optimal, and visual guidance data for that route is generated and sent to the terminal.

[0757] 3. Real-time updates

[0758] When a user departs Shinjuku Station, the server continuously collects traffic data and detects delays and changes in congestion.

[0759] Example: If there is a delay on the Yamanote Line, the server will calculate an alternative route using the Chuo Line and send the latest guidance information to the terminal.

[0760] Prompt Sentence Examples

[0761] A system description can be generated by inputting the following prompt sentence into the generative AI model:

[0762] Please explain in natural language the processing of the system's program. The system calculates the optimal route from the user's current location to their destination and provides visual guidance through a dedicated visual device. The hardware uses a smartphone and the visual device, and the software uses the Google Maps API and a MySQL database. The specific steps and process are shown below.

[0763] 1. Initial Setup Procedure

[0764] The server collects data from the Google Maps API and Weather API and stores it in a MySQL database.

[0765] It works in conjunction with the user's smartphone to prepare to obtain current location and destination information.

[0766] 2. Acquisition and transmission of location information

[0767] The device uses GPS to determine its current location and sends this information to the server.

[0768] 3. Calculation and guidance of optimal routes

[0769] The server obtains the latest traffic, congestion, and weather information and calculates the optimal route using Dijkstra's algorithm or A algorithm.

[0770] The calculated route guidance information is sent to the terminal and displayed on the visual device.

[0771] 4. Real-time updates and rerouting

[0772] The server collects data in real time and reevaluates and recalculates routes as needed.

[0773] Updates are sent to the terminal and displayed on the visual device.

[0774] This system ensures that users always have the most up-to-date information and the best route available.

[0775] In accordance with the above, this invention provides a multi-layered approach to help users reach their destinations efficiently. Real-time updated data allows users to always be presented with the most up-to-date and optimal route, supporting smooth travel even in areas with unstable communication environments.

[0776] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0777] Program processing steps

[0778] Step 1: Initial Setup

[0779] server

[0780] The server periodically collects traffic, congestion, and weather data using the Google Maps API and Weather API, and stores this data in a MySQL database.

[0781] Input: Traffic volume data, congestion data, and weather data obtained from the API

[0782] Output: Updated database

[0783] For example, you can call an API every hour to get the latest data for a specific region and store it in a database.

[0784] Terminal

[0785] Launch the dedicated application and enable GPS.

[0786] Input: User-initiated application launch

[0787] Output: GPS enabled device

[0788] User

[0789] The user launches a dedicated app on their smartphone and enters their destination.

[0790] Input: Enter your destination using the application

[0791] Output: Destination information is saved on the device

[0792] Step 2: Obtaining and sending location information

[0793] Terminal

[0794] The device uses GPS to obtain its current location information and sends this information to the server.

[0795] Input: Current location information via GPS

[0796] Output: Current location information sent to the server

[0797] For example, location information such as "current latitude: 35.6895, longitude: 139.6917" is obtained and sent to the server.

[0798] server

[0799] The server receives the current location information and destination information sent from the terminal.

[0800] Input: Current location and destination information sent from the device

[0801] Output: All the information necessary for route calculation is available

[0802] For example, you might receive data such as "Current location: 35.6895, 139.6917" and "Destination: 35.658, 139.701."

[0803] Step 3: Calculate the optimal route

[0804] server

[0805] The server retrieves the latest traffic, congestion, and weather information from the database and calculates the optimal route using Dijkstra's algorithm or A algorithm.

[0806] Input: Latest traffic volume data, congestion data, weather data, current location information, destination information

[0807] Output: Optimal route information

[0808] For example, it calculates results such as "The Yamanote Line route from Shinjuku Station to Shibuya Station is optimal."

[0809] Step 4: Generate and send visual guidance data

[0810] server

[0811] The server generates visual guidance data (e.g., arrows, movement instructions) based on the optimal route. Image data can be generated using libraries such as OpenCV.

[0812] Input: Optimal route information

[0813] Output: Visual guidance data

[0814] For example, image data including an arrow indicating the direction of travel and detailed station information is generated.

[0815] server

[0816] Visual guidance data is sent to the terminal.

[0817] Input: Visual guidance data

[0818] Output: Visual guidance data is sent to the terminal.

[0819] For example, the generated visual guide image is transmitted to the terminal.

[0820] Terminal

[0821] The terminal transmits the received visual guidance data to the visual device.

[0822] Input: Visual guidance data received from the server

[0823] Output: Visual guidance data sent to the vision device

[0824] User

[0825] The user wears the visual device and checks the guidance information.

[0826] Input: Guidance information presented through visual devices

[0827] Output: Move based on visual guidance information

[0828] For example, the driver confirms the direction of travel by following the arrow displayed on the visual device.

[0829] Step 5: Real-time updates and rerouting

[0830] server

[0831] The server continuously collects real-time traffic, congestion, and weather data and updates the database, reevaluating and recalculating routes as needed.

[0832] Input: Latest traffic data, congestion data, weather data

[0833] Output: Updated database, recalculated route information if necessary

[0834] For example, recalculations are made such as "There will be delays on the Yamanote Line" or "The new Chuo Line route is optimal."

[0835] server

[0836] The updated route guidance information is sent to the terminal.

[0837] Input: Recalculated route information

[0838] Output: Updated route information sent to the device

[0839] Terminal

[0840] The terminal receives the updated information from the server and transmits it back to the vision device.

[0841] Input: Updated route information received from the server

[0842] Output: Updated path information sent to the vision device

[0843] User

[0844] The user reviews the updated guidance information and follows the appropriate route.

[0845] Input: Updated route information displayed on a visual device

[0846] Output: Move based on updated guidance information

[0847] For example, follow new instructions such as "Avoid delays on the Yamanote Line and use the Chuo Line."

[0848] By following the above steps, the present invention can provide the user with optimal route guidance that reflects the latest traffic and weather information, allowing the user to smoothly reach their destination even in places with unstable communication environments.

[0849] (Application example 1)

[0850] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0851] In recent years, advances in autonomous driving technology have led to an increasing demand for vehicle navigation systems. However, existing systems often lack the ability to update information in locations with unstable communication environments or provide optimal route guidance in real time. Furthermore, there are limited means to intuitively and efficiently provide route guidance information to help users reach their destinations. Therefore, there is a need for a system that can collect and update information on traffic volume, congestion, weather, and other factors in real time, and provide appropriate route guidance to autonomous vehicles.

[0852] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0853] In this invention, the server includes: means for acquiring current location information; means for acquiring destination information; means for calculating an optimal route based on the current location information and the destination information; a display device for visually providing route guidance even in locations with an unstable communication environment; means for transmitting route guidance information to the display device; means for visually presenting the route guidance information to the user; means for collecting and updating traffic volume, congestion, and weather information in real time; means for reevaluating the calculated route based on the collected information and recalculating the route as necessary; means for integrating the real-time route guidance information into the control system of the autonomous vehicle; and means for displaying the received route guidance information on a smart display of the autonomous vehicle. This enables a system that enables users to efficiently reach their destination even in locations with an unstable communication environment.

[0854] The "means for acquiring current location information" refers to a device or method for identifying the user's current location and providing that information to the system.

[0855] The "means for acquiring destination information" refers to a device or method for collecting destination information set by the user and importing that data into the system.

[0856] The "means for calculating the optimum route" is a device or method for calculating the optimum travel route based on current location information and destination information, taking into consideration traffic volume, congestion, and weather information.

[0857] A "display device for visually providing route guidance even in locations where the communication environment is unstable" is a device that provides users with visual route guidance even in situations where communication is unstable.

[0858] The "means for transmitting route guidance information to a display device" is a device or method for transmitting optimal route guidance information to a display device.

[0859] The "means for visually presenting route guidance information to a user" refers to a device or method for visually displaying the transmitted route guidance information to a user.

[0860] "Means for collecting and updating traffic volume, congestion status, and weather information in real time" refers to a device or method for constantly collecting the latest traffic volume, congestion status, and weather information and updating the data within the system.

[0861] "Means for re-evaluating and, if necessary, recalculating the calculated route based on collected information" means a device or method for re-evaluating an existing route based on collected real-time information and re-calculating a new optimal route.

[0862] A "means for integrating real-time route guidance information into an automated vehicle control system" is a device or method that links a calculated optimal route to an automated vehicle control system.

[0863] "Means for displaying received route guidance information on the smart display of the autonomous vehicle" refers to a device or method for displaying optimal route guidance information on the smart display of the autonomous vehicle and providing it visually to the user.

[0864] MODE FOR CARRYING OUT THE INVENTION

[0865] A specific system configuration for implementing the present invention is shown below.

[0866] System Program Overview

[0867] server

[0868] The server processes data using the following hardware and software:

[0869] Hardware: High-performance server

[0870] Software: Database systems (e.g., PostgreSQL), traffic data APIs (e.g., Google Maps API, Here API), generative AI models (e.g., GPT-4)

[0871] The server performs the following data manipulation and calculations:

[0872] 1. Data Collection and Storage

[0873] The server periodically obtains traffic volume, congestion status, and weather information and stores it in a database. For this purpose, it uses a traffic data API.

[0874] 2. Route calculation

[0875] The server calculates the optimal route based on the current location and destination information sent by the user, using the latest traffic information, and employs a specific algorithm (e.g., Dijkstra, A).

[0876] 3. Real-time updates

[0877] The server reflects the information obtained in real time, reevaluates and recalculates the route, and always provides the latest route according to changes in traffic conditions.

[0878] Terminals (smartphones and display devices)

[0879] The smartphone and display device use the following hardware and software:

[0880] Hardware: Smartphone, display device (e.g. smart display)

[0881] Software: Dedicated app, GPS function

[0882] The terminal performs the following data manipulations and calculations:

[0883] 1. Obtaining location information

[0884] The smartphone uses its GPS function to obtain current location information and transmits it to the server.

[0885] 2. Enter and submit destination information

[0886] The user inputs their destination using a dedicated app, and the input data is sent to the server.

[0887] 3. Visual route guidance

[0888] The smartphone that receives the optimal route information then sends the information to the smart display of the autonomous vehicle, where it is visually presented to the user.

[0889] Autonomous vehicle control system

[0890] Autonomous vehicles use the following hardware and software:

[0891] Hardware: Autonomous vehicle control systems, smart displays

[0892] Software: Operating systems for autonomous vehicles (e.g., Apollo, Autoware)

[0893] The vehicle's control system performs the following data processing and calculations:

[0894] 1. Route Integration

[0895] Real-time route guidance information sent from the server is integrated into the control system of the autonomous vehicle.

[0896] 2. Display route guidance

[0897] The received route guidance information is displayed on a smart display and provided to the user.

[0898] Specific examples

[0899] As a specific example, a scenario will be described in which a user uses an autonomous vehicle to travel from their home to a station.

[0900] 1. The user opens the dedicated app on their smartphone, enables the GPS function, and enters the destination from "home" to "station."

[0901] 2. The vehicle's control server receives the current location and destination data and calculates the optimal route.

[0902] 3. The vehicle is now instructed on the quickest route, avoiding busy roads, and the information is displayed on the smart display.

[0903] 4. Users can visually check the smart display in the vehicle, relax and enjoy the journey.

[0904] This system allows users to reach their destination efficiently even in areas with unstable communication environments. It also provides the most optimal route based on the latest traffic information, making for a more comfortable and stress-free travel experience.

[0905] Example prompt sentence:

[0906] A user opens a smartphone app and wants to set up route guidance from their current location (home) to their destination (train station). The app should use GPS data to determine their current location, calculate the optimal route based on the latest traffic information, and display it on the autonomous vehicle's smart display. Write program code to monitor traffic volume, weather, and congestion conditions in real time, and reevaluate and recalculate as necessary.

[0907] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0908] Step 1:

[0909] Initial Setup and Data Collection

[0910] The server periodically collects data such as traffic volume, congestion status, and weather information, and stores it in a database. For this purpose, a traffic data API (e.g., Google Maps API, Here API) is used. The server receives this data as input and processes it to store it in the database. The input data is traffic volume data, congestion status data, and weather data, and it quickly imports this data and performs data processing and storage operations to store it in the database. As an output, the latest traffic information is accumulated in the database.

[0911] Step 2:

[0912] Acquiring and sending location information

[0913] The device (smartphone) obtains current location information when the user launches a dedicated app and enables the GPS function. The user then enters their destination into the smartphone app and sends that information to the server. The input data is the user's current location and destination, and the current location information obtained from the GPS device and the destination information entered by the user into the app are sent to the server. This inputs the location information data on the server side, and the server is ready to perform processing based on that information.

[0914] Step 3:

[0915] Calculating the best route

[0916] The server calculates the optimal route by retrieving the latest traffic volume, congestion, and weather information from a database based on the current location and destination information sent from the terminal. Here, a specific algorithm (e.g., Dijkstra, A) is used to perform data calculations. The input data is the current location information, destination information, and the latest traffic information, and the output is optimal route information. This route information includes specific travel instructions such as route selection and travel time prediction.

[0917] Step 4:

[0918] Send directions

[0919] The server generates calculated optimal route guidance information and sends the data to the terminal. The input data is the optimal route information, and the generated visual guidance data (e.g., arrows and movement instructions) is sent. As an output, the route guidance information is sent to the terminal and used for subsequent processing.

[0920] Step 5:

[0921] Visual directions

[0922] The terminal sends the received route guidance information to the smart display of the autonomous vehicle and presents it visually to the user. The input data is the route guidance information sent from the server, and the terminal sends the data to the display and processes it for display. The output is the route guidance displayed on the smart display, and the user follows it to move.

[0923] Step 6:

[0924] Real-time information gathering and updating

[0925] The server continues to collect traffic volume, congestion status, and weather information in real time and updates the database. The input data is new information obtained from the traffic data API, and the database is updated based on this. The output is the latest traffic information stored in the database, which is always kept up to date.

[0926] Step 7:

[0927] Reevaluate and recalculate routes

[0928] The server reevaluates the existing route based on the updated information in real time and recalculates a new optimal route if necessary. Here, the algorithm is used again to calculate the data. The input data is the updated traffic information, and the output is the recalculated new optimal route information. This newly calculated route guidance information is then sent to the terminal again.

[0929] Step 8:

[0930] View updated directions

[0931] The terminal receives the updated route guidance information sent again from the server and displays it on the smart display of the autonomous vehicle. The input data is the updated route guidance information from the server, which is displayed on the display. As an output, the user can continue traveling along the appropriate route based on the updated guidance information.

[0932] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0933] To specifically implement this invention, we will explain the system configuration and operation using the following means and steps. This system includes a combination of means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route, an eyeglass device for visually guiding a route even in places with an unstable communication environment, means for transmitting route guidance information to the eyeglass device, means for visually presenting a route to a user, means for collecting and updating traffic volume, congestion status, and weather information in real time, means for recalculation, and an emotion engine.

[0934] Initial Setup Procedure

[0935] server

[0936] The server periodically obtains traffic data, public transport congestion data, weather data, etc. from various APIs and stores it in a database.

[0937] The server receives a request for current location and destination information from the user's smartphone and prepares to calculate the optimal route.

[0938] Terminal

[0939] When the dedicated app is launched, the device enables the GPS function and prepares to obtain the user's current location information.

[0940] User

[0941] The user launches a dedicated app on their smartphone and enters destination information.

[0942] Acquiring and sending location information

[0943] Terminal

[0944] When the user inputs destination information, the terminal uses GPS to identify the current location and sends it to the server.

[0945] server

[0946] The server analyzes the current location information and destination information received from the device and prepares to calculate the optimal route.

[0947] Optimal route calculation and guidance

[0948] server

[0949] The server retrieves the latest traffic, congestion and weather data from a database and runs an algorithm to calculate the optimal route based on this.

[0950] For example, if it is determined that using the Yamanote Line is the best route to take when traveling from Shinjuku Station to Shibuya Station, this route will be selected.

[0951] server

[0952] After the optimal route is determined, visual guidance data is generated and transmitted to the terminal.

[0953] Emotion recognition and guidance adjustment

[0954] Eyeglasses Device

[0955] The glasses device is equipped with an emotion engine that analyzes the user's facial expressions and recognizes their emotions. This emotion engine analyzes the user's emotions (e.g., tension, anxiety, joy) in real time.

[0956] server

[0957] The system receives user emotion data sent from the emotion engine and adjusts the content and display of route guidance. For example, if the user is nervous, the system displays guidance information more simply and clearly.

[0958] Get directions

[0959] Terminal

[0960] The terminal transmits visual guidance to a dedicated eyeglass device based on the route guidance data and emotion recognition data received from the server.

[0961] User

[0962] The user checks the visual guidance information displayed through the glasses device and travels according to the presented route. The guidance information, which is mitigated by the emotion engine, reduces stress during travel.

[0963] Real-time updates and rerouting

[0964] server

[0965] The server collects real-time traffic, congestion, and weather data and updates the database. If new delays or congestion information is discovered, the optimal route is recalculated.

[0966] server

[0967] Send updated route guidance information to the device.

[0968] Terminal

[0969] The terminal transmits the updated information received from the server again to the dedicated glasses device.

[0970] User

[0971] The user continues to move along the appropriate route based on guidance information updated in real time, and the emotion engine continuously adjusts the guidance information according to changes in the user's emotions.

[0972] Specific examples

[0973] 1. Initial Setup and Data Collection

[0974] The user arrives at Shinjuku Station and launches a dedicated app to head to Shibuya Station.

[0975] The device uses GPS to notify the server that it is at Shinjuku Station.

[0976] The server collects the latest traffic conditions and congestion information between Shinjuku Station and Shibuya Station and stores it in a database.

[0977] 2. Route calculation and guidance

[0978] Once the user enters their destination, the server calculates the optimal route and generates visual guidance data, such as the best train transfer information from Shinjuku Station to Shibuya Station.

[0979] The generated guidance information is transmitted to the terminal, which then displays it on the dedicated glasses device.

[0980] 3. Emotion recognition and regulation

[0981] While the user is moving, the emotion engine analyzes the user's facial expressions in real time to detect tension or anxiety.

[0982] The server then simplifies the guidance information accordingly, making it easier to understand, and simultaneously displays multimedia content that has a relaxing effect.

[0983] 4. Real-time updates and rerouting

[0984] When a user boards the Yamanote Line from Shinjuku Station, the server analyzes traffic data in real time to check delays and congestion.

[0985] If the Yamanote Line is delayed, the server calculates an alternative route and suggests a new route, for example using another line. This information is sent to the terminal and displayed again on the glasses device, allowing the user to follow the new route.

[0986] This system allows users to receive optimal navigation in real time, even in areas with unstable communication environments. The emotion engine analyzes the user's emotions and provides appropriately adjusted guidance information, reducing stress during travel. The system also responds to changes in traffic conditions and weather, ensuring smooth travel.

[0987] The processing flow will be explained below.

[0988] Step 1:

[0989] User

[0990] The user launches a dedicated app on their smartphone and enters destination information.

[0991] Step 2:

[0992] Terminal

[0993] The device enables the GPS function to obtain the user's current location information.

[0994] The terminal transmits the acquired current location information and destination information to the server.

[0995] Step 3:

[0996] server

[0997] The server analyzes the current location information and destination information received from the terminal.

[0998] The server retrieves the latest traffic, congestion and weather data from a database.

[0999] Based on this information, an algorithm is run to calculate the optimal route.

[1000] Step 4:

[1001] server

[1002] Visual guidance data is generated based on the calculated optimal route.

[1003] The generated visual guidance data is transmitted to the terminal.

[1004] Step 5:

[1005] Terminal

[1006] The terminal transmits the visual guidance data received from the server to a dedicated glasses device.

[1007] Step 6:

[1008] User

[1009] The user checks the visual guidance information displayed through the glasses device and moves according to the presented route.

[1010] Step 7:

[1011] Eyeglasses Device

[1012] The emotion engine installed in the glasses device analyzes the user's facial expressions in real time.

[1013] The emotion engine recognizes the user's emotions (e.g., tension, anxiety, joy).

[1014] Step 8:

[1015] server

[1016] The server receives the user's emotional data sent from the emotion engine and adjusts the content and display method of the guidance. For example, if the user is nervous, the guidance information will be displayed more simply and clearly.

[1017] Step 9:

[1018] server

[1019] The server collects real-time traffic, congestion and weather data and updates the database.

[1020] If new delay or congestion information is discovered, the server will recalculate the optimal route.

[1021] Step 10:

[1022] server

[1023] The server sends updated route guidance information to the terminal.

[1024] Step 11:

[1025] Terminal

[1026] The terminal transmits the update information received from the server to the glasses device again.

[1027] Step 12:

[1028] User

[1029] Users can view real-time updated guidance information and continue traveling based on the appropriate route.

[1030] The emotion engine of the glasses device continues to adjust the guidance information according to changes in the user's emotions.

[1031] These steps allow users to receive optimal navigation in real time even in places with unstable communication environments. Furthermore, the emotion engine analyzes the user's emotions and provides appropriately tailored guidance information, reducing stress during travel and ensuring a smooth journey.

[1032] Example 2

[1033] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1034] Conventional navigation systems are not capable of handling unstable communication environments, unexpected congestion, or sudden changes in weather. Furthermore, they do not provide guidance information that takes into account the user's emotions, making it difficult for users to reach their destination without stress.

[1035] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: means for acquiring current location information; means for acquiring destination information; means for calculating an optimal route based on the current location information and the destination information; a head-mounted display for visually providing route guidance even in places with an unstable communication environment; means for transmitting route guidance information to the head-mounted display; means for visually presenting the route guidance information to the user; means for collecting and updating traffic volume, congestion status, and weather information in real time; means for reevaluating the calculated route based on the collected information and recalculating the route as necessary; and means for analyzing the user's emotions and adjusting the route guidance information. This enables optimal navigation in real time even in places with an unstable communication environment, and by providing guidance information that takes the user's emotions into consideration, stress during travel is reduced and smooth travel is achieved.

[1036] "Current location information" is location data that indicates the user's current location and is obtained using GPS or other location information services.

[1037] "Destination information" is location data indicating where the user wants to go, which is manually entered by the user or obtained by other means.

[1038] "Means for calculating the optimal route" refers to an algorithm or system that calculates the route that will allow the user to reach their destination most efficiently, based on current location information and destination information, taking into account traffic volume, congestion, weather information, etc.

[1039] A "head-mounted display" is a display device that is worn on the user's head and is a device for visually presenting information.

[1040] The "means for transmitting route guidance information" refers to a communication means for transferring the calculated optimal route information to a head-mounted display or other presentation device.

[1041] The term "means for visually presenting to the user" refers to a method or device for displaying the calculated route information so that the user can visually confirm it.

[1042] "Means of collecting and updating traffic, congestion, and weather information in real time" refers to a system or method that obtains current traffic, congestion, and weather conditions from external sources at any time and reflects them in a database.

[1043] "Means for re-evaluating and recalculating routes" refers to algorithms or systems that review existing routes and, if necessary, calculate new optimal routes based on new information collected in real time.

[1044] "Means for analyzing user emotions" refers to a system or algorithm that analyzes the user's facial expressions and behavior using sensors or other devices to determine the user's current emotional state (e.g., tension, anxiety, joy).

[1045] "Means for adjusting route guidance information" refers to a system or method that changes the display content and presentation method of guidance information based on the results of user emotion analysis, and provides information in an optimal form to the user.

[1046] To specifically implement this invention, a system configuration and its operation using the following means and steps will be described. This system includes a combination of means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route, a head-mounted display for visually guiding the route even in places with an unstable communication environment, means for transmitting route guidance information to the head-mounted display, means for visually presenting the route to the user, means for collecting and updating traffic volume, congestion status, and weather information in real time, means for reevaluating and recalculating, and an emotion engine.

[1047] Initial Setup

[1048] server

[1049] The server periodically obtains traffic data, public transport congestion data, weather data, etc. from various APIs (such as Google Maps API and OpenWeatherMap API) and stores them in a database. The server receives requests for current location and destination information from the user's smartphone and prepares to calculate the optimal route.

[1050] Terminal

[1051] When the dedicated app is launched, the device activates the GPS function and prepares to obtain the user's current location information, for example, by using the location information services of Android or iOS.

[1052] User

[1053] The user launches a dedicated smartphone app and enters destination information, including manually entering the destination into the app's input form.

[1054] Acquiring and sending location information

[1055] Terminal

[1056] When the user inputs destination information, the device uses GPS to identify the current location and sends it to the server. Specifically, the device sends the current location information to the server as JSON format data.

[1057] server

[1058] The server analyzes the current location information and destination information received from the device, temporarily stores it in a database, and prepares it for analysis.

[1059] Calculating the best route

[1060] server

[1061] The server retrieves the latest traffic volume, congestion, and weather data from the database and runs an algorithm to calculate the optimal route based on this. Specifically, it uses route optimization algorithms such as Dijkstra and A. For example, when calculating a route from Shinjuku Station to Shibuya Station, the Yamanote Line is determined to be the best route, taking into account the current traffic conditions.

[1062] Generate and send visual guidance

[1063] server

[1064] After determining the optimal route, visual guidance data is generated and sent to the device, including map images and text directions.

[1065] Emotion recognition and guidance adjustment

[1066] Eyeglasses Device

[1067] The glasses device is equipped with an emotion engine that analyzes the user's facial expressions and recognizes their emotions. This emotion engine analyzes the user's emotions (e.g., tension, anxiety, joy) in real time. It detects smiles and wrinkles between the eyebrows to analyze the level of tension or relief.

[1068] server

[1069] The server receives the user's emotion data sent from the emotion engine and adjusts the content and display method of route guidance. Specifically, if it detects a state of tension, it generates simplified guidance.

[1070] Get directions

[1071] Terminal

[1072] The device sends visual guidance to a dedicated eyeglass device based on route guidance data and emotion recognition data received from the server. For example, if the user is nervous, specific and simple direction instructions will be displayed.

[1073] User

[1074] The user checks the visual guidance information displayed through the glasses device and travels according to the presented route. The guidance information displayed is appropriately adjusted by the emotion engine, reducing stress during travel.

[1075] Real-time updates and rerouting

[1076] server

[1077] The server collects real-time traffic, congestion, and weather data and updates the database. For example, if the Yamanote Line is delayed, the server recalculates the route based on the new data and suggests an alternative route.

[1078] server

[1079] Send updated route guidance information to the device.

[1080] Terminal

[1081] The terminal transmits the update information received from the server again to the dedicated glasses device.

[1082] User

[1083] The user continues to navigate along the appropriate route based on guidance information updated in real time, and the emotion engine responds to changes in the user's emotions and continuously adjusts the guidance information.

[1084] Specific examples

[1085] 1. Initial Setup and Data Collection

[1086] The user arrives at Shinjuku Station and launches a dedicated app to head to Shibuya Station.

[1087] The device uses GPS to notify the server that it is at Shinjuku Station.

[1088] The server collects the latest traffic conditions and congestion information between Shinjuku Station and Shibuya Station and stores it in a database.

[1089] 2. Route calculation and guidance

[1090] Once the user enters their destination, the server calculates the optimal route and generates visual guidance data, such as the best train transfer information from Shinjuku Station to Shibuya Station.

[1091] The generated guidance information is transmitted to the terminal, which then displays it on the dedicated glasses device.

[1092] 3. Emotion recognition and regulation

[1093] While the user is moving, the emotion engine analyzes the user's facial expressions in real time to detect tension or anxiety.

[1094] The server then simplifies the guidance information accordingly, making it easier to understand, and simultaneously displays multimedia content that has a relaxing effect.

[1095] 4. Real-time updates and rerouting

[1096] When a user boards the Yamanote Line from Shinjuku Station, the server analyzes traffic data in real time to check delays and congestion.

[1097] If the Yamanote Line is delayed, the server calculates an alternative route and suggests a new route, for example using another line. This information is sent to the terminal and displayed again on the glasses device, allowing the user to follow the new route.

[1098] Prompt Sentence Examples

[1099] Example of initial setting: "Arrived at Shinjuku Station. Prepare to calculate the optimal route to Shibuya Station."

[1100] Example of location information transmission: "After entering a destination, send the current location to the server using GPS."

[1101] Route guidance example: "Calculating the optimal route from Shinjuku Station to Shibuya Station and generating visual guidance"

[1102] Emotion recognition example: "Recognize emotions while traveling and adjust guidance information"

[1103] Example of real-time update: "Yamanote Line is delayed. An alternative route will be calculated and displayed on the glasses device."

[1104] This system allows users to receive optimal navigation in real time, even in areas with unstable communication environments. The emotion engine analyzes the user's emotions and provides appropriately adjusted guidance information, reducing stress during travel. The system also responds to changes in traffic conditions and weather, ensuring smooth travel.

[1105] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1106] Processing Steps

[1107] Step 1: Initial Setup

[1108] server

[1109] The server periodically obtains traffic volume, congestion status of public transport, and weather data using various APIs and stores them in a database. Specifically, it obtains traffic data from the Google Maps API, congestion data from the public transport API, and weather data from the OpenWeatherMap API. This allows the server to maintain the latest information.

[1110] Terminal

[1111] When the dedicated app installed on the device is launched, it activates the GPS function and prepares to obtain the user's current location information. Specifically, it uses the location information services of Android and iOS to identify the user's current location.

[1112] User

[1113] The user starts the dedicated app and enters the destination in text format, which prepares the app to send the destination information to the server.

[1114] Step 2: Obtaining and sending location information

[1115] Terminal

[1116] When the user enters destination information and presses the send button, the device uses GPS to obtain current location information. This obtained current location information is converted into JSON format and sent to the server along with the destination information. This allows the server to grasp the user's current location and destination.

[1117] server

[1118] The server analyzes the current location and destination information received from the device and temporarily stores it in a database, so that the server has all the data necessary to calculate the next route.

[1119] Step 3: Calculate the optimal route

[1120] server

[1121] The server retrieves the latest traffic volume, congestion, and weather data from the database and calculates the optimal route based on this data. Specifically, it uses route optimization algorithms such as Dijkstra and A. This algorithm calculates the route that will allow the user to reach the destination in the shortest and most optimal time based on the input current location, destination, and the latest traffic information. After calculation, the optimal route information is generated and saved on the server in JSON format.

[1122] Step 4: Generate and send visual guidance

[1123] server

[1124] After the optimal route is calculated, the server generates visual guidance data, including map images and text directions. The generated guidance data is sent to the device, allowing the user to receive guidance information that is easy to understand visually.

[1125] Step 5: Emotion recognition and guidance adjustment

[1126] Eyeglasses Device

[1127] The glasses device is equipped with an emotion engine that analyzes the user's facial expressions in real time to detect emotions such as tension or anxiety. For example, by detecting smiles and frowns, the emotional state can be quantified.

[1128] server

[1129] The server receives the user's emotion data sent from the emotion engine and adjusts the content and display method of the route guidance. Specifically, if tension is detected, the guidance information is simplified and simpler direction instructions are generated. This adjusted guidance information is then sent back to the device.

[1130] Step 6: Get directions

[1131] Terminal

[1132] The device sends visual guidance to the dedicated eyeglasses device based on the route guidance data and emotion recognition data received from the server. Specifically, it provides more specific and concise guidance information to users who are nervous.

[1133] User

[1134] The user checks the visual guidance information displayed through the glasses device and begins moving. By following the guidance information appropriately adjusted by the emotion engine, the user can reduce stress during their journey.

[1135] Step 7: Real-time updates and rerouting

[1136] server

[1137] The server collects real-time traffic, congestion, and weather data and updates the database. For example, if a particular route is delayed, the server recalculates the optimal route based on the new information.

[1138] server

[1139] The updated route guidance information is then sent back to the terminal, allowing the user to always receive optimal route guidance.

[1140] Terminal

[1141] The terminal then sends the updated information received from the server back to the dedicated eyeglass device, allowing the user to check the latest guidance information in real time.

[1142] User

[1143] The user continues traveling along the appropriate route based on the updated guidance information. The emotion engine responds to the user's emotional changes and continuously adjusts the guidance information, further reducing stress during travel.

[1144] This allows users to receive optimal navigation in real time even in places with unstable communication environments, and the emotion engine provides guidance information that corresponds to the user's emotions, allowing them to travel with peace of mind.

[1145] (Application example 2)

[1146] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1147] Food delivery services require drivers to be provided with optimal route guidance in real time to ensure they deliver efficiently and safely. There are also concerns that drivers' emotional states can increase stress and compromise safety. Therefore, by analyzing drivers' emotional states and providing appropriate guidance information, it is necessary to reduce driving stress and improve safety and efficiency.

[1148] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route, viewing means, means for transmitting route guidance information, means for visually presenting the route guidance information to the user, means for collecting and updating traffic volume, congestion status, and weather information, means for reevaluating the calculated route based on the collected information and recalculating the route as necessary, means for analyzing the user's emotional state, and means for adjusting the content and display method of the route guidance information based on the analyzed emotional state. This not only enables the driver to receive optimal navigation in real time, but also reduces stress by providing information tailored to the driver's emotions, enabling safe and efficient delivery.

[1149] "Current location information" is location data of the user's current location.

[1150] "Destination information" is location data of a place where the user wants to go.

[1151] The "optimal route" is the most efficient route based on current location information and destination information, taking into account traffic conditions and weather information.

[1152] An "eyeglass device" is a wearable device that is worn by a user and is used for the purpose of visually displaying information.

[1153] "Route guidance information" is navigation data presented to the user based on a calculated optimal route.

[1154] "Visual guidance" is a means of visually presenting route guidance information to a user, and is information displayed through an eyeglass device.

[1155] "Traffic volume information" refers to data on the flow of vehicles and congestion on roads and transportation infrastructure.

[1156] "Crowding information" is data on crowd density and waiting times on public transport or in specific areas.

[1157] "Weather information" is data about current and forecast weather.

[1158] "Recalculation" is the process of reviewing current plans based on new information and making necessary adjustments.

[1159] "Emotional state" is data that indicates the psychological or emotional state of a user.

[1160] "Emotion analysis" is the process of determining a user's emotional state using sensors and data analysis techniques.

[1161] The following describes an embodiment of the present invention. The present invention is a navigation system for enabling drivers in food delivery services to deliver food efficiently and safely. Specifically, the system provides optimal route guidance calculated based on current location information and destination information, and adjusts guidance information appropriately by analyzing the driver's emotional state.

[1162] 1. Hardware Configuration

[1163] - Server: Periodically obtains traffic data, public transport congestion data, weather data, etc. from various APIs (e.g. traffic data API, weather data API) and stores it in a database. Receives requests for user current location and destination information and calculates the optimal route.

[1164] - Device: On the driver's smartphone, start the dedicated app and enable the GPS function to obtain current location information.

[1165] - Eyeglasses devices: Smart glasses (e.g., Google Glass) are used to visually present route guidance information.

[1166] 2. Software Configuration

[1167] - Route calculation algorithm: Software that calculates the optimal route on the server side based on current location information, destination information, and traffic volume, congestion, and weather information collected in real time.

[1168] - Emotion Analysis Engine: Software that uses the built-in camera of the glasses device to collect data on the user's facial expressions and analyze their emotional state (e.g., tension, anxiety, joy). It then adjusts the guidance information based on the emotional data.

[1169] 3. Specific Examples

[1170] For example, a delivery driver launches a dedicated app on their smartphone and enters the customer's address as the destination. The smart glasses automatically connect to GPS to obtain the driver's current location information. The server calculates the optimal route based on real-time traffic and weather information and sends this information to the smart glasses. While the driver is driving, the smart glasses' camera sends the driver's face to an emotion analysis engine, and route guidance information is displayed according to the driver's emotional state. For example, if the driver is nervous, the guidance information is simplified. Furthermore, if the route is changed in real time, new route guidance is provided in a timely manner, allowing the driver to reach their destination smoothly.

[1171] 4. Examples of prompts

[1172] The following example prompt sentences could be considered as input to the generating AI model:

[1173] "I would like to develop an application for smart glasses that provides emotion analysis and real-time route guidance for delivery drivers. Please provide a concrete implementation example and code for a system that combines appropriate route calculation, traffic information collection, and emotion recognition to help drivers reach their destinations without stress."

[1174] This invention allows delivery drivers to receive optimal navigation in real time even in places with unstable communication environments, and provides information based on emotion analysis to reduce stress, enabling safe and efficient deliveries.

[1175] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1176] Step 1:

[1177] The user launches the delivery app on their smartphone and enters the customer's address as the destination. The entered destination information is saved as internal data on the smartphone.

[1178] Step 2:

[1179] The device enables the GPS function and acquires the current location information. The acquired current location information is sent to the server. The input is the device's GPS data, and the output is the current location information sent to the server.

[1180] Step 3:

[1181] The server receives the current location and destination information sent from the device and calculates the optimal route based on this. The calculation algorithm uses real-time traffic volume data, congestion data, and weather data. The inputs are current location information, destination information, traffic data, congestion data, and weather data, and the output is optimal route information.

[1182] Step 4:

[1183] The server generates optimal route information and sends it to the terminal. The input is the optimal route information, and the output is the route guidance data sent to the terminal.

[1184] Step 5:

[1185] The terminal transmits the received route guidance data to the smart glasses device and visually displays the route guidance. Specifically, the route information is displayed on the display of the glasses device. The input is the route guidance data from the server, and the output is the information displayed on the smart glasses.

[1186] Step 6:

[1187] When the user starts driving, the camera in the smart glasses analyzes the user's facial expressions in real time and sends them to the emotion engine. The input is the facial expression data captured by the camera, and the output is the emotional state.

[1188] Step 7:

[1189] The server receives the emotional state data sent from the emotion engine and adjusts the content and display method of the route guidance information based on that data. For example, if the user is in a tense state, the server displays route guidance information in a simpler and easier-to-understand manner. The input is the emotional state data, and the output is the adjusted route guidance information.

[1190] Step 8:

[1191] The server collects traffic, congestion, and weather data in real time and recalculates the optimal route as needed. When new route guidance information is generated, it is sent to the device and displayed on the smart glasses. The input is the latest traffic and weather data and the recalculated route, and the output is the updated route guidance information.

[1192] Step 9:

[1193] The user continues driving according to the latest route guidance information displayed on the smart glasses. The emotion engine continuously monitors the user's emotional state in real time and adjusts the guidance information again as necessary. The input is continuous emotional state data, and the output is continuously adjusted route guidance information.

[1194] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1195] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1196] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1197] [Third embodiment]

[1198] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1199] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1200] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1201] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1202] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1203] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1204] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1205] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1206] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1207] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1208] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1209] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1210] In order to implement this invention, a specific system configuration and its operation using the following means will be described. This system includes a means for acquiring current location information, a means for acquiring destination information, a means for calculating an optimal route, an eyeglass device for visually guiding a route even in places with an unstable communication environment, a means for transmitting route guidance information to the eyeglass device, a means for visually presenting a route to a user, a means for collecting and updating traffic volume, congestion status, and weather information in real time, and a means for reevaluating and recalculating. Below, specific examples of each step and program processing are explained in natural language.

[1211] Initial Setup Procedure

[1212] server

[1213] The server periodically collects data on traffic volume, congestion, weather, delays, etc. This data is obtained from various APIs and stored in a database.

[1214] The server prepares to obtain current location and destination information in response to a request from the user's smartphone.

[1215] Terminal

[1216] The device will launch a dedicated app and enable the GPS function to prepare to obtain current location information.

[1217] User

[1218] The user launches a dedicated app on their smartphone and enters their destination.

[1219] Acquiring and sending location information

[1220] Terminal

[1221] When the user enters a destination, the device uses GPS to determine the current location, and this information is sent to the server.

[1222] server

[1223] The server receives the current location and destination information sent from the device and prepares to calculate the optimal route.

[1224] Optimal route calculation and guidance

[1225] server

[1226] The server retrieves the latest traffic, congestion, and weather information from a database, and then uses a specific algorithm to calculate the optimal route.

[1227] For example, if a route from Shinjuku Station to Shibuya Station is calculated and it is determined that the route using the Yamanote Line is optimal, that route is selected.

[1228] server

[1229] After the optimal route is determined, visual guidance data (e.g., arrows and movement instructions) is generated and sent to the device.

[1230] Terminal

[1231] The terminal transmits the received route guidance information to a dedicated eyeglass device.

[1232] User

[1233] The user checks the guidance information visually displayed through the eyeglass device and moves along the presented route.

[1234] Real-time updates and rerouting

[1235] server

[1236] The server continues to collect real-time data on traffic volume, congestion, weather, and other factors and updates the database, thereby maintaining the most up-to-date information.

[1237] If new delays or congestion occur, the route will be reevaluated and recalculated.

[1238] server

[1239] By sending updated route guidance information to the terminal, the latest travel information is provided to the user.

[1240] Terminal

[1241] The terminal receives the updated information from the server and transmits it again to the dedicated glasses device.

[1242] User

[1243] The user continues to travel along the appropriate route based on guidance information updated in real time.

[1244] Specific examples

[1245] 1. Initial Setup and Data Collection

[1246] The user arrives at Shinjuku Station and launches a dedicated app to head to Shibuya Station.

[1247] The device uses GPS to notify the server that the user is at Shinjuku Station.

[1248] The server collects the latest traffic conditions and congestion information between Shinjuku Station and Shibuya Station and stores it in a database.

[1249] 2. Route calculation and guidance

[1250] When a user inputs their destination, the server calculates the optimal route and generates visual guidance data, such as suggesting a route from Shinjuku Station to Shibuya Station using the Yamanote Line.

[1251] The generated guidance information is transmitted to the terminal, which then presents it to the user by displaying it on a dedicated eyeglass device.

[1252] 3. Real-time updates and rerouting

[1253] When a user departs Shinjuku Station, the server analyzes traffic data to check for delays and congestion.

[1254] If the Yamanote Line is delayed, the server calculates an alternative route and suggests a new route, for example using another line. This information is sent to the terminal and displayed again on the glasses device, allowing the user to follow the new route.

[1255] This system allows users to reach their destination efficiently even in areas with unstable communication environments, providing a stress-free travel experience. Real-time updated data always presents the optimal route, supporting smooth travel for users.

[1256] The processing flow will be explained below.

[1257] Step 1:

[1258] User

[1259] The user launches a dedicated app on their smartphone and enters destination information.

[1260] Step 2:

[1261] Terminal

[1262] The device enables the GPS function to obtain the user's current location information.

[1263] Current location information and destination information are sent to the server.

[1264] Step 3:

[1265] server

[1266] The server analyzes the current location information and destination information received from the terminal.

[1267] The server retrieves the latest traffic, congestion, and weather information from a database.

[1268] Based on this information, an algorithm is run to calculate the optimal route.

[1269] Step 4:

[1270] server

[1271] Visual guidance data is generated based on the calculated optimal route.

[1272] The generated guidance data is transmitted to the terminal.

[1273] Step 5:

[1274] Terminal

[1275] The terminal transmits the visual guidance data received from the server to a dedicated glasses device.

[1276] Step 6:

[1277] User

[1278] The user checks the visual guidance information displayed through the glasses device.

[1279] The user follows the guidance information to head to the destination.

[1280] Step 7:

[1281] server

[1282] The server collects real-time traffic, congestion and weather data and updates the database.

[1283] If new delays or congestion occur, the server recalculates the optimal route.

[1284] Step 8:

[1285] server

[1286] Send updated route guidance information to the device.

[1287] Step 9:

[1288] Terminal

[1289] The terminal transmits the updated information received from the server again to the dedicated glasses device.

[1290] Step 10:

[1291] User

[1292] The user continues to travel along the appropriate route, following guidance information updated in real time.

[1293] These specific processing steps enable users to receive optimal navigation in real time even in places with unstable communication environments, and also enable smooth travel by adapting to changes in traffic conditions and weather.

[1294] Example 1

[1295] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1296] In systems that present and visually guide optimal routes based on the current location and destination, there is a need to establish technology that can update information and reroute in real time, even in places with unstable communication environments. Another issue is providing guidance that reflects the latest traffic and weather information so that users can travel efficiently from their current location to their destination.

[1297] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1298] In this invention, the server includes means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route based on the current location information and the destination information, a visual device for visually providing route guidance even in places with an unstable communication environment, means for transmitting route guidance information to the visual device, means for visually presenting the route guidance information to the user, means for collecting and updating traffic volume, congestion status, and weather information in real time, means for reevaluating the calculated route based on the collected information and recalculating the route as necessary, means for processing the collected data using a specific algorithm to derive an optimal route, and means for generating guidance information to be displayed on the visual device. This allows the user to always receive optimal route guidance based on the latest traffic and weather information, enabling them to smoothly reach their destination even in places with an unstable communication environment.

[1299] "Current location information" is data indicating the location where the user is located.

[1300] "Destination information" is data indicating the location where the user wants to arrive.

[1301] An "optimal route" is a route calculated to allow the user to travel efficiently from the current location to the destination.

[1302] A "visual device" is a device for providing visual information to a user.

[1303] "Route guidance information" is data such as instructions and maps to help the user navigate the most optimal route.

[1304] "Traffic volume" is data that indicates the number of vehicles or people on a particular road or route.

[1305] "Crowding" is data that shows the density of people and the difficulty of movement on public transportation or in specific locations.

[1306] "Weather information" is data that indicates the current weather and meteorological conditions.

[1307] An "algorithm" is a computational procedure or method used to solve a particular problem.

[1308] "Real-time" means being able to handle the latest information immediately.

[1309] The specific system configuration and operation for implementing this invention will be described below. This system provides the user with the optimal route from their current location to their destination, and supports efficient travel based on traffic and weather information updated in real time.

[1310] Hardware and software used

[1311] Hardware

[1312] Smartphones (portable information terminals)

[1313] GPS Modules

[1314] Visual devices (e.g., smart glasses)

[1315] software

[1316] Dedicated application (for smartphones)

[1317] Server software

[1318] Database (e.g. MySQL)

[1319] API (e.g. Google Maps API, Weather API)

[1320] Libraries (e.g. OpenCV)

[1321] Program processing

[1322] server

[1323] The server periodically collects data such as traffic volume, congestion, and weather information using an API and stores this data in a MySQL database.

[1324] The server receives the current location and destination information sent from the user's smartphone and retrieves the latest information from the database.

[1325] The server calculates the optimal route using Dijkstra's algorithm or A algorithm, and sends the generated visual guidance data to the smartphone.

[1326] The server collects new delay and congestion data in real time and reevaluates and recalculates routes as needed.

[1327] Terminal

[1328] The user launches a dedicated application, enables GPS, and obtains current location information.

[1329] The device sends the current location and destination information to the server.

[1330] The terminal receives the visual guidance data sent from the server and sends it to the visual device, which then presents the guidance information to the user.

[1331] User

[1332] The user launches a dedicated smartphone application and inputs their destination, such as "from Shinjuku Station to Shibuya Station."

[1333] The user wears a visual device and follows the guidance information to their destination, correcting their direction as needed based on the guidance information updated in real time.

[1334] Specific examples

[1335] 1. Data Collection

[1336] The server uses the Google Maps API to collect traffic data and store it in a database, and also uses the Weather API to collect current weather data.

[1337] Example: The server calls an API every hour to get the latest traffic and weather information and update the database.

[1338] 2. Route calculation and guidance

[1339] When a user enters "from Shinjuku Station to Shibuya Station" into the dedicated application, the device sends current location information and destination information to the server.

[1340] The server calculates the optimal route using the Dijkstra algorithm and A algorithm based on the latest traffic volume, congestion status, and weather information.

[1341] Example: From the database, it is determined that the Yamanote Line route from Shinjuku Station to Shibuya Station is optimal, and visual guidance data for that route is generated and sent to the terminal.

[1342] 3. Real-time updates

[1343] When a user departs Shinjuku Station, the server continuously collects traffic data and detects delays and changes in congestion.

[1344] Example: If there is a delay on the Yamanote Line, the server will calculate an alternative route using the Chuo Line and send the latest guidance information to the terminal.

[1345] Prompt Sentence Examples

[1346] A system description can be generated by inputting the following prompt sentence into the generative AI model:

[1347] Please explain in natural language the processing of the system's program. The system calculates the optimal route from the user's current location to their destination and provides visual guidance through a dedicated visual device. The hardware uses a smartphone and the visual device, and the software uses the Google Maps API and a MySQL database. The specific steps and process are shown below.

[1348] 1. Initial Setup Procedure

[1349] The server collects data from the Google Maps API and Weather API and stores it in a MySQL database.

[1350] It works in conjunction with the user's smartphone to prepare to obtain current location and destination information.

[1351] 2. Acquisition and transmission of location information

[1352] The device uses GPS to determine its current location and sends this information to the server.

[1353] 3. Calculation and guidance of optimal routes

[1354] The server obtains the latest traffic, congestion, and weather information and calculates the optimal route using Dijkstra's algorithm or A algorithm.

[1355] The calculated route guidance information is sent to the terminal and displayed on the visual device.

[1356] 4. Real-time updates and rerouting

[1357] The server collects data in real time and reevaluates and recalculates routes as needed.

[1358] Updates are sent to the terminal and displayed on the visual device.

[1359] This system ensures that users always have the most up-to-date information and the best route available.

[1360] In accordance with the above, this invention provides a multi-layered approach to help users reach their destinations efficiently. Real-time updated data allows users to always be presented with the most up-to-date and optimal route, supporting smooth travel even in areas with unstable communication environments.

[1361] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1362] Program processing steps

[1363] Step 1: Initial Setup

[1364] server

[1365] The server periodically collects traffic, congestion, and weather data using the Google Maps API and Weather API, and stores this data in a MySQL database.

[1366] Input: Traffic volume data, congestion data, and weather data obtained from the API

[1367] Output: Updated database

[1368] For example, you can call an API every hour to get the latest data for a specific region and store it in a database.

[1369] Terminal

[1370] Launch the dedicated application and enable GPS.

[1371] Input: User-initiated application launch

[1372] Output: GPS enabled device

[1373] User

[1374] The user launches a dedicated app on their smartphone and enters their destination.

[1375] Input: Enter your destination using the application

[1376] Output: Destination information is saved on the device

[1377] Step 2: Obtaining and sending location information

[1378] Terminal

[1379] The device uses GPS to obtain its current location information and sends this information to the server.

[1380] Input: Current location information via GPS

[1381] Output: Current location information sent to the server

[1382] For example, location information such as "current latitude: 35.6895, longitude: 139.6917" is obtained and sent to the server.

[1383] server

[1384] The server receives the current location information and destination information sent from the terminal.

[1385] Input: Current location and destination information sent from the device

[1386] Output: All the information necessary for route calculation is available

[1387] For example, you might receive data such as "Current location: 35.6895, 139.6917" and "Destination: 35.658, 139.701."

[1388] Step 3: Calculate the optimal route

[1389] server

[1390] The server retrieves the latest traffic, congestion, and weather information from the database and calculates the optimal route using Dijkstra's algorithm or A algorithm.

[1391] Input: Latest traffic volume data, congestion data, weather data, current location information, destination information

[1392] Output: Optimal route information

[1393] For example, it calculates results such as "The Yamanote Line route from Shinjuku Station to Shibuya Station is optimal."

[1394] Step 4: Generate and send visual guidance data

[1395] server

[1396] The server generates visual guidance data (e.g., arrows, movement instructions) based on the optimal route. Image data can be generated using libraries such as OpenCV.

[1397] Input: Optimal route information

[1398] Output: Visual guidance data

[1399] For example, image data including an arrow indicating the direction of travel and detailed station information is generated.

[1400] server

[1401] Visual guidance data is sent to the terminal.

[1402] Input: Visual guidance data

[1403] Output: Visual guidance data is sent to the terminal.

[1404] For example, the generated visual guide image is transmitted to the terminal.

[1405] Terminal

[1406] The terminal transmits the received visual guidance data to the visual device.

[1407] Input: Visual guidance data received from the server

[1408] Output: Visual guidance data sent to the vision device

[1409] User

[1410] The user wears the visual device and checks the guidance information.

[1411] Input: Guidance information presented through visual devices

[1412] Output: Move based on visual guidance information

[1413] For example, the driver confirms the direction of travel by following the arrow displayed on the visual device.

[1414] Step 5: Real-time updates and rerouting

[1415] server

[1416] The server continuously collects real-time traffic, congestion, and weather data and updates the database, reevaluating and recalculating routes as needed.

[1417] Input: Latest traffic data, congestion data, weather data

[1418] Output: Updated database, recalculated route information if necessary

[1419] For example, recalculations are made such as "There will be delays on the Yamanote Line" or "The new Chuo Line route is optimal."

[1420] server

[1421] The updated route guidance information is sent to the terminal.

[1422] Input: Recalculated route information

[1423] Output: Updated route information sent to the device

[1424] Terminal

[1425] The terminal receives the updated information from the server and transmits it back to the vision device.

[1426] Input: Updated route information received from the server

[1427] Output: Updated path information sent to the vision device

[1428] User

[1429] The user reviews the updated guidance information and follows the appropriate route.

[1430] Input: Updated route information displayed on a visual device

[1431] Output: Move based on updated guidance information

[1432] For example, follow new instructions such as "Avoid delays on the Yamanote Line and use the Chuo Line."

[1433] By following the above steps, the present invention can provide the user with optimal route guidance that reflects the latest traffic and weather information, allowing the user to smoothly reach their destination even in places with unstable communication environments.

[1434] (Application example 1)

[1435] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1436] In recent years, advances in autonomous driving technology have led to an increasing demand for vehicle navigation systems. However, existing systems often lack the ability to update information in locations with unstable communication environments or provide optimal route guidance in real time. Furthermore, there are limited means to intuitively and efficiently provide route guidance information to help users reach their destinations. Therefore, there is a need for a system that can collect and update information on traffic volume, congestion, weather, and other factors in real time, and provide appropriate route guidance to autonomous vehicles.

[1437] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1438] In this invention, the server includes: means for acquiring current location information; means for acquiring destination information; means for calculating an optimal route based on the current location information and the destination information; a display device for visually providing route guidance even in locations with an unstable communication environment; means for transmitting route guidance information to the display device; means for visually presenting the route guidance information to the user; means for collecting and updating traffic volume, congestion, and weather information in real time; means for reevaluating the calculated route based on the collected information and recalculating the route as necessary; means for integrating the real-time route guidance information into the control system of the autonomous vehicle; and means for displaying the received route guidance information on a smart display of the autonomous vehicle. This enables a system that enables users to efficiently reach their destination even in locations with an unstable communication environment.

[1439] The "means for acquiring current location information" refers to a device or method for identifying the user's current location and providing that information to the system.

[1440] The "means for acquiring destination information" refers to a device or method for collecting destination information set by the user and importing that data into the system.

[1441] The "means for calculating the optimum route" is a device or method for calculating the optimum travel route based on current location information and destination information, taking into consideration traffic volume, congestion, and weather information.

[1442] A "display device for visually providing route guidance even in locations where the communication environment is unstable" is a device that provides users with visual route guidance even in situations where communication is unstable.

[1443] The "means for transmitting route guidance information to a display device" is a device or method for transmitting optimal route guidance information to a display device.

[1444] The "means for visually presenting route guidance information to a user" refers to a device or method for visually displaying the transmitted route guidance information to a user.

[1445] "Means for collecting and updating traffic volume, congestion status, and weather information in real time" refers to a device or method for constantly collecting the latest traffic volume, congestion status, and weather information and updating the data within the system.

[1446] "Means for re-evaluating and, if necessary, recalculating the calculated route based on collected information" means a device or method for re-evaluating an existing route based on collected real-time information and re-calculating a new optimal route.

[1447] A "means for integrating real-time route guidance information into an automated vehicle control system" is a device or method that links a calculated optimal route to an automated vehicle control system.

[1448] "Means for displaying received route guidance information on the smart display of the autonomous vehicle" refers to a device or method for displaying optimal route guidance information on the smart display of the autonomous vehicle and providing it visually to the user.

[1449] MODE FOR CARRYING OUT THE INVENTION

[1450] A specific system configuration for implementing the present invention is shown below.

[1451] System Program Overview

[1452] server

[1453] The server processes data using the following hardware and software:

[1454] Hardware: High-performance server

[1455] Software: Database systems (e.g., PostgreSQL), traffic data APIs (e.g., Google Maps API, Here API), generative AI models (e.g., GPT-4)

[1456] The server performs the following data manipulation and calculations:

[1457] 1. Data Collection and Storage

[1458] The server periodically obtains traffic volume, congestion status, and weather information and stores it in a database. For this purpose, it uses a traffic data API.

[1459] 2. Route calculation

[1460] The server calculates the optimal route based on the current location and destination information sent by the user, using the latest traffic information, and employs a specific algorithm (e.g., Dijkstra, A).

[1461] 3. Real-time updates

[1462] The server reflects the information obtained in real time, reevaluates and recalculates the route, and always provides the latest route according to changes in traffic conditions.

[1463] Terminals (smartphones and display devices)

[1464] The smartphone and display device use the following hardware and software:

[1465] Hardware: Smartphone, display device (e.g. smart display)

[1466] Software: Dedicated app, GPS function

[1467] The terminal performs the following data manipulations and calculations:

[1468] 1. Obtaining location information

[1469] The smartphone uses its GPS function to obtain current location information and transmits it to the server.

[1470] 2. Enter and submit destination information

[1471] The user inputs their destination using a dedicated app, and the input data is sent to the server.

[1472] 3. Visual route guidance

[1473] The smartphone that receives the optimal route information then sends the information to the smart display of the autonomous vehicle, where it is visually presented to the user.

[1474] Autonomous vehicle control system

[1475] Autonomous vehicles use the following hardware and software:

[1476] Hardware: Autonomous vehicle control systems, smart displays

[1477] Software: Operating systems for autonomous vehicles (e.g., Apollo, Autoware)

[1478] The vehicle's control system performs the following data processing and calculations:

[1479] 1. Route Integration

[1480] Real-time route guidance information sent from the server is integrated into the control system of the autonomous vehicle.

[1481] 2. Display route guidance

[1482] The received route guidance information is displayed on a smart display and provided to the user.

[1483] Specific examples

[1484] As a specific example, a scenario will be described in which a user uses an autonomous vehicle to travel from their home to a station.

[1485] 1. The user opens the dedicated app on their smartphone, enables the GPS function, and enters the destination from "home" to "station."

[1486] 2. The vehicle's control server receives the current location and destination data and calculates the optimal route.

[1487] 3. The vehicle is now instructed on the quickest route, avoiding busy roads, and the information is displayed on the smart display.

[1488] 4. Users can visually check the smart display in the vehicle, relax and enjoy the journey.

[1489] This system allows users to reach their destination efficiently even in areas with unstable communication environments. It also provides the most optimal route based on the latest traffic information, making for a more comfortable and stress-free travel experience.

[1490] Example prompt sentence:

[1491] A user opens a smartphone app and wants to set up route guidance from their current location (home) to their destination (train station). The app should use GPS data to determine their current location, calculate the optimal route based on the latest traffic information, and display it on the autonomous vehicle's smart display. Write program code to monitor traffic volume, weather, and congestion conditions in real time, and reevaluate and recalculate as necessary.

[1492] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1493] Step 1:

[1494] Initial Setup and Data Collection

[1495] The server periodically collects data such as traffic volume, congestion status, and weather information, and stores it in a database. For this purpose, a traffic data API (e.g., Google Maps API, Here API) is used. The server receives this data as input and processes it to store it in the database. The input data is traffic volume data, congestion status data, and weather data, and it quickly imports this data and performs data processing and storage operations to store it in the database. As an output, the latest traffic information is accumulated in the database.

[1496] Step 2:

[1497] Acquiring and sending location information

[1498] The device (smartphone) obtains current location information when the user launches a dedicated app and enables the GPS function. The user then enters their destination into the smartphone app and sends that information to the server. The input data is the user's current location and destination, and the current location information obtained from the GPS device and the destination information entered by the user into the app are sent to the server. This inputs the location information data on the server side, and the server is ready to perform processing based on that information.

[1499] Step 3:

[1500] Calculating the best route

[1501] The server calculates the optimal route by retrieving the latest traffic volume, congestion, and weather information from a database based on the current location and destination information sent from the terminal. Here, a specific algorithm (e.g., Dijkstra, A) is used to perform data calculations. The input data is the current location information, destination information, and the latest traffic information, and the output is optimal route information. This route information includes specific travel instructions such as route selection and travel time prediction.

[1502] Step 4:

[1503] Send directions

[1504] The server generates calculated optimal route guidance information and sends the data to the terminal. The input data is the optimal route information, and the generated visual guidance data (e.g., arrows and movement instructions) is sent. As an output, the route guidance information is sent to the terminal and used for subsequent processing.

[1505] Step 5:

[1506] Visual directions

[1507] The terminal sends the received route guidance information to the smart display of the autonomous vehicle and presents it visually to the user. The input data is the route guidance information sent from the server, and the terminal sends the data to the display and processes it for display. The output is the route guidance displayed on the smart display, and the user follows it to move.

[1508] Step 6:

[1509] Real-time information gathering and updating

[1510] The server continues to collect traffic volume, congestion status, and weather information in real time and updates the database. The input data is new information obtained from the traffic data API, and the database is updated based on this. The output is the latest traffic information stored in the database, which is always kept up to date.

[1511] Step 7:

[1512] Reevaluate and recalculate routes

[1513] The server reevaluates the existing route based on the updated information in real time and recalculates a new optimal route if necessary. Here, the algorithm is used again to calculate the data. The input data is the updated traffic information, and the output is the recalculated new optimal route information. This newly calculated route guidance information is then sent to the terminal again.

[1514] Step 8:

[1515] View updated directions

[1516] The terminal receives the updated route guidance information sent again from the server and displays it on the smart display of the autonomous vehicle. The input data is the updated route guidance information from the server, which is displayed on the display. As an output, the user can continue traveling along the appropriate route based on the updated guidance information.

[1517] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1518] To specifically implement this invention, we will explain the system configuration and operation using the following means and steps. This system includes a combination of means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route, an eyeglass device for visually guiding a route even in places with an unstable communication environment, means for transmitting route guidance information to the eyeglass device, means for visually presenting a route to a user, means for collecting and updating traffic volume, congestion status, and weather information in real time, means for recalculation, and an emotion engine.

[1519] Initial Setup Procedure

[1520] server

[1521] The server periodically obtains traffic data, public transport congestion data, weather data, etc. from various APIs and stores it in a database.

[1522] The server receives a request for current location and destination information from the user's smartphone and prepares to calculate the optimal route.

[1523] Terminal

[1524] When the dedicated app is launched, the device enables the GPS function and prepares to obtain the user's current location information.

[1525] User

[1526] The user launches a dedicated app on their smartphone and enters destination information.

[1527] Acquiring and sending location information

[1528] Terminal

[1529] When the user inputs destination information, the terminal uses GPS to identify the current location and sends it to the server.

[1530] server

[1531] The server analyzes the current location information and destination information received from the device and prepares to calculate the optimal route.

[1532] Optimal route calculation and guidance

[1533] server

[1534] The server retrieves the latest traffic, congestion and weather data from a database and runs an algorithm to calculate the optimal route based on this.

[1535] For example, if it is determined that using the Yamanote Line is the best route to take when traveling from Shinjuku Station to Shibuya Station, this route will be selected.

[1536] server

[1537] After the optimal route is determined, visual guidance data is generated and transmitted to the terminal.

[1538] Emotion recognition and guidance adjustment

[1539] Eyeglasses Device

[1540] The glasses device is equipped with an emotion engine that analyzes the user's facial expressions and recognizes their emotions. This emotion engine analyzes the user's emotions (e.g., tension, anxiety, joy) in real time.

[1541] server

[1542] The system receives user emotion data sent from the emotion engine and adjusts the content and display of route guidance. For example, if the user is nervous, the system displays guidance information more simply and clearly.

[1543] Get directions

[1544] Terminal

[1545] The terminal transmits visual guidance to a dedicated eyeglass device based on the route guidance data and emotion recognition data received from the server.

[1546] User

[1547] The user checks the visual guidance information displayed through the glasses device and travels according to the presented route. The guidance information, which is mitigated by the emotion engine, reduces stress during travel.

[1548] Real-time updates and rerouting

[1549] server

[1550] The server collects real-time traffic, congestion, and weather data and updates the database. If new delays or congestion information is discovered, the optimal route is recalculated.

[1551] server

[1552] Send updated route guidance information to the device.

[1553] Terminal

[1554] The terminal transmits the updated information received from the server again to the dedicated glasses device.

[1555] User

[1556] The user continues to move along the appropriate route based on guidance information updated in real time, and the emotion engine continuously adjusts the guidance information according to changes in the user's emotions.

[1557] Specific examples

[1558] 1. Initial Setup and Data Collection

[1559] The user arrives at Shinjuku Station and launches a dedicated app to head to Shibuya Station.

[1560] The device uses GPS to notify the server that it is at Shinjuku Station.

[1561] The server collects the latest traffic conditions and congestion information between Shinjuku Station and Shibuya Station and stores it in a database.

[1562] 2. Route calculation and guidance

[1563] Once the user enters their destination, the server calculates the optimal route and generates visual guidance data, such as the best train transfer information from Shinjuku Station to Shibuya Station.

[1564] The generated guidance information is transmitted to the terminal, which then displays it on the dedicated glasses device.

[1565] 3. Emotion recognition and regulation

[1566] While the user is moving, the emotion engine analyzes the user's facial expressions in real time to detect tension or anxiety.

[1567] The server then simplifies the guidance information accordingly, making it easier to understand, and simultaneously displays multimedia content that has a relaxing effect.

[1568] 4. Real-time updates and rerouting

[1569] When a user boards the Yamanote Line from Shinjuku Station, the server analyzes traffic data in real time to check delays and congestion.

[1570] If the Yamanote Line is delayed, the server calculates an alternative route and suggests a new route, for example using another line. This information is sent to the terminal and displayed again on the glasses device, allowing the user to follow the new route.

[1571] This system allows users to receive optimal navigation in real time, even in areas with unstable communication environments. The emotion engine analyzes the user's emotions and provides appropriately adjusted guidance information, reducing stress during travel. The system also responds to changes in traffic conditions and weather, ensuring smooth travel.

[1572] The processing flow will be explained below.

[1573] Step 1:

[1574] User

[1575] The user launches a dedicated app on their smartphone and enters destination information.

[1576] Step 2:

[1577] Terminal

[1578] The device enables the GPS function to obtain the user's current location information.

[1579] The terminal transmits the acquired current location information and destination information to the server.

[1580] Step 3:

[1581] server

[1582] The server analyzes the current location information and destination information received from the terminal.

[1583] The server retrieves the latest traffic, congestion and weather data from a database.

[1584] Based on this information, an algorithm is run to calculate the optimal route.

[1585] Step 4:

[1586] server

[1587] Visual guidance data is generated based on the calculated optimal route.

[1588] The generated visual guidance data is transmitted to the terminal.

[1589] Step 5:

[1590] Terminal

[1591] The terminal transmits the visual guidance data received from the server to a dedicated glasses device.

[1592] Step 6:

[1593] User

[1594] The user checks the visual guidance information displayed through the glasses device and moves according to the presented route.

[1595] Step 7:

[1596] Eyeglasses Device

[1597] The emotion engine installed in the glasses device analyzes the user's facial expressions in real time.

[1598] The emotion engine recognizes the user's emotions (e.g., tension, anxiety, joy).

[1599] Step 8:

[1600] server

[1601] The server receives the user's emotional data sent from the emotion engine and adjusts the content and display method of the guidance. For example, if the user is nervous, the guidance information will be displayed more simply and clearly.

[1602] Step 9:

[1603] server

[1604] The server collects real-time traffic, congestion and weather data and updates the database.

[1605] If new delay or congestion information is discovered, the server will recalculate the optimal route.

[1606] Step 10:

[1607] server

[1608] The server sends updated route guidance information to the terminal.

[1609] Step 11:

[1610] Terminal

[1611] The terminal transmits the update information received from the server to the glasses device again.

[1612] Step 12:

[1613] User

[1614] Users can view real-time updated guidance information and continue traveling based on the appropriate route.

[1615] The emotion engine of the glasses device continues to adjust the guidance information according to changes in the user's emotions.

[1616] These steps allow users to receive optimal navigation in real time even in places with unstable communication environments. Furthermore, the emotion engine analyzes the user's emotions and provides appropriately tailored guidance information, reducing stress during travel and ensuring a smooth journey.

[1617] Example 2

[1618] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1619] Conventional navigation systems are not capable of handling unstable communication environments, unexpected congestion, or sudden changes in weather. Furthermore, they do not provide guidance information that takes into account the user's emotions, making it difficult for users to reach their destination without stress.

[1620] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: means for acquiring current location information; means for acquiring destination information; means for calculating an optimal route based on the current location information and the destination information; a head-mounted display for visually providing route guidance even in places with an unstable communication environment; means for transmitting route guidance information to the head-mounted display; means for visually presenting the route guidance information to the user; means for collecting and updating traffic volume, congestion status, and weather information in real time; means for reevaluating the calculated route based on the collected information and recalculating the route as necessary; and means for analyzing the user's emotions and adjusting the route guidance information. This enables optimal navigation in real time even in places with an unstable communication environment, and by providing guidance information that takes the user's emotions into consideration, stress during travel is reduced and smooth travel is achieved.

[1621] "Current location information" is location data that indicates the user's current location and is obtained using GPS or other location information services.

[1622] "Destination information" is location data indicating where the user wants to go, which is manually entered by the user or obtained by other means.

[1623] "Means for calculating the optimal route" refers to an algorithm or system that calculates the route that will allow the user to reach their destination most efficiently, based on current location information and destination information, taking into account traffic volume, congestion, weather information, etc.

[1624] A "head-mounted display" is a display device that is worn on the user's head and is a device for visually presenting information.

[1625] The "means for transmitting route guidance information" refers to a communication means for transferring the calculated optimal route information to a head-mounted display or other presentation device.

[1626] The term "means for visually presenting to the user" refers to a method or device for displaying the calculated route information so that the user can visually confirm it.

[1627] "Means of collecting and updating traffic, congestion, and weather information in real time" refers to a system or method that obtains current traffic, congestion, and weather conditions from external sources at any time and reflects them in a database.

[1628] "Means for re-evaluating and recalculating routes" refers to algorithms or systems that review existing routes and, if necessary, calculate new optimal routes based on new information collected in real time.

[1629] "Means for analyzing user emotions" refers to a system or algorithm that analyzes the user's facial expressions and behavior using sensors or other devices to determine the user's current emotional state (e.g., tension, anxiety, joy).

[1630] "Means for adjusting route guidance information" refers to a system or method that changes the display content and presentation method of guidance information based on the results of user emotion analysis, and provides information in an optimal form to the user.

[1631] To specifically implement this invention, a system configuration and its operation using the following means and steps will be described. This system includes a combination of means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route, a head-mounted display for visually guiding the route even in places with an unstable communication environment, means for transmitting route guidance information to the head-mounted display, means for visually presenting the route to the user, means for collecting and updating traffic volume, congestion status, and weather information in real time, means for reevaluating and recalculating, and an emotion engine.

[1632] Initial Setup

[1633] server

[1634] The server periodically obtains traffic data, public transport congestion data, weather data, etc. from various APIs (such as Google Maps API and OpenWeatherMap API) and stores them in a database. The server receives requests for current location and destination information from the user's smartphone and prepares to calculate the optimal route.

[1635] Terminal

[1636] When the dedicated app is launched, the device activates the GPS function and prepares to obtain the user's current location information, for example, by using the location information services of Android or iOS.

[1637] User

[1638] The user launches a dedicated smartphone app and enters destination information, including manually entering the destination into the app's input form.

[1639] Acquiring and sending location information

[1640] Terminal

[1641] When the user inputs destination information, the device uses GPS to identify the current location and sends it to the server. Specifically, the device sends the current location information to the server as JSON format data.

[1642] server

[1643] The server analyzes the current location information and destination information received from the device, temporarily stores it in a database, and prepares it for analysis.

[1644] Calculating the best route

[1645] server

[1646] The server retrieves the latest traffic volume, congestion, and weather data from the database and runs an algorithm to calculate the optimal route based on this. Specifically, it uses route optimization algorithms such as Dijkstra and A. For example, when calculating a route from Shinjuku Station to Shibuya Station, the Yamanote Line is determined to be the best route, taking into account the current traffic conditions.

[1647] Generate and send visual guidance

[1648] server

[1649] After determining the optimal route, visual guidance data is generated and sent to the device, including map images and text directions.

[1650] Emotion recognition and guidance adjustment

[1651] Eyeglasses Device

[1652] The glasses device is equipped with an emotion engine that analyzes the user's facial expressions and recognizes their emotions. This emotion engine analyzes the user's emotions (e.g., tension, anxiety, joy) in real time. It detects smiles and wrinkles between the eyebrows to analyze the level of tension or relief.

[1653] server

[1654] The server receives the user's emotion data sent from the emotion engine and adjusts the content and display method of route guidance. Specifically, if it detects a state of tension, it generates simplified guidance.

[1655] Get directions

[1656] Terminal

[1657] The device sends visual guidance to a dedicated eyeglass device based on route guidance data and emotion recognition data received from the server. For example, if the user is nervous, specific and simple direction instructions will be displayed.

[1658] User

[1659] The user checks the visual guidance information displayed through the glasses device and travels according to the presented route. The guidance information displayed is appropriately adjusted by the emotion engine, reducing stress during travel.

[1660] Real-time updates and rerouting

[1661] server

[1662] The server collects real-time traffic, congestion, and weather data and updates the database. For example, if the Yamanote Line is delayed, the server recalculates the route based on the new data and suggests an alternative route.

[1663] server

[1664] Send updated route guidance information to the device.

[1665] Terminal

[1666] The terminal transmits the update information received from the server again to the dedicated glasses device.

[1667] User

[1668] The user continues to navigate along the appropriate route based on guidance information updated in real time, and the emotion engine responds to changes in the user's emotions and continuously adjusts the guidance information.

[1669] Specific examples

[1670] 1. Initial Setup and Data Collection

[1671] The user arrives at Shinjuku Station and launches a dedicated app to head to Shibuya Station.

[1672] The device uses GPS to notify the server that it is at Shinjuku Station.

[1673] The server collects the latest traffic conditions and congestion information between Shinjuku Station and Shibuya Station and stores it in a database.

[1674] 2. Route calculation and guidance

[1675] Once the user enters their destination, the server calculates the optimal route and generates visual guidance data, such as the best train transfer information from Shinjuku Station to Shibuya Station.

[1676] The generated guidance information is transmitted to the terminal, which then displays it on the dedicated glasses device.

[1677] 3. Emotion recognition and regulation

[1678] While the user is moving, the emotion engine analyzes the user's facial expressions in real time to detect tension or anxiety.

[1679] The server then simplifies the guidance information accordingly, making it easier to understand, and simultaneously displays multimedia content that has a relaxing effect.

[1680] 4. Real-time updates and rerouting

[1681] When a user boards the Yamanote Line from Shinjuku Station, the server analyzes traffic data in real time to check delays and congestion.

[1682] If the Yamanote Line is delayed, the server calculates an alternative route and suggests a new route, for example using another line. This information is sent to the terminal and displayed again on the glasses device, allowing the user to follow the new route.

[1683] Prompt Sentence Examples

[1684] Example of initial setting: "Arrived at Shinjuku Station. Prepare to calculate the optimal route to Shibuya Station."

[1685] Example of location information transmission: "After entering a destination, send the current location to the server using GPS."

[1686] Route guidance example: "Calculating the optimal route from Shinjuku Station to Shibuya Station and generating visual guidance"

[1687] Emotion recognition example: "Recognize emotions while traveling and adjust guidance information"

[1688] Example of real-time update: "Yamanote Line is delayed. An alternative route will be calculated and displayed on the glasses device."

[1689] This system allows users to receive optimal navigation in real time, even in areas with unstable communication environments. The emotion engine analyzes the user's emotions and provides appropriately adjusted guidance information, reducing stress during travel. The system also responds to changes in traffic conditions and weather, ensuring smooth travel.

[1690] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1691] Processing Steps

[1692] Step 1: Initial Setup

[1693] server

[1694] The server periodically obtains traffic volume, congestion status of public transport, and weather data using various APIs and stores them in a database. Specifically, it obtains traffic data from the Google Maps API, congestion data from the public transport API, and weather data from the OpenWeatherMap API. This allows the server to maintain the latest information.

[1695] Terminal

[1696] When the dedicated app installed on the device is launched, it activates the GPS function and prepares to obtain the user's current location information. Specifically, it uses the location information services of Android and iOS to identify the user's current location.

[1697] User

[1698] The user starts the dedicated app and enters the destination in text format, which prepares the app to send the destination information to the server.

[1699] Step 2: Obtaining and sending location information

[1700] Terminal

[1701] When the user enters destination information and presses the send button, the device uses GPS to obtain current location information. This obtained current location information is converted into JSON format and sent to the server along with the destination information. This allows the server to grasp the user's current location and destination.

[1702] server

[1703] The server analyzes the current location and destination information received from the device and temporarily stores it in a database, so that the server has all the data necessary to calculate the next route.

[1704] Step 3: Calculate the optimal route

[1705] server

[1706] The server retrieves the latest traffic volume, congestion, and weather data from the database and calculates the optimal route based on this data. Specifically, it uses route optimization algorithms such as Dijkstra and A. This algorithm calculates the route that will allow the user to reach the destination in the shortest and most optimal time based on the input current location, destination, and the latest traffic information. After calculation, the optimal route information is generated and saved on the server in JSON format.

[1707] Step 4: Generate and send visual guidance

[1708] server

[1709] After the optimal route is calculated, the server generates visual guidance data, including map images and text directions. The generated guidance data is sent to the device, allowing the user to receive guidance information that is easy to understand visually.

[1710] Step 5: Emotion recognition and guidance adjustment

[1711] Eyeglasses Device

[1712] The glasses device is equipped with an emotion engine that analyzes the user's facial expressions in real time to detect emotions such as tension or anxiety. For example, by detecting smiles and frowns, the emotional state can be quantified.

[1713] server

[1714] The server receives the user's emotion data sent from the emotion engine and adjusts the content and display method of the route guidance. Specifically, if tension is detected, the guidance information is simplified and simpler direction instructions are generated. This adjusted guidance information is then sent back to the device.

[1715] Step 6: Get directions

[1716] Terminal

[1717] The device sends visual guidance to the dedicated eyeglasses device based on the route guidance data and emotion recognition data received from the server. Specifically, it provides more specific and concise guidance information to users who are nervous.

[1718] User

[1719] The user checks the visual guidance information displayed through the glasses device and begins moving. By following the guidance information appropriately adjusted by the emotion engine, the user can reduce stress during their journey.

[1720] Step 7: Real-time updates and rerouting

[1721] server

[1722] The server collects real-time traffic, congestion, and weather data and updates the database. For example, if a particular route is delayed, the server recalculates the optimal route based on the new information.

[1723] server

[1724] The updated route guidance information is then sent back to the terminal, allowing the user to always receive optimal route guidance.

[1725] Terminal

[1726] The terminal then sends the updated information received from the server back to the dedicated eyeglass device, allowing the user to check the latest guidance information in real time.

[1727] User

[1728] The user continues traveling along the appropriate route based on the updated guidance information. The emotion engine responds to the user's emotional changes and continuously adjusts the guidance information, further reducing stress during travel.

[1729] This allows users to receive optimal navigation in real time even in places with unstable communication environments, and the emotion engine provides guidance information that corresponds to the user's emotions, allowing them to travel with peace of mind.

[1730] (Application example 2)

[1731] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1732] Food delivery services require drivers to be provided with optimal route guidance in real time to ensure they deliver efficiently and safely. There are also concerns that drivers' emotional states can increase stress and compromise safety. Therefore, by analyzing drivers' emotional states and providing appropriate guidance information, it is necessary to reduce driving stress and improve safety and efficiency.

[1733] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route, viewing means, means for transmitting route guidance information, means for visually presenting the route guidance information to the user, means for collecting and updating traffic volume, congestion status, and weather information, means for reevaluating the calculated route based on the collected information and recalculating the route as necessary, means for analyzing the user's emotional state, and means for adjusting the content and display method of the route guidance information based on the analyzed emotional state. This not only enables the driver to receive optimal navigation in real time, but also reduces stress by providing information tailored to the driver's emotions, enabling safe and efficient delivery.

[1734] "Current location information" is location data of the user's current location.

[1735] "Destination information" is location data of a place where the user wants to go.

[1736] The "optimal route" is the most efficient route based on current location information and destination information, taking into account traffic conditions and weather information.

[1737] An "eyeglass device" is a wearable device that is worn by a user and is used for the purpose of visually displaying information.

[1738] "Route guidance information" is navigation data presented to the user based on a calculated optimal route.

[1739] "Visual guidance" is a means of visually presenting route guidance information to a user, and is information displayed through an eyeglass device.

[1740] "Traffic volume information" refers to data on the flow of vehicles and congestion on roads and transportation infrastructure.

[1741] "Crowding information" is data on crowd density and waiting times on public transport or in specific areas.

[1742] "Weather information" is data about current and forecast weather.

[1743] "Recalculation" is the process of reviewing current plans based on new information and making necessary adjustments.

[1744] "Emotional state" is data that indicates the psychological or emotional state of a user.

[1745] "Emotion analysis" is the process of determining a user's emotional state using sensors and data analysis techniques.

[1746] The following describes an embodiment of the present invention. The present invention is a navigation system for enabling drivers in food delivery services to deliver food efficiently and safely. Specifically, the system provides optimal route guidance calculated based on current location information and destination information, and adjusts guidance information appropriately by analyzing the driver's emotional state.

[1747] 1. Hardware Configuration

[1748] - Server: Periodically obtains traffic data, public transport congestion data, weather data, etc. from various APIs (e.g. traffic data API, weather data API) and stores it in a database. Receives requests for user current location and destination information and calculates the optimal route.

[1749] - Device: On the driver's smartphone, start the dedicated app and enable the GPS function to obtain current location information.

[1750] - Eyeglasses devices: Smart glasses (e.g., Google Glass) are used to visually present route guidance information.

[1751] 2. Software Configuration

[1752] - Route calculation algorithm: Software that calculates the optimal route on the server side based on current location information, destination information, and traffic volume, congestion, and weather information collected in real time.

[1753] - Emotion Analysis Engine: Software that uses the built-in camera of the glasses device to collect data on the user's facial expressions and analyze their emotional state (e.g., tension, anxiety, joy). It then adjusts the guidance information based on the emotional data.

[1754] 3. Specific Examples

[1755] For example, a delivery driver launches a dedicated app on their smartphone and enters the customer's address as the destination. The smart glasses automatically connect to GPS to obtain the driver's current location information. The server calculates the optimal route based on real-time traffic and weather information and sends this information to the smart glasses. While the driver is driving, the smart glasses' camera sends the driver's face to an emotion analysis engine, and route guidance information is displayed according to the driver's emotional state. For example, if the driver is nervous, the guidance information is simplified. Furthermore, if the route is changed in real time, new route guidance is provided in a timely manner, allowing the driver to reach their destination smoothly.

[1756] 4. Examples of prompts

[1757] The following example prompt sentences could be considered as input to the generating AI model:

[1758] "I would like to develop an application for smart glasses that provides emotion analysis and real-time route guidance for delivery drivers. Please provide a concrete implementation example and code for a system that combines appropriate route calculation, traffic information collection, and emotion recognition to help drivers reach their destinations without stress."

[1759] This invention allows delivery drivers to receive optimal navigation in real time even in places with unstable communication environments, and provides information based on emotion analysis, reducing stress, enabling safe and efficient deliveries.

[1760] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1761] Step 1:

[1762] The user launches the delivery app on their smartphone and enters the customer's address as the destination. The entered destination information is saved as internal data on the smartphone.

[1763] Step 2:

[1764] The device enables the GPS function and acquires the current location information. The acquired current location information is sent to the server. The input is the device's GPS data, and the output is the current location information sent to the server.

[1765] Step 3:

[1766] The server receives the current location and destination information sent from the device and calculates the optimal route based on this. The calculation algorithm uses real-time traffic volume data, congestion data, and weather data. The inputs are current location information, destination information, traffic data, congestion data, and weather data, and the output is optimal route information.

[1767] Step 4:

[1768] The server generates optimal route information and sends it to the terminal. The input is the optimal route information, and the output is the route guidance data sent to the terminal.

[1769] Step 5:

[1770] The terminal transmits the received route guidance data to the smart glasses device and visually displays the route guidance. Specifically, the route information is displayed on the display of the glasses device. The input is the route guidance data from the server, and the output is the information displayed on the smart glasses.

[1771] Step 6:

[1772] When the user starts driving, the camera in the smart glasses analyzes the user's facial expressions in real time and sends them to the emotion engine. The input is the facial expression data captured by the camera, and the output is the emotional state.

[1773] Step 7:

[1774] The server receives the emotional state data sent from the emotion engine and adjusts the content and display method of the route guidance information based on that data. For example, if the user is in a tense state, the server displays route guidance information in a simpler and easier-to-understand manner. The input is the emotional state data, and the output is the adjusted route guidance information.

[1775] Step 8:

[1776] The server collects traffic, congestion, and weather data in real time and recalculates the optimal route as needed. When new route guidance information is generated, it is sent to the device and displayed on the smart glasses. The input is the latest traffic and weather data and the recalculated route, and the output is the updated route guidance information.

[1777] Step 9:

[1778] The user continues driving according to the latest route guidance information displayed on the smart glasses. The emotion engine continuously monitors the user's emotional state in real time and adjusts the guidance information again as necessary. The input is continuous emotional state data, and the output is continuously adjusted route guidance information.

[1779] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1780] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1781] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1782] [Fourth embodiment]

[1783] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1784] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1785] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1786] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1787] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1788] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1789] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1790] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1791] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1792] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1793] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1794] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1795] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1796] In order to implement this invention, a specific system configuration and its operation using the following means will be described. This system includes a means for acquiring current location information, a means for acquiring destination information, a means for calculating an optimal route, an eyeglass device for visually guiding a route even in places with an unstable communication environment, a means for transmitting route guidance information to the eyeglass device, a means for visually presenting a route to a user, a means for collecting and updating traffic volume, congestion status, and weather information in real time, and a means for reevaluating and recalculating. Below, specific examples of each step and program processing are explained in natural language.

[1797] Initial Setup Procedure

[1798] server

[1799] The server periodically collects data on traffic volume, congestion, weather, delays, etc. This data is obtained from various APIs and stored in a database.

[1800] The server prepares to obtain current location and destination information in response to a request from the user's smartphone.

[1801] Terminal

[1802] The device will launch a dedicated app and enable the GPS function to prepare to obtain current location information.

[1803] User

[1804] The user launches a dedicated app on their smartphone and enters their destination.

[1805] Acquiring and sending location information

[1806] Terminal

[1807] When the user enters a destination, the device uses GPS to determine the current location, and this information is sent to the server.

[1808] server

[1809] The server receives the current location and destination information sent from the device and prepares to calculate the optimal route.

[1810] Optimal route calculation and guidance

[1811] server

[1812] The server retrieves the latest traffic, congestion, and weather information from a database, and then uses a specific algorithm to calculate the optimal route.

[1813] For example, if a route from Shinjuku Station to Shibuya Station is calculated and it is determined that the route using the Yamanote Line is optimal, that route is selected.

[1814] server

[1815] After the optimal route is determined, visual guidance data (e.g., arrows and movement instructions) is generated and sent to the device.

[1816] Terminal

[1817] The terminal transmits the received route guidance information to a dedicated eyeglass device.

[1818] User

[1819] The user checks the guidance information visually displayed through the eyeglass device and moves along the presented route.

[1820] Real-time updates and rerouting

[1821] server

[1822] The server continues to collect real-time data on traffic volume, congestion, weather, and other factors and updates the database, thereby maintaining the most up-to-date information.

[1823] If new delays or congestion occur, the route will be reevaluated and recalculated.

[1824] server

[1825] By sending updated route guidance information to the terminal, the latest travel information is provided to the user.

[1826] Terminal

[1827] The terminal receives the updated information from the server and transmits it again to the dedicated glasses device.

[1828] User

[1829] The user continues to travel along the appropriate route based on guidance information updated in real time.

[1830] Specific examples

[1831] 1. Initial Setup and Data Collection

[1832] The user arrives at Shinjuku Station and launches a dedicated app to head to Shibuya Station.

[1833] The device uses GPS to notify the server that the user is at Shinjuku Station.

[1834] The server collects the latest traffic conditions and congestion information between Shinjuku Station and Shibuya Station and stores it in a database.

[1835] 2. Route calculation and guidance

[1836] When a user inputs their destination, the server calculates the optimal route and generates visual guidance data, such as suggesting a route from Shinjuku Station to Shibuya Station using the Yamanote Line.

[1837] The generated guidance information is transmitted to the terminal, which then presents it to the user by displaying it on a dedicated eyeglass device.

[1838] 3. Real-time updates and rerouting

[1839] When a user departs Shinjuku Station, the server analyzes traffic data to check for delays and congestion.

[1840] If the Yamanote Line is delayed, the server calculates an alternative route and suggests a new route, for example using another line. This information is sent to the terminal and displayed again on the glasses device, allowing the user to follow the new route.

[1841] This system allows users to reach their destination efficiently even in areas with unstable communication environments, providing a stress-free travel experience. Real-time updated data always presents the optimal route, supporting smooth travel for users.

[1842] The processing flow will be explained below.

[1843] Step 1:

[1844] User

[1845] The user launches a dedicated app on their smartphone and enters destination information.

[1846] Step 2:

[1847] Terminal

[1848] The device enables the GPS function to obtain the user's current location information.

[1849] Current location information and destination information are sent to the server.

[1850] Step 3:

[1851] server

[1852] The server analyzes the current location information and destination information received from the terminal.

[1853] The server retrieves the latest traffic, congestion, and weather information from a database.

[1854] Based on this information, an algorithm is run to calculate the optimal route.

[1855] Step 4:

[1856] server

[1857] Visual guidance data is generated based on the calculated optimal route.

[1858] The generated guidance data is transmitted to the terminal.

[1859] Step 5:

[1860] Terminal

[1861] The terminal transmits the visual guidance data received from the server to a dedicated glasses device.

[1862] Step 6:

[1863] User

[1864] The user checks the visual guidance information displayed through the glasses device.

[1865] The user follows the guidance information to head to the destination.

[1866] Step 7:

[1867] server

[1868] The server collects real-time traffic, congestion and weather data and updates the database.

[1869] If new delays or congestion occur, the server recalculates the optimal route.

[1870] Step 8:

[1871] server

[1872] Send updated route guidance information to the device.

[1873] Step 9:

[1874] Terminal

[1875] The terminal transmits the updated information received from the server again to the dedicated glasses device.

[1876] Step 10:

[1877] User

[1878] The user continues to travel along the appropriate route, following guidance information updated in real time.

[1879] These specific processing steps enable users to receive optimal navigation in real time even in places with unstable communication environments, and also enable smooth travel by adapting to changes in traffic conditions and weather.

[1880] Example 1

[1881] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1882] In systems that present and visually guide optimal routes based on the current location and destination, there is a need to establish technology that can update information and reroute in real time, even in places with unstable communication environments. Another issue is providing guidance that reflects the latest traffic and weather information so that users can travel efficiently from their current location to their destination.

[1883] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1884] In this invention, the server includes means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route based on the current location information and the destination information, a visual device for visually providing route guidance even in places with an unstable communication environment, means for transmitting route guidance information to the visual device, means for visually presenting the route guidance information to the user, means for collecting and updating traffic volume, congestion status, and weather information in real time, means for reevaluating the calculated route based on the collected information and recalculating the route as necessary, means for processing the collected data using a specific algorithm to derive an optimal route, and means for generating guidance information to be displayed on the visual device. This allows the user to always receive optimal route guidance based on the latest traffic and weather information, enabling them to smoothly reach their destination even in places with an unstable communication environment.

[1885] "Current location information" is data indicating the location where the user is located.

[1886] "Destination information" is data indicating the location where the user wants to arrive.

[1887] An "optimal route" is a route calculated to allow the user to travel efficiently from the current location to the destination.

[1888] A "visual device" is a device for providing visual information to a user.

[1889] "Route guidance information" is data such as instructions and maps to help the user navigate the most optimal route.

[1890] "Traffic volume" is data that indicates the number of vehicles or people on a particular road or route.

[1891] "Crowding" is data that shows the density of people and the difficulty of movement on public transportation or in specific locations.

[1892] "Weather information" is data that indicates the current weather and meteorological conditions.

[1893] An "algorithm" is a computational procedure or method used to solve a particular problem.

[1894] "Real-time" means being able to handle the latest information immediately.

[1895] The specific system configuration and operation for implementing this invention will be described below. This system provides the user with the optimal route from their current location to their destination, and supports efficient travel based on traffic and weather information updated in real time.

[1896] Hardware and software used

[1897] Hardware

[1898] Smartphones (portable information terminals)

[1899] GPS Modules

[1900] Visual devices (e.g., smart glasses)

[1901] software

[1902] Dedicated application (for smartphones)

[1903] Server software

[1904] Database (e.g. MySQL)

[1905] API (e.g. Google Maps API, Weather API)

[1906] Libraries (e.g. OpenCV)

[1907] Program processing

[1908] server

[1909] The server periodically collects data such as traffic volume, congestion, and weather information using an API and stores this data in a MySQL database.

[1910] The server receives the current location and destination information sent from the user's smartphone and retrieves the latest information from the database.

[1911] The server calculates the optimal route using Dijkstra's algorithm or A algorithm, and sends the generated visual guidance data to the smartphone.

[1912] The server collects new delay and congestion data in real time and reevaluates and recalculates routes as needed.

[1913] Terminal

[1914] The user launches a dedicated application, enables GPS, and obtains current location information.

[1915] The device sends the current location and destination information to the server.

[1916] The terminal receives the visual guidance data sent from the server and sends it to the visual device, which then presents the guidance information to the user.

[1917] User

[1918] The user launches a dedicated smartphone application and inputs their destination, such as "from Shinjuku Station to Shibuya Station."

[1919] The user wears a visual device and follows the guidance information to their destination, correcting their direction as needed based on the guidance information updated in real time.

[1920] Specific examples

[1921] 1. Data Collection

[1922] The server uses the Google Maps API to collect traffic data and store it in a database, and also uses the Weather API to collect current weather data.

[1923] Example: The server calls an API every hour to get the latest traffic and weather information and update the database.

[1924] 2. Route calculation and guidance

[1925] When a user enters "from Shinjuku Station to Shibuya Station" into the dedicated application, the device sends current location information and destination information to the server.

[1926] The server calculates the optimal route using the Dijkstra algorithm and A algorithm based on the latest traffic volume, congestion status, and weather information.

[1927] Example: From the database, it is determined that the Yamanote Line route from Shinjuku Station to Shibuya Station is optimal, and visual guidance data for that route is generated and sent to the terminal.

[1928] 3. Real-time updates

[1929] When a user departs Shinjuku Station, the server continuously collects traffic data and detects delays and changes in congestion.

[1930] Example: If there is a delay on the Yamanote Line, the server will calculate an alternative route using the Chuo Line and send the latest guidance information to the terminal.

[1931] Prompt Sentence Examples

[1932] A system description can be generated by inputting the following prompt sentence into the generative AI model:

[1933] Please explain in natural language the processing of the system's program. The system calculates the optimal route from the user's current location to their destination and provides visual guidance through a dedicated visual device. The hardware uses a smartphone and the visual device, and the software uses the Google Maps API and a MySQL database. The specific steps and process are shown below.

[1934] 1. Initial Setup Procedure

[1935] The server collects data from the Google Maps API and Weather API and stores it in a MySQL database.

[1936] It works in conjunction with the user's smartphone to prepare to obtain current location and destination information.

[1937] 2. Acquisition and transmission of location information

[1938] The device uses GPS to determine its current location and sends this information to the server.

[1939] 3. Calculation and guidance of optimal routes

[1940] The server obtains the latest traffic, congestion, and weather information and calculates the optimal route using Dijkstra's algorithm or A algorithm.

[1941] The calculated route guidance information is sent to the terminal and displayed on the visual device.

[1942] 4. Real-time updates and rerouting

[1943] The server collects data in real time and reevaluates and recalculates routes as needed.

[1944] Updates are sent to the terminal and displayed on the visual device.

[1945] This system ensures that users always have the most up-to-date information and the best route available.

[1946] In accordance with the above, this invention provides a multi-layered approach to help users reach their destinations efficiently. Real-time updated data allows users to always be presented with the most up-to-date and optimal route, supporting smooth travel even in areas with unstable communication environments.

[1947] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1948] Program processing steps

[1949] Step 1: Initial Setup

[1950] server

[1951] The server periodically collects traffic, congestion, and weather data using the Google Maps API and Weather API, and stores this data in a MySQL database.

[1952] Input: Traffic volume data, congestion data, and weather data obtained from the API

[1953] Output: Updated database

[1954] For example, you can call an API every hour to get the latest data for a specific region and store it in a database.

[1955] Terminal

[1956] Launch the dedicated application and enable GPS.

[1957] Input: User-initiated application launch

[1958] Output: GPS enabled device

[1959] User

[1960] The user launches a dedicated app on their smartphone and enters their destination.

[1961] Input: Enter your destination using the application

[1962] Output: Destination information is saved on the device

[1963] Step 2: Obtaining and sending location information

[1964] Terminal

[1965] The device uses GPS to obtain its current location information and sends this information to the server.

[1966] Input: Current location information via GPS

[1967] Output: Current location information sent to the server

[1968] For example, location information such as "current latitude: 35.6895, longitude: 139.6917" is obtained and sent to the server.

[1969] server

[1970] The server receives the current location information and destination information sent from the terminal.

[1971] Input: Current location and destination information sent from the device

[1972] Output: All the information necessary for route calculation is available

[1973] For example, you might receive data such as "Current location: 35.6895, 139.6917" and "Destination: 35.658, 139.701."

[1974] Step 3: Calculate the optimal route

[1975] server

[1976] The server retrieves the latest traffic, congestion, and weather information from the database and calculates the optimal route using Dijkstra's algorithm or A algorithm.

[1977] Input: Latest traffic volume data, congestion data, weather data, current location information, destination information

[1978] Output: Optimal route information

[1979] For example, it calculates results such as "The Yamanote Line route from Shinjuku Station to Shibuya Station is optimal."

[1980] Step 4: Generate and send visual guidance data

[1981] server

[1982] The server generates visual guidance data (e.g., arrows, movement instructions) based on the optimal route. Image data can be generated using libraries such as OpenCV.

[1983] Input: Optimal route information

[1984] Output: Visual guidance data

[1985] For example, image data including an arrow indicating the direction of travel and detailed station information is generated.

[1986] server

[1987] Visual guidance data is sent to the terminal.

[1988] Input: Visual guidance data

[1989] Output: Visual guidance data is sent to the terminal.

[1990] For example, the generated visual guide image is transmitted to the terminal.

[1991] Terminal

[1992] The terminal transmits the received visual guidance data to the visual device.

[1993] Input: Visual guidance data received from the server

[1994] Output: Visual guidance data sent to the vision device

[1995] User

[1996] The user wears the visual device and checks the guidance information.

[1997] Input: Guidance information presented through visual devices

[1998] Output: Move based on visual guidance information

[1999] For example, the driver confirms the direction of travel by following the arrow displayed on the visual device.

[2000] Step 5: Real-time updates and rerouting

[2001] server

[2002] The server continuously collects real-time traffic, congestion, and weather data and updates the database, reevaluating and recalculating routes as needed.

[2003] Input: Latest traffic data, congestion data, weather data

[2004] Output: Updated database, recalculated route information if necessary

[2005] For example, recalculations are made such as "There will be delays on the Yamanote Line" or "The new Chuo Line route is optimal."

[2006] server

[2007] The updated route guidance information is sent to the terminal.

[2008] Input: Recalculated route information

[2009] Output: Updated route information sent to the device

[2010] Terminal

[2011] The terminal receives the updated information from the server and transmits it back to the vision device.

[2012] Input: Updated route information received from the server

[2013] Output: Updated path information sent to the vision device

[2014] User

[2015] The user reviews the updated guidance information and follows the appropriate route.

[2016] Input: Updated route information displayed on a visual device

[2017] Output: Move based on updated guidance information

[2018] For example, follow new instructions such as "Avoid delays on the Yamanote Line and use the Chuo Line."

[2019] By following the above steps, the present invention can provide the user with optimal route guidance that reflects the latest traffic and weather information, allowing the user to smoothly reach their destination even in places with unstable communication environments.

[2020] (Application example 1)

[2021] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2022] In recent years, advances in autonomous driving technology have led to an increasing demand for vehicle navigation systems. However, existing systems often lack the ability to update information in locations with unstable communication environments or provide optimal route guidance in real time. Furthermore, there are limited means to intuitively and efficiently provide route guidance information to help users reach their destinations. Therefore, there is a need for a system that can collect and update information on traffic volume, congestion, weather, and other factors in real time, and provide appropriate route guidance to autonomous vehicles.

[2023] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2024] In this invention, the server includes: means for acquiring current location information; means for acquiring destination information; means for calculating an optimal route based on the current location information and the destination information; a display device for visually providing route guidance even in locations with an unstable communication environment; means for transmitting route guidance information to the display device; means for visually presenting the route guidance information to the user; means for collecting and updating traffic volume, congestion, and weather information in real time; means for reevaluating the calculated route based on the collected information and recalculating the route as necessary; means for integrating the real-time route guidance information into the control system of the autonomous vehicle; and means for displaying the received route guidance information on a smart display of the autonomous vehicle. This enables a system that enables users to efficiently reach their destination even in locations with an unstable communication environment.

[2025] The "means for acquiring current location information" refers to a device or method for identifying the user's current location and providing that information to the system.

[2026] The "means for acquiring destination information" refers to a device or method for collecting destination information set by the user and importing that data into the system.

[2027] The "means for calculating the optimum route" is a device or method for calculating the optimum travel route based on current location information and destination information, taking into consideration traffic volume, congestion, and weather information.

[2028] A "display device for visually providing route guidance even in locations where the communication environment is unstable" is a device that provides users with visual route guidance even in situations where communication is unstable.

[2029] The "means for transmitting route guidance information to a display device" is a device or method for transmitting optimal route guidance information to a display device.

[2030] The "means for visually presenting route guidance information to a user" refers to a device or method for visually displaying the transmitted route guidance information to a user.

[2031] "Means for collecting and updating traffic volume, congestion status, and weather information in real time" refers to a device or method for constantly collecting the latest traffic volume, congestion status, and weather information and updating the data within the system.

[2032] "Means for re-evaluating and, if necessary, recalculating the calculated route based on collected information" means a device or method for re-evaluating an existing route based on collected real-time information and re-calculating a new optimal route.

[2033] A "means for integrating real-time route guidance information into an automated vehicle control system" is a device or method that links a calculated optimal route to an automated vehicle control system.

[2034] "Means for displaying received route guidance information on the smart display of the autonomous vehicle" refers to a device or method for displaying optimal route guidance information on the smart display of the autonomous vehicle and providing it visually to the user.

[2035] MODE FOR CARRYING OUT THE INVENTION

[2036] A specific system configuration for implementing the present invention is shown below.

[2037] System Program Overview

[2038] server

[2039] The server processes data using the following hardware and software:

[2040] Hardware: High-performance server

[2041] Software: Database systems (e.g., PostgreSQL), traffic data APIs (e.g., Google Maps API, Here API), generative AI models (e.g., GPT-4)

[2042] The server performs the following data manipulation and calculations:

[2043] 1. Data Collection and Storage

[2044] The server periodically obtains traffic volume, congestion status, and weather information and stores it in a database. For this purpose, it uses a traffic data API.

[2045] 2. Route calculation

[2046] The server calculates the optimal route based on the current location and destination information sent by the user, using the latest traffic information, and employs a specific algorithm (e.g., Dijkstra, A).

[2047] 3. Real-time updates

[2048] The server reflects the information obtained in real time, reevaluates and recalculates the route, and always provides the latest route according to changes in traffic conditions.

[2049] Terminals (smartphones and display devices)

[2050] The smartphone and display device use the following hardware and software:

[2051] Hardware: Smartphone, display device (e.g. smart display)

[2052] Software: Dedicated app, GPS function

[2053] The terminal performs the following data manipulations and calculations:

[2054] 1. Obtaining location information

[2055] The smartphone uses its GPS function to obtain current location information and transmits it to the server.

[2056] 2. Enter and submit destination information

[2057] The user inputs their destination using a dedicated app, and the input data is sent to the server.

[2058] 3. Visual route guidance

[2059] The smartphone that receives the optimal route information then sends the information to the smart display of the autonomous vehicle, where it is visually presented to the user.

[2060] Autonomous vehicle control system

[2061] Autonomous vehicles use the following hardware and software:

[2062] Hardware: Autonomous vehicle control systems, smart displays

[2063] Software: Operating systems for autonomous vehicles (e.g., Apollo, Autoware)

[2064] The vehicle's control system performs the following data processing and calculations:

[2065] 1. Route Integration

[2066] Real-time route guidance information sent from the server is integrated into the control system of the autonomous vehicle.

[2067] 2. Display route guidance

[2068] The received route guidance information is displayed on a smart display and provided to the user.

[2069] Specific examples

[2070] As a specific example, a scenario will be described in which a user uses an autonomous vehicle to travel from their home to a station.

[2071] 1. The user opens the dedicated app on their smartphone, enables the GPS function, and enters the destination from "home" to "station."

[2072] 2. The vehicle's control server receives the current location and destination data and calculates the optimal route.

[2073] 3. The vehicle is now instructed on the quickest route, avoiding busy roads, and the information is displayed on the smart display.

[2074] 4. Users can visually check the smart display in the vehicle, relax and enjoy the journey.

[2075] This system allows users to reach their destination efficiently even in areas with unstable communication environments. It also provides the most optimal route based on the latest traffic information, making for a more comfortable and stress-free travel experience.

[2076] Example prompt sentence:

[2077] A user opens a smartphone app and wants to set up route guidance from their current location (home) to their destination (train station). The app should use GPS data to determine their current location, calculate the optimal route based on the latest traffic information, and display it on the autonomous vehicle's smart display. Write program code to monitor traffic volume, weather, and congestion conditions in real time, and reevaluate and recalculate as necessary.

[2078] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2079] Step 1:

[2080] Initial Setup and Data Collection

[2081] The server periodically collects data such as traffic volume, congestion status, and weather information, and stores it in a database. For this purpose, a traffic data API (e.g., Google Maps API, Here API) is used. The server receives this data as input and processes it to store it in the database. The input data is traffic volume data, congestion status data, and weather data, and it quickly imports this data and performs data processing and storage operations to store it in the database. As an output, the latest traffic information is accumulated in the database.

[2082] Step 2:

[2083] Acquiring and sending location information

[2084] The device (smartphone) obtains current location information when the user launches a dedicated app and enables the GPS function. The user then enters their destination into the smartphone app and sends that information to the server. The input data is the user's current location and destination, and the current location information obtained from the GPS device and the destination information entered by the user into the app are sent to the server. This inputs the location information data on the server side, and the server is ready to perform processing based on that information.

[2085] Step 3:

[2086] Calculating the best route

[2087] The server calculates the optimal route by retrieving the latest traffic volume, congestion, and weather information from a database based on the current location and destination information sent from the terminal. Here, a specific algorithm (e.g., Dijkstra, A) is used to perform data calculations. The input data is the current location information, destination information, and the latest traffic information, and the output is optimal route information. This route information includes specific travel instructions such as route selection and travel time prediction.

[2088] Step 4:

[2089] Send directions

[2090] The server generates calculated optimal route guidance information and sends the data to the terminal. The input data is the optimal route information, and the generated visual guidance data (e.g., arrows and movement instructions) is sent. As an output, the route guidance information is sent to the terminal and used for subsequent processing.

[2091] Step 5:

[2092] Visual directions

[2093] The terminal sends the received route guidance information to the smart display of the autonomous vehicle and presents it visually to the user. The input data is the route guidance information sent from the server, and the terminal sends the data to the display and processes it for display. The output is the route guidance displayed on the smart display, and the user follows it to move.

[2094] Step 6:

[2095] Real-time information gathering and updating

[2096] The server continues to collect traffic volume, congestion status, and weather information in real time and updates the database. The input data is new information obtained from the traffic data API, and the database is updated based on this. The output is the latest traffic information stored in the database, which is always kept up to date.

[2097] Step 7:

[2098] Reevaluate and recalculate routes

[2099] The server reevaluates the existing route based on the updated information in real time and recalculates a new optimal route if necessary. Here, the algorithm is used again to calculate the data. The input data is the updated traffic information, and the output is the recalculated new optimal route information. This newly calculated route guidance information is then sent to the terminal again.

[2100] Step 8:

[2101] View updated directions

[2102] The terminal receives the updated route guidance information sent again from the server and displays it on the smart display of the autonomous vehicle. The input data is the updated route guidance information from the server, which is displayed on the display. As an output, the user can continue traveling along the appropriate route based on the updated guidance information.

[2103] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2104] To specifically implement this invention, we will explain the system configuration and operation using the following means and steps. This system includes a combination of means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route, an eyeglass device for visually guiding a route even in places with an unstable communication environment, means for transmitting route guidance information to the eyeglass device, means for visually presenting a route to a user, means for collecting and updating traffic volume, congestion status, and weather information in real time, means for recalculation, and an emotion engine.

[2105] Initial Setup Procedure

[2106] server

[2107] The server periodically obtains traffic data, public transport congestion data, weather data, etc. from various APIs and stores it in a database.

[2108] The server receives a request for current location and destination information from the user's smartphone and prepares to calculate the optimal route.

[2109] Terminal

[2110] When the dedicated app is launched, the device enables the GPS function and prepares to obtain the user's current location information.

[2111] User

[2112] The user launches a dedicated app on their smartphone and enters destination information.

[2113] Acquiring and sending location information

[2114] Terminal

[2115] When the user inputs destination information, the terminal uses GPS to identify the current location and sends it to the server.

[2116] server

[2117] The server analyzes the current location information and destination information received from the device and prepares to calculate the optimal route.

[2118] Optimal route calculation and guidance

[2119] server

[2120] The server retrieves the latest traffic, congestion and weather data from a database and runs an algorithm to calculate the optimal route based on this.

[2121] For example, if it is determined that using the Yamanote Line is the best route to take when traveling from Shinjuku Station to Shibuya Station, this route will be selected.

[2122] server

[2123] After the optimal route is determined, visual guidance data is generated and transmitted to the terminal.

[2124] Emotion recognition and guidance adjustment

[2125] Eyeglasses Device

[2126] The glasses device is equipped with an emotion engine that analyzes the user's facial expressions and recognizes their emotions. This emotion engine analyzes the user's emotions (e.g., tension, anxiety, joy) in real time.

[2127] server

[2128] The system receives user emotion data sent from the emotion engine and adjusts the content and display of route guidance. For example, if the user is nervous, the system displays guidance information more simply and clearly.

[2129] Get directions

[2130] Terminal

[2131] The terminal transmits visual guidance to a dedicated eyeglass device based on the route guidance data and emotion recognition data received from the server.

[2132] User

[2133] The user checks the visual guidance information displayed through the glasses device and travels according to the presented route. The guidance information, which is mitigated by the emotion engine, reduces stress during travel.

[2134] Real-time updates and rerouting

[2135] server

[2136] The server collects real-time traffic, congestion, and weather data and updates the database. If new delays or congestion information is discovered, the optimal route is recalculated.

[2137] server

[2138] Send updated route guidance information to the device.

[2139] Terminal

[2140] The terminal transmits the updated information received from the server again to the dedicated glasses device.

[2141] User

[2142] The user continues to move along the appropriate route based on guidance information updated in real time, and the emotion engine continuously adjusts the guidance information according to changes in the user's emotions.

[2143] Specific examples

[2144] 1. Initial Setup and Data Collection

[2145] The user arrives at Shinjuku Station and launches a dedicated app to head to Shibuya Station.

[2146] The device uses GPS to notify the server that it is at Shinjuku Station.

[2147] The server collects the latest traffic conditions and congestion information between Shinjuku Station and Shibuya Station and stores it in a database.

[2148] 2. Route calculation and guidance

[2149] Once the user enters their destination, the server calculates the optimal route and generates visual guidance data, such as the best train transfer information from Shinjuku Station to Shibuya Station.

[2150] The generated guidance information is transmitted to the terminal, which then displays it on the dedicated glasses device.

[2151] 3. Emotion recognition and regulation

[2152] While the user is moving, the emotion engine analyzes the user's facial expressions in real time to detect tension or anxiety.

[2153] The server then simplifies the guidance information accordingly, making it easier to understand, and simultaneously displays multimedia content that has a relaxing effect.

[2154] 4. Real-time updates and rerouting

[2155] When a user boards the Yamanote Line from Shinjuku Station, the server analyzes traffic data in real time to check delays and congestion.

[2156] If the Yamanote Line is delayed, the server calculates an alternative route and suggests a new route, for example using another line. This information is sent to the terminal and displayed again on the glasses device, allowing the user to follow the new route.

[2157] This system allows users to receive optimal navigation in real time, even in areas with unstable communication environments. The emotion engine analyzes the user's emotions and provides appropriately adjusted guidance information, reducing stress during travel. The system also responds to changes in traffic conditions and weather, ensuring smooth travel.

[2158] The processing flow will be explained below.

[2159] Step 1:

[2160] User

[2161] The user launches a dedicated app on their smartphone and enters destination information.

[2162] Step 2:

[2163] Terminal

[2164] The device enables the GPS function to obtain the user's current location information.

[2165] The terminal transmits the acquired current location information and destination information to the server.

[2166] Step 3:

[2167] server

[2168] The server analyzes the current location information and destination information received from the terminal.

[2169] The server retrieves the latest traffic, congestion and weather data from a database.

[2170] Based on this information, an algorithm is run to calculate the optimal route.

[2171] Step 4:

[2172] server

[2173] Visual guidance data is generated based on the calculated optimal route.

[2174] The generated visual guidance data is transmitted to the terminal.

[2175] Step 5:

[2176] Terminal

[2177] The terminal transmits the visual guidance data received from the server to a dedicated glasses device.

[2178] Step 6:

[2179] User

[2180] The user checks the visual guidance information displayed through the glasses device and moves according to the presented route.

[2181] Step 7:

[2182] Eyeglasses Device

[2183] The emotion engine installed in the glasses device analyzes the user's facial expressions in real time.

[2184] The emotion engine recognizes the user's emotions (e.g., tension, anxiety, joy).

[2185] Step 8:

[2186] server

[2187] The server receives the user's emotional data sent from the emotion engine and adjusts the content and display method of the guidance. For example, if the user is nervous, the guidance information will be displayed more simply and clearly.

[2188] Step 9:

[2189] server

[2190] The server collects real-time traffic, congestion and weather data and updates the database.

[2191] If new delay or congestion information is discovered, the server will recalculate the optimal route.

[2192] Step 10:

[2193] server

[2194] The server sends updated route guidance information to the terminal.

[2195] Step 11:

[2196] Terminal

[2197] The terminal transmits the update information received from the server to the glasses device again.

[2198] Step 12:

[2199] User

[2200] Users can view real-time updated guidance information and continue traveling based on the appropriate route.

[2201] The emotion engine of the glasses device continues to adjust the guidance information according to changes in the user's emotions.

[2202] These steps allow users to receive optimal navigation in real time even in places with unstable communication environments. Furthermore, the emotion engine analyzes the user's emotions and provides appropriately tailored guidance information, reducing stress during travel and ensuring a smooth journey.

[2203] Example 2

[2204] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2205] Conventional navigation systems are not capable of handling unstable communication environments, unexpected congestion, or sudden changes in weather. Furthermore, they do not provide guidance information that takes into account the user's emotions, making it difficult for users to reach their destination without stress.

[2206] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: means for acquiring current location information; means for acquiring destination information; means for calculating an optimal route based on the current location information and the destination information; a head-mounted display for visually providing route guidance even in places with an unstable communication environment; means for transmitting route guidance information to the head-mounted display; means for visually presenting the route guidance information to the user; means for collecting and updating traffic volume, congestion status, and weather information in real time; means for reevaluating the calculated route based on the collected information and recalculating the route as necessary; and means for analyzing the user's emotions and adjusting the route guidance information. This enables optimal navigation in real time even in places with an unstable communication environment, and by providing guidance information that takes the user's emotions into consideration, stress during travel is reduced and smooth travel is achieved.

[2207] "Current location information" is location data that indicates the user's current location and is obtained using GPS or other location information services.

[2208] "Destination information" is location data indicating where the user wants to go, which is manually entered by the user or obtained by other means.

[2209] "Means for calculating the optimal route" refers to an algorithm or system that calculates the route that will allow the user to reach their destination most efficiently, based on current location information and destination information, taking into account traffic volume, congestion, weather information, etc.

[2210] A "head-mounted display" is a display device that is worn on the user's head and is a device for visually presenting information.

[2211] The "means for transmitting route guidance information" refers to a communication means for transferring the calculated optimal route information to a head-mounted display or other presentation device.

[2212] The term "means for visually presenting to the user" refers to a method or device for displaying the calculated route information so that the user can visually confirm it.

[2213] "Means of collecting and updating traffic, congestion, and weather information in real time" refers to a system or method that obtains current traffic, congestion, and weather conditions from external sources at any time and reflects them in a database.

[2214] "Means for re-evaluating and recalculating routes" refers to algorithms or systems that review existing routes and, if necessary, calculate new optimal routes based on new information collected in real time.

[2215] "Means for analyzing user emotions" refers to a system or algorithm that analyzes the user's facial expressions and behavior using sensors or other devices to determine the user's current emotional state (e.g., tension, anxiety, joy).

[2216] "Means for adjusting route guidance information" refers to a system or method that changes the display content and presentation method of guidance information based on the results of user emotion analysis, and provides information in an optimal form to the user.

[2217] To specifically implement this invention, a system configuration and its operation using the following means and steps will be described. This system includes a combination of means for acquiring current location information, means for acquiring destination information, means for calculating an optimal route, a head-mounted display for visually guiding the route even in places with an unstable communication environment, means for transmitting route guidance information to the head-mounted display, means for visually presenting the route to the user, means for collecting and updating traffic volume, congestion status, and weather information in real time, means for reevaluating and recalculating, and an emotion engine.

[2218] Initial Setup

[2219] server

[2220] The server periodically obtains traffic data, public transport congestion data, weather data, etc. from various APIs (such as Google Maps API and OpenWeatherMap API) and stores them in a database. The server receives requests for current location and destination information from the user's smartphone and prepares to calculate the optimal route.

[2221] Terminal

[2222] When the dedicated app is launched, the device activates the GPS function and prepares to obtain the user's current location information, for example, by using the location information services of Android or iOS.

[2223] User

[2224] The user launches a dedicated smartphone app and enters destination information, including manually entering the destination into the app's input form.

[2225] Acquiring and sending location information

[2226] Terminal

[2227] When the user inputs destination information, the device uses GPS to identify the current location and sends it to the server. Specifically, the device sends the current location information to the server as JSON format data.

[2228] server

[2229] The server analyzes the current location information and destination information received from the device, temporarily stores it in a database, and prepares it for analysis.

[2230] Calculating the best route

[2231] server

[2232] The server retrieves the latest traffic volume, congestion, and weather data from the database and runs an algorithm to calculate the optimal route based on this. Specifically, it uses route optimization algorithms such as Dijkstra and A. For example, when calculating a route from Shinjuku Station to Shibuya Station, the Yamanote Line is determined to be the best route, taking into account the current traffic conditions.

[2233] Generate and send visual guidance

[2234] server

[2235] After determining the optimal route, visual guidance data is generated and sent to the device, including map images and text directions.

[2236] Emotion recognition and guidance adjustment

[2237] Eyeglasses Device

[2238] The glasses device is equipped...

Claims

1. A means for obtaining current location information; A means for obtaining destination information; A means for calculating an optimal route based on current location information and destination information; A glasses device that provides visual route guidance even in places with unstable communication environments, means for transmitting route guidance information to the eyeglass device; means for visually presenting the route guidance information to a user; A means of collecting and updating real-time traffic, congestion, and weather information; means for reevaluating the calculated route based on the collected information and recalculating the route as necessary; A system including:

2. The system according to claim 1 , wherein the real-time information gathering means includes means for gathering traffic volume data, public transportation congestion data, and weather data.

3. The system according to claim 1 , wherein the means for transmitting the route guidance information is a smartphone device.

Images