System

Abstract

A system is provided.SOLUTION: A system comprising: means for determining location information of a user; means for inputting or setting destination information; a server device for calculating an optimal route between a current location and a destination; a glasses-type device or an earphone-type device for providing navigation information to the user based on the calculated optimal route; and means for recalculating the route and providing modified navigation information if the location of the user changes.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention aims to solve the problem of people frequently getting lost or missing meeting places in large train stations and other crowded places. These situations can cause stress and anxiety, especially in unfamiliar places. Providing safe navigation is also a challenge. Looking at your hands for visual navigation can be particularly dangerous in crowded areas. Therefore, there is a need for a means to provide appropriate visual and auditory information, enabling safe and efficient navigation. [Means for solving the problem]

[0005] The present invention solves the above problems by the following means. First, a means is provided for using a device with a built-in GPS sensor or beacon to identify the user's location information. Next, a means is provided for the user to input or set destination information. Based on the current location and destination information obtained through these means, a server device calculates the optimal route. The calculation results are sent to the user's device in real time and provided to the user as navigation information via a glasses-type device or earphone-type device. If the user's location changes, the server device calculates the route again and provides revised navigation information in real time. Through this series of means, the user can reach their destination safely without getting lost.

[0006] "User" refers to an individual who uses the navigation system of the present invention.

[0007] "Location information" refers to geographical information such as latitude and longitude used to identify a user's current location.

[0008] "Destination Information" refers to the geographic information of a particular location that a user wishes to reach.

[0009] "Server" refers to a computing device that calculates the optimal route based on the user's location information and destination information and provides navigation information.

[0010] "Eyeglasses-type device" refers to a wearable device that is worn by the user and displays navigation information overlaid on the user's field of vision.

[0011] An "earphone-type device" refers to a wearable device that is worn by the user and provides navigation information via voice.

[0012] An "optimal route" refers to the most efficient and safe route from a user's current location to their destination.

[0013] "Navigation information" refers to visual or audio guidance information that instructs the user on the direction of travel, distance, etc.

[0014] "Real-time" refers to the exchange of information with extremely short delays.

[0015] "GPS Sensor" means a sensor that utilizes the Global Positioning System to determine geographic location.

[0016] A "beacon" refers to a wireless transmitting device for identifying location information over a short distance. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11]FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] The present invention is a navigation system that helps users avoid getting lost in large train stations and other crowded places. This system identifies the user's current location, calculates the optimal route to the destination, and provides navigation information in real time. The program processing flow of this system is explained in detail below.

[0039] Program processing flow

[0040] Getting the user's current location

[0041] 1. User: Puts on the eyeglasses or earbuds and launches the navigation app.

[0042] When the app is launched, the device prepares to obtain its location information.

[0043] 2. Device: Determines current location using built-in GPS sensor or beacon.

[0044] The GPS sensor is activated to obtain latitude and longitude information, and if a beacon is available, its signal is detected and used as supplemental information.

[0045] 3. Device: Sends the acquired location information to the server.

[0046] The location information is packetized and sent to the server as an HTTP POST request.

[0047] Setting a destination

[0048] 4. User: Set a destination in the app by voice or text input.

[0049] For example, you can say "Shinjuku Station Southeast Exit" or enter it into the text form.

[0050] 5. Terminal: Sends destination information to the server.

[0051] The destination information is formatted and sent to the server.

[0052] Calculating the best route

[0053] 6. Server: Obtains current location and destination information and calculates the optimal route.

[0054] The server retrieves map information from a database and uses an algorithm (e.g., Dijkstra algorithm) to calculate the optimal route.

[0055] 7. Server: Sends the calculation results to the terminal in real time.

[0056] The calculated route information is packetized in JSON format and sent to the terminal.

[0057] Providing navigation information

[0058] 8. Terminal: The received navigation information is displayed to the user (glasses-type device) or guided by voice (earphone-type device).

[0059] In the case of glasses-type devices, arrows and distance information are displayed on the HUD, while in the case of earphone-type devices, direction and distance are guided by voice.

[0060] 9. User: Follow the device's directions to your destination.

[0061] Real-time route corrections

[0062] 10. Terminal: If the user takes a wrong turn, it sends that information to the server.

[0063] A new location is obtained and retransmitted to the server.

[0064] 11. Server: Recalculate the route based on the new location information and send the revised navigation information to the device.

[0065] Recalculate the optimal route from the new location information and send the revised route.

[0066] 12. Terminal: Display or audibly notify the user of the revised navigation information.

[0067] The glasses-type device displays the corrected route on the HUD, while the earphone-type device provides voice guidance such as "Go back 50 meters and turn left."

[0068] Specific examples

[0069] Meeting scenario at Shinjuku Station

[0070] 1. User: I am meeting a friend at Shinjuku Station and am using the glasses.

[0071] 2. User: Launch the app on the glasses-type device and voice-input "Southeast Exit" as the destination.

[0072] 3. Device: Detects current location using GPS sensor and sends that information to the server.

[0073] 4. Server: Calculates the optimal route between the current location and the destination "Southeast Exit" and sends it to the eyeglasses.

[0074] 5. Terminal: Displays arrows and distance information on the HUD to instruct the user on which direction to go.

[0075] 6. User: Follows instructions but accidentally goes in the wrong direction.

[0076] 7. Device: Resends updated location to server.

[0077] 8. Server: Recalculate the route based on the new position and send the corrected route.

[0078] 9. Terminal: Display the corrected route on the HUD and guide the user in the right direction.

[0079] 10. User: Proceed in the correct direction and arrive safely at the "Southeast Exit".

[0080] This series of processes allows users to reach their destination safely and efficiently, even in large stations and crowded places. This invention reduces the chances of getting lost or missing meeting places, and reduces stress and anxiety for users.

[0081] The processing flow will be explained below.

[0082] Step 1:

[0083] User: Puts on the glasses or earbuds and launches a navigation app.

[0084] Action: The user taps on the app to launch it.

[0085] Step 2:

[0086] Device: Determines current location using built-in GPS sensor or beacon.

[0087] Action: The GPS sensor is activated to obtain the current latitude and longitude coordinates, and if available, to detect beacon signals to supplement the location.

[0088] Step 3:

[0089] Device: Sends the acquired location information to the server.

[0090] Action: Packet location data (latitude and longitude) and send an HTTP POST request to the server.

[0091] Step 4:

[0092] User: Set a destination by voice or text input within the app.

[0093] Action: Say "Shinjuku Station Southeast Exit" or type it into the text field.

[0094] Step 5:

[0095] Terminal: Sends destination information to the server.

[0096] Action: Format the destination data and send it to the server as an HTTP POST request.

[0097] Step 6:

[0098] Server: Obtains the user's current location and destination information and calculates the optimal route.

[0099] Action: The server retrieves map information from the database and calculates the optimal route using an algorithm (e.g., Dijkstra algorithm).

[0100] Step 7:

[0101] Server: Sends the calculation results to the terminal in real time.

[0102] Action: Packet the coordinate data of the optimal route in JSON format and send it to the device as an HTTP response.

[0103] Step 8:

[0104] Terminal: Provides the received navigation information to the user visually or audibly.

[0105] Action: Display arrows and distance information on the HUD (glasses) or provide audio guidance of direction and distance (earbuds).

[0106] Step 9:

[0107] User: Follow the device's directions to reach your destination.

[0108] Action: Follow the arrows and audio prompts.

[0109] Step 10:

[0110] Terminal: If the user takes a wrong turn, the sensor detects it and sends the information to the server.

[0111] Action: The GPS sensor gets an updated location and sends it back to the server.

[0112] Step 11:

[0113] Server: Recalculates the route based on the new location information and sends the revised navigation information to the device.

[0114] Action: Recalculate the optimal route based on the new location information and send the revised route data in JSON format to the device.

[0115] Step 12:

[0116] On the device: Display or audibly notify the user of the revised navigation information.

[0117] Action: Display corrected arrow on HUD or voice prompt "Go back 50 meters and then right again."

[0118] Step 13:

[0119] User: Follows the revised directions and proceeds to the destination.

[0120] Action: Correct the mistake and move in the right direction.

[0121] Example 1

[0122] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0123] In large stations and crowded areas, it is difficult for users to reach their destination efficiently without getting lost. This can cause users anxiety and stress. Furthermore, there is a lack of navigation systems that can respond to real-time location changes, making it difficult to correct a route once it has been set. There is a need for a system that can solve these problems and provide users with a comfortable journey.

[0124] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0125] In this invention, the server includes means for acquiring user location information, means for inputting or setting destination information, means for calculating the optimum route between the acquired current location and the set destination, means for providing guidance information to the user based on the calculated optimum route, and means for recalculating the route and providing revised guidance information when the user's location changes, thereby enabling the user to reach their destination efficiently without getting lost even in large stations or crowded places.

[0126] "User" refers to a person who uses this system to obtain location information and set a destination.

[0127] "Means of obtaining location information" refers to devices or technologies for measuring a user's current location, specifically devices that use GPS sensors or beacons.

[0128] "Means for inputting or setting destination information" refers to an interface or device that allows a user to specify the location they want to go to, specifically a device for voice input or text input.

[0129] "Computing device" refers to the device or technology, specifically the server, that calculates the optimal route based on the user's current location and destination information.

[0130] The term "display device" refers to a device for providing visual guidance information to a user, specifically, a glasses-type device.

[0131] "Audio output device" refers to a device that provides guidance information to users by voice, specifically an earphone-type device.

[0132] "Re-route means" refers to the technology or algorithm used to recalculate a new, optimal route from the user's current location to the destination if the user's location changes.

[0133] "Guidance information" refers to information about the direction and distance a user needs to reach their destination.

[0134] "Real-time" refers to updating and providing information immediately when a user's location information changes.

[0135] The present invention relates to a navigation system that helps users avoid getting lost in large train stations and other crowded places. The system identifies the user's current location, calculates the optimal route to the destination, and provides real-time navigation information.

[0136] System configuration

[0137] The system consists of the following main components:

[0138] 1. User terminal: Glasses-type device or earphone-type device.

[0139] 2. Server: Performs route calculation and data management.

[0140] 3. Network: The communications infrastructure that connects user devices and servers.

[0141] Hardware and Software Examples

[0142] User device:

[0143] User terminals are glasses-type devices (e.g., smart glasses) with built-in GPS sensors or earphone-type devices (e.g., smart earphones) with voice guidance functions.

[0144] These devices use dedicated applications that run on operating systems such as Android and iOS.

[0145] server:

[0146] The server is installed with a database management system (e.g., MySQL) and software for executing a route calculation algorithm (e.g., Dijkstra's algorithm).

[0147] The server communicates with the user terminal using the HTTP protocol.

[0148] network:

[0149] Data is exchanged between the user terminal and the server using the Internet or a dedicated local network.

[0150] Data processing and calculation

[0151] User device: Uses a GPS sensor and beacon receiver to measure the current location and send that location information to the server. It also organizes destination information specified by the user and sends it to the server.

[0152] Server: Based on the received location and destination information, retrieves map data from the database, calculates the optimal route using a route calculation algorithm, and sends the calculation results to the user's device in real time.

[0153] Example of processing flow

[0154] Example 1: Meeting scenario at Shinjuku Station

[0155] 1. A user uses the eyeglasses to meet a friend at Shinjuku Station.

[0156] 2. The user launches the app on their device and voice-inputs "Southeast Exit" as their destination.

[0157] 3. The device determines its current location using its built-in GPS sensor and sends that information to the server.

[0158] 4. The server calculates the optimal route based on the received location information and the destination information, "Southeast Exit," and sends the results to the eyeglasses.

[0159] 5. The device displays arrows and distance information on the HUD to instruct the user on which direction to go.

[0160] 6. Users follow instructions but sometimes accidentally go in the wrong direction.

[0161] 7. The device obtains new location information and retransmits it to the server.

[0162] 8. The server recalculates the route based on the new location information and sends the revised route to the user device.

[0163] 9. The device displays the corrected route on the HUD and guides the user in the correct direction.

[0164] Examples of prompt statements

[0165] The following prompts can be used for speech or text input:

[0166] 1. "Please take me to the southeast exit of Shinjuku Station."

[0167] 2. "Please set a new destination. Southeast Exit."

[0168] 3. "What is the best route from my current location to my destination?"

[0169] This invention allows users to reach their destination efficiently without getting lost even in large stations or crowded places. This system reduces the chances of getting lost or missing meeting places, and reduces stress and anxiety for users.

[0170] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0171] Step 1:

[0172] The user turns on the eyeglasses or earphones.

[0173] Specific behavior: User turns on the device and opens the navigation app.

[0174] Input: User actions (device launch and app launch).

[0175] Output: The device is initialized and ready to acquire location information.

[0176] Step 2:

[0177] The device activates the GPS sensor and beacon to determine its current location.

[0178] Specific operation: The GPS sensor inside the device is activated, and the device captures surrounding beacon signals.

[0179] Input: Device location sensors (GPS and beacons).

[0180] Output: Latitude and longitude information and signal information from the beacon.

[0181] Step 3:

[0182] The location information acquired by the device is sent to the server.

[0183] Specific operation: The location information is converted into JSON format and sent to the server as an HTTP POST request.

[0184] Input: Latitude and longitude information and beacon signal data.

[0185] Output: Confirmation of sending location information to the server.

[0186] Step 4:

[0187] The user sets the destination by voice or text input.

[0188] Specific operation: The user specifies a destination using the device's input interface (microphone or keyboard). For example, the user enters "Shinjuku Station Southeast Exit."

[0189] Input: User speaks or texts destination.

[0190] Output: Destination information confirmed and set.

[0191] Step 5:

[0192] The terminal transmits the destination information to the server.

[0193] Specific operation: The input destination information is formatted, converted into JSON format, and sent to the server.

[0194] Input: Destination text or audio data.

[0195] Output: Confirmation of sending destination information to the server.

[0196] Step 6:

[0197] The server obtains information about the current location and destination and calculates the optimal route.

[0198] Specific operation: The server retrieves map information from the database and calculates the optimal route using a route calculation algorithm (e.g., Dijkstra algorithm).

[0199] Input: User's current location and destination information.

[0200] Output: Calculated optimal route data.

[0201] Step 7:

[0202] The server sends the calculation results to the terminal in real time.

[0203] Specific operation: The calculated route information is packetized in JSON format and sent to the terminal as an HTTP response.

[0204] Input: Optimal route data calculated by the server.

[0205] Output: Confirmation of sending route information to the device.

[0206] Step 8:

[0207] The navigation information received by the device is displayed or audibly provided to the user.

[0208] Specific operation: For glasses-type devices, arrows and distance information will be displayed on the HUD. For earphone-type devices, voice guidance will be provided.

[0209] Input: Route information received from the server.

[0210] Output: Providing visual or audio guidance to the user.

[0211] Step 9:

[0212] The user follows the navigation information.

[0213] Specific operation: The user follows the guidance of the glasses-type device or earphone-type device to move in the direction they should go.

[0214] Input: Guidance information from the terminal.

[0215] Output: The user follows the route provided.

[0216] Step 10:

[0217] If the device changes the user's location, it sends it back to the server.

[0218] Specific behavior: If the user deviates from the specified route, obtain new location information and resend it to the server.

[0219] Input: Updated location information.

[0220] Output: Confirmation of sending new location to server.

[0221] Step 11:

[0222] The server recalculates the route based on the new location information and sends the revised navigation information to the device.

[0223] Specific operation: The optimal route is recalculated based on the new location information, and the revised route information is packetized in JSON format and sent to the terminal.

[0224] Input: New location.

[0225] Output: Confirmation of sending corrected route information.

[0226] Step 12:

[0227] The device will display or audibly notify the user of the revised navigation information.

[0228] Specific operation: In the case of glasses-type devices, the revised route will be displayed on the HUD, and in the case of earphone-type devices, voice guidance will be given, such as "Go back 50 meters and turn left."

[0229] Input: The modified route information received from the server.

[0230] Output: Providing visual or audio correction guidance to the user.

[0231] (Application example 1)

[0232] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0233] Conventional navigation systems have limitations when it comes to navigating large stations and crowded areas. In particular, in businesses like food delivery, it is important to reach your destination efficiently, but it is difficult to flexibly change routes to take real-time traffic information into account. Furthermore, there are limited ways to provide navigation information, leaving delivery drivers with few intuitive and easy-to-understand directions.

[0234] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0235] In this invention, the server includes means for acquiring user location information and providing an optimal route to support the delivery driver's work, means for dynamically correcting the route by reflecting real-time traffic information, and means for providing navigation information to the device. This allows the delivery driver to receive optimal route information in real time and flexibly change the route according to traffic conditions, enabling efficient and effective delivery.

[0236] "Means of identifying the user's location"

[0237] It is a technology that uses sensors such as GPS and beacons to accurately detect the user's current location.

[0238] "Method for entering or setting destination information"

[0239] is a technology that allows users to specify navigation destinations to applications through voice or text input.

[0240] "Server device for calculating optimal routes"

[0241] is a computer system that uses an algorithm (e.g., Dijkstra algorithm or A) to calculate the shortest or fastest route based on the user's current location and destination.

[0242] "Eyeglasses-type device that provides navigation information"

[0243] is a wearable device that has a visual display and overlays navigation instructions into the user's field of view.

[0244] "Earphone-type device that provides navigation information"

[0245] is a wearable device that can provide navigation information to users via voice.

[0246] "Real-time traffic information"

[0247] This is road condition data that is updated instantly, including current traffic conditions, congestion, and accident information.

[0248] "Means for dynamically correcting routes"

[0249] This is a technology that takes real-time traffic information into account to recalculate the optimal route and provide it to the user.

[0250] "A means of providing optimal routes to support delivery drivers' work"

[0251] This is a technology that calculates and guides delivery drivers to the optimal delivery route to reach their destination efficiently and quickly.

[0252] The present invention is a system that identifies a user's current location, calculates the optimal route to a destination, and provides navigation information in real time, and is particularly used to improve the efficiency of food delivery operations.

[0253] 1. Obtaining user location information

[0254] The server uses the GPS sensor built into the delivery driver's smartphone to accurately determine the driver's current location (latitude and longitude). This GPS sensor sends the driver's location information to the server in real time. For example, the server can obtain location information using the smartphone's location information service.

[0255] 2. Setting destination information

[0256] The user sets the destination address of the customer on their smartphone using voice recognition or text input. Voice recognition technology can use the Google Voice Recognition API or a voice interface provided by the requester. The set address is sent to the server and used as the destination information for navigation.

[0257] 3. Calculating the optimal route

[0258] The server receives the user's current location and destination information to calculate the optimal route for navigation. The calculation uses Dijkstra's algorithm or A algorithm, which are executed on the server. The calculation results are sent to the user's smartphone or smart glasses in real time.

[0259] 4. Providing navigation information

[0260] The device provides the user with the optimal route information received from the server. In the case of a smartphone, the route map and direction instructions are displayed on the screen. In addition, if smart glasses are used, navigation information is overlaid on the HUD (Heads-Up Display). In the case of earphone-type devices, navigation information such as direction and distance is provided by voice.

[0261] 5. Real-time route correction

[0262] If road conditions change while the user is traveling, such as when traffic jams or an accident occurs, new location information is sent to the server. The server then recalculates the optimal route based on this information and sends the revised route information to the device in real time. This allows the user to navigate efficiently based on the latest information.

[0263] Specific hardware and software to be used

[0264] Smartphone: GPS sensor, location information services

[0265] Server: High performance server (Python, Node.js, PostgreSQL)

[0266] Glasses-type device: HUD (Heads-Up Display)

[0267] Earphone-type devices: Audio output technology

[0268] Example scenario

[0269] Consider a scenario where a user is working as a food delivery driver near Shinjuku Station. The delivery driver launches a smartphone app and uses the GPS sensor to determine their current location. They then voice-enter the customer's address and set it as their destination. The server calculates the optimal route based on their current location and destination information and sends it to the smartphone in real time. The driver then follows the navigation information displayed on the smartphone or smart glasses. If traffic congestion occurs along the way, new location information is sent to the server and the route is recalculated. The revised route information is then provided to the driver in real time.

[0270] Prompt Sentence Examples

[0271] What is the algorithm of the food delivery app that calculates the optimal route from Shinjuku Station to the customer's address and adjusts the route in real time to reflect current traffic information? Please also provide a detailed explanation of the technologies used (GPS, voice recognition, navigation, real-time updates).

[0272] In this way, the present invention can significantly improve the efficiency of delivery drivers by combining user location information with real-time traffic information.

[0273] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0274] Step 1:

[0275] When a user launches a smartphone app, the app uses the GPS sensor to obtain the user's current location (latitude and longitude).

[0276] Input: Smartphone app launch, GPS sensor data

[0277] Output: Current location (latitude and longitude) data

[0278] Specific behavior: Uses the smartphone's location services to call APIs such as locationManager.getLastKnownLocation() to obtain the coordinates of the current location.

[0279] Step 2:

[0280] The user sets the destination information (customer's address) through voice recognition or text input.

[0281] Input: Voice or text input data

[0282] Output: Destination information (address)

[0283] Specific operation: In the case of voice input, the user's destination is obtained using the Google Voice Recognition API, and in the case of text input, the destination is obtained using an input form within the app.

[0284] Step 3:

[0285] The device sends the current location and destination information to the server.

[0286] Input: Current location (latitude and longitude) data, destination information (address)

[0287] Output: HTTP POST request to the server

[0288] Specific operation: Format the current location and destination data into JSON format and send it to the server as an HTTP POST request.

[0289] Step 4:

[0290] The server calculates the optimal route based on the current location and destination information.

[0291] Input: Current location (latitude and longitude) data, destination information (address)

[0292] Output: Optimal route data (route information, distance, time, etc.)

[0293] Specific operation: The server retrieves map data from the database and calculates the optimal route using Dijkstra's algorithm or A algorithm.

[0294] Step 5:

[0295] The server sends the calculated optimal route to the terminal.

[0296] Input: Optimal route data

[0297] Output: HTTP response to the device

[0298] Specific operation: The calculated route information is packetized in JSON format and sent to the terminal as an HTTP response.

[0299] Step 6:

[0300] The terminal provides the received navigation information to the user.

[0301] Input: Optimal route data

[0302] Output: On-screen display or voice guidance

[0303] Specific operation: In the case of a smartphone, the route is displayed using a map application, in the case of smart glasses, the information is overlaid on the HUD, and in the case of earphones, voice guidance is provided.

[0304] Step 7:

[0305] The user follows the navigation.

[0306] Input: Navigation information provided by the device

[0307] Output: Tracking of travel route

[0308] Specific actions: The user follows instructions on their smartphone or smart glasses to move towards their destination.

[0309] Step 8:

[0310] The device updates the user's location information in real time and sends it to the server.

[0311] Input: Continuous GPS data

[0312] Output: Updated location information sent to the server

[0313] Specific operation: Obtain location information at regular intervals and resend it to the server.

[0314] Step 9:

[0315] The server recalculates the route based on real-time traffic information.

[0316] Input: Updated location, real-time traffic information

[0317] Output: Modified route data

[0318] Specific operation: The server recalculates the optimal route taking into account the new location information and real-time traffic information.

[0319] Step 10:

[0320] The server sends the modified route information to the terminal.

[0321] Input: Modified route data

[0322] Output: HTTP response to the device

[0323] Specific operation: The corrected route information is packetized in JSON format and sent to the terminal as an HTTP response.

[0324] Step 11:

[0325] The terminal provides the revised route information to the user.

[0326] Input: Modified route data

[0327] Output: Corrected screen display or voice guidance

[0328] Specific operation: On smartphones, the updated map information will be redisplayed, and on smart glasses or earphones, the updated information will be displayed as an overlay or announced via voice guidance.

[0329] Through the above processing steps, delivery drivers receive optimal route information in real time, enabling them to flexibly change routes according to traffic conditions, enabling them to make deliveries efficiently and effectively.

[0330] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0331] The present invention combines a navigation system that helps users avoid getting lost in large train stations and crowded places with an emotion engine that recognizes the user's emotions and adjusts navigation information based on those emotions. Specific embodiments of the present invention will be described below.

[0332] Program processing flow

[0333] Getting the user's current location

[0334] 1. User: Puts on the eyeglasses or earbuds and launches the navigation app.

[0335] Action: The user taps on the app to launch it.

[0336] 2. Device: Determines current location using built-in GPS sensor or beacon.

[0337] Action: The GPS sensor is activated to obtain the current latitude and longitude coordinates, and if available, to detect beacon signals to supplement the location.

[0338] 3. Device: Sends the acquired location information to the server.

[0339] Action: Packet location data (latitude and longitude) and send an HTTP POST request to the server.

[0340] Setting a destination

[0341] 4. User: Set a destination by voice or text input within the app.

[0342] Action: Say "Shinjuku Station Southeast Exit" or type it into the text field.

[0343] 5. Terminal: Sends destination information to the server.

[0344] Action: Format the destination data and send it to the server as an HTTP POST request.

[0345] Calculating the best route

[0346] 6. Server: Obtains the user's current location and destination information and calculates the optimal route.

[0347] Action: The server retrieves map information from the database and calculates the optimal route using an algorithm (e.g., Dijkstra algorithm).

[0348] 7. Server: Sends the calculation results to the terminal in real time.

[0349] Action: Packet the coordinate data of the optimal route in JSON format and send it to the device as an HTTP response.

[0350] Providing navigation information

[0351] 8. Terminal: Provides the received navigation information to the user visually or audibly.

[0352] Action: Display arrows and distance information on the HUD (glasses) or provide audio guidance of direction and distance (earbuds).

[0353] 9. User: Follow the device's directions to your destination.

[0354] Action: Follow the arrows and audio prompts.

[0355] Real-time route corrections

[0356] 10. Terminal: If the user takes a wrong turn, the sensor will detect it and send the information to the server.

[0357] Action: The GPS sensor gets an updated location and sends it back to the server.

[0358] 11. Server: Recalculate the route based on the new location information and send the revised navigation information to the device.

[0359] Action: Recalculate the optimal route based on the new location information and send the revised route data in JSON format to the device.

[0360] 12. Terminal: Display or audibly notify the user of the revised navigation information.

[0361] Action: Display corrected arrow on HUD or voice prompt "Go back 50 meters and then right again."

[0362] 13. User: Follow the modified directions and proceed towards your destination.

[0363] Action: Correct the mistake and move in the right direction.

[0364] Emotion Engine Processing Flow

[0365] User emotion recognition

[0366] 1. Device: The emotion engine detects the user's facial expressions, tone of voice, heart rate, etc.

[0367] Action: Collect data using devices such as cameras, microphones, and heart rate sensors.

[0368] 2. Device: Analyzes the detected data and recognizes the user's emotional state.

[0369] Action: Use machine learning models and algorithms to determine the user's emotional state from the collected data.

[0370] 3. Terminal: Sends the recognized emotional state to the server.

[0371] Action: Format the emotional state data and send it to the server as an HTTP POST request.

[0372] Adjusting navigation information

[0373] 4. Server: Based on the user's emotional state, adjust navigation information to reduce anxiety and stress.

[0374] Action: For example, make adjustments such as providing more detailed instructions, simplifying instructions, or suggesting stopovers or rest areas.

[0375] 5. Server: Sends the adjusted navigation information to the device.

[0376] Action: Packet the adjusted navigation information in JSON format and send it to the device as an HTTP response.

[0377] 6. Terminal: Providing tailored navigation information to the user visually or audibly.

[0378] Action: Display on HUD or give voice prompt.

[0379] Specific examples

[0380] Meeting scenario at Shinjuku Station

[0381] 1. User: I am meeting a friend at Shinjuku Station and am using the glasses.

[0382] 2. User: Launch the app on the glasses-type device and voice-input "Southeast Exit" as the destination.

[0383] 3. Device: Detects current location using GPS sensor and sends that information to the server.

[0384] 4. Server: Calculates the optimal route between the current location and the destination "Southeast Exit" and sends it to the eyeglasses.

[0385] 5. Terminal: Displays arrows and distance information on the HUD to instruct the user on which direction to go.

[0386] 6. User: Follows instructions but accidentally goes in the wrong direction.

[0387] 7. Device: Resends updated location to server.

[0388] 8. Server: Recalculate the route based on the new position and send the corrected route.

[0389] 9. Terminal: Display the corrected route on the HUD and guide the user in the right direction.

[0390] 10. User: Proceed in the correct direction and arrive safely at the "Southeast Exit".

[0391] 11. On the device: At the same time, the emotion engine detects the user's facial expressions and tone of voice and determines that the user is feeling anxious.

[0392] 12. Server: Provides detailed directions and suggests appropriate rest areas depending on the anxiety state.

[0393] 13. Terminal: Display the adjusted information on the HUD and guide the user by saying, "There is a rest point in 100 meters."

[0394] In this way, the present invention is a system that provides appropriate navigation information based on the user's current location and emotional state, and supports the user in reaching their destination comfortably and safely.

[0395] The processing flow will be explained below.

[0396] Step 1:

[0397] User: Puts on the glasses or earbuds and launches a navigation app.

[0398] Action: The user taps on the app to launch it.

[0399] Step 2:

[0400] Device: Determines current location using built-in GPS sensor or beacon.

[0401] Action: The GPS sensor is activated to obtain the current latitude and longitude coordinates, and if available, to detect beacon signals to supplement the location.

[0402] Step 3:

[0403] Device: Sends the acquired location information to the server.

[0404] Action: Packet location data (latitude and longitude) and send an HTTP POST request to the server.

[0405] Step 4:

[0406] User: Set a destination by voice or text input within the app.

[0407] Action: Say "Shinjuku Station Southeast Exit" or type it into the text field.

[0408] Step 5:

[0409] Terminal: Sends destination information to the server.

[0410] Action: Format the destination data and send it to the server as an HTTP POST request.

[0411] Step 6:

[0412] Server: Obtains the user's current location and destination information and calculates the optimal route.

[0413] Action: The server retrieves map information from the database and calculates the optimal route using an algorithm (e.g., Dijkstra algorithm).

[0414] Step 7:

[0415] Server: Sends the calculation results to the terminal in real time.

[0416] Action: Packet the coordinate data of the optimal route in JSON format and send it to the device as an HTTP response.

[0417] Step 8:

[0418] Terminal: Provides the received navigation information to the user visually or audibly.

[0419] Action: Display arrows and distance information on the HUD (glasses) or provide audio guidance of direction and distance (earbuds).

[0420] Step 9:

[0421] User: Follow the device's directions to reach your destination.

[0422] Action: Follow the arrows and audio prompts.

[0423] Step 10:

[0424] Terminal: If the user takes a wrong turn, the sensor detects it and sends the information to the server.

[0425] Action: The GPS sensor gets an updated location and sends it back to the server.

[0426] Step 11:

[0427] Server: Recalculates the route based on the new location information and sends the revised navigation information to the device.

[0428] Action: Recalculate the optimal route based on the new location information and send the revised route data in JSON format to the device.

[0429] Step 12:

[0430] On the device: Display or audibly notify the user of the revised navigation information.

[0431] Action: Display corrected arrow on HUD or voice prompt "Go back 50 meters and then right again."

[0432] Step 13:

[0433] Device: The emotion engine detects the user's facial expressions, tone of voice, heart rate, etc.

[0434] Action: Collect data using devices such as cameras, microphones, and heart rate sensors.

[0435] Step 14:

[0436] Device: Analyzes detected data and recognizes the user's emotional state.

[0437] Action: Use machine learning models and algorithms to determine the user's emotional state from the collected data.

[0438] Step 15:

[0439] Device: Sends the recognized emotional state to the server.

[0440] Action: Format the emotional state data and send it to the server as an HTTP POST request.

[0441] Step 16:

[0442] Server: Based on the user's emotional state, adjust navigation information to reduce anxiety and stress.

[0443] Action: For example, make adjustments such as providing more detailed instructions, simplifying instructions, or suggesting stopovers or rest areas.

[0444] Step 17:

[0445] Server: Sends adjusted navigation information to the device.

[0446] Action: Packet the adjusted navigation information in JSON format and send it to the device as an HTTP response.

[0447] Step 18:

[0448] Device: Provides tailored navigation information to the user visually or audibly.

[0449] Action: Display on HUD or give voice prompt.

[0450] Step 19:

[0451] User: Follow the tailored guidance and proceed towards your destination in a relaxed state.

[0452] Action: Follow the tailored details and rest stop suggestions to stay safe and relaxed.

[0453] Specific examples

[0454] Meeting scenario at Shinjuku Station

[0455] 1. User: I am meeting a friend at Shinjuku Station and am using the glasses.

[0456] 2. User: Launch the app on the glasses-type device and voice-input "Southeast Exit" as the destination.

[0457] 3. Device: Detects current location using GPS sensor and sends that information to the server.

[0458] 4. Server: Calculates the optimal route between the current location and the destination "Southeast Exit" and sends it to the eyeglasses.

[0459] 5. Terminal: Displays arrows and distance information on the HUD to instruct the user on which direction to go.

[0460] 6. User: Follows the arrows but accidentally goes in the wrong direction.

[0461] 7. Device: Resends updated location to server.

[0462] 8. Server: Recalculate the route based on the new position and send the corrected route.

[0463] 9. Terminal: Display the corrected route on the HUD and guide the user in the right direction.

[0464] 10. User: Proceed in the correct direction and arrive safely at the "Southeast Exit".

[0465] 11. On the device: At the same time, the emotion engine detects the user's facial expressions and tone of voice to analyze the user's emotional state.

[0466] 12. Device: If it determines that the user is feeling anxious, it sends emotional data to the server.

[0467] 13. Server: Responds to anxiety states and adjusts navigation information to provide detailed directions and suggest appropriate rest stops.

[0468] 14. Server: Sends the adjusted navigation information to the device.

[0469] 15. Terminal: Display the adjusted information on the HUD and guide the user by saying, "There is a rest point in 100 meters."

[0470] 16. User: Follow the suggestions and proceed to your destination in a relaxed state.

[0471] Example 2

[0472] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0473] While navigation systems exist to help users reach their destinations in large stations and crowded areas without getting lost, they often cause anxiety and stress. Furthermore, they lack optimal route guidance with real-time location correction, and navigation information tailored to the user's emotional state is not provided. This makes it difficult for users to reach their destination comfortably. The present invention aims to solve these problems.

[0474] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0475] In this invention, the server includes a means for identifying the user's location information, a means for inputting or setting destination information, an information processing device for calculating the optimal route between the current location and the destination, a visual display device or an audio output device for providing the user with navigation information based on the calculated optimal route, a means for recalculating the route and providing revised navigation information when the user's location changes, and a means for detecting the user's emotions and adjusting the navigation information based on the emotions. This allows the user to receive optimal route guidance including real-time location corrections, and the provision of navigation information according to the user's emotional state, enabling the user to reach the destination comfortably and safely.

[0476] "Means for identifying a user's location information" refers to technology that measures a user's current location using location measurement devices such as GPS sensors and beacons.

[0477] "Means for inputting or setting destination information" refers to technology that allows a user to specify a destination by voice input or text input via a device.

[0478] An "information processing device that calculates the optimal route between the current location and the destination" is a server or computer system equipped with an algorithm for calculating the optimal route based on the user's current location and the set destination.

[0479] "Visual display devices or audio output devices that provide navigation information to users based on the calculated optimal route" refers to devices such as head-up displays (HUDs) that display visual information to users and earphones that provide audio guidance.

[0480] "Means for recalculating routes and providing revised navigation information when the user's location changes" refers to technology that recalculates routes based on new location information when the user's location changes, and provides the results to the user's device in real time.

[0481] "Means for detecting the user's emotions and adjusting navigation information based on those emotions" refers to a technology that analyzes the user's facial expressions, tone of voice, heart rate, etc. to recognize their emotional state, and then adjusts and provides navigation information based on the results.

[0482] The present invention combines a navigation system that helps users avoid getting lost in large train stations and crowded places with an emotion engine that recognizes the user's emotions and adjusts navigation information based on those emotions. Specific embodiments of the present invention will be described below.

[0483] This system uses GPS sensors and beacons to identify the user's location. When the user wears the glasses or earphones and launches a navigation app, the device uses the built-in GPS sensor and surrounding beacon signals to identify the user's current location. The identified location information is sent from the device to the server via an HTTP POST request.

[0484] Next, the user sets their destination within the app by voice or text input. For example, the user can say "Shinjuku Station Southeast Exit" or enter the destination information in a text field. The device formats this destination data and sends it to the server.

[0485] The server receives the user's current location and destination information and calculates the optimal route. The server calculates the shortest route using algorithms such as Dijkstra's algorithm and sends the results in JSON format to the device. Based on the calculated optimal route, the device provides navigation information to the user using the HUD on the glasses or the voice guidance function on the earphones. For example, voice guidance such as "Go straight for 200 meters" or arrows are displayed.

[0486] If the user takes a wrong turn while following the directions, the device will send new location information to the server. The server will recalculate the route based on the new location and send the revised route data in JSON format to the device. The revised navigation information will be notified to the user again via HUD and voice.

[0487] Furthermore, the device uses an emotion engine to detect and analyze the user's facial expressions, tone of voice, heart rate, etc. to recognize the user's emotional state. For example, if the user is feeling anxious, the emotion engine will determine this. The recognized emotional state is sent to the server, which then adjusts the navigation information based on the emotional state. For example, it may provide more detailed instructions or suggest appropriate rest areas. The adjusted navigation information is then sent to the device, where it provides visual or audio guidance to the user. For example, it may display a message such as, "There is a rest point 100 meters further."

[0488] Specific examples

[0489] At Shinjuku Station, the user uses the glasses-type device to set the destination as the Southeast Exit using voice commands.

[0490] The GPS sensor detects the user's current location and sends that information to the server.

[0491] The server calculates the optimal route and sends it to the eyeglasses-type device.

[0492] The HUD displays arrows and distance information to guide the user in the direction they should go.

[0493] If the device takes a wrong turn, it resends updated location information to the server, which then recalculates the route and sends the revised route to the device.

[0494] Prompt Sentence Examples

[0495] "I want to go to the southeast exit of Shinjuku Station."

[0496] "Set destination as Southeast Exit"

[0497] "The emotion engine detected your anxiety."

[0498] "Please provide detailed route directions."

[0499] In this way, the present invention is a system that provides appropriate navigation information based on the user's current location and emotional state, and supports the user in reaching their destination comfortably and safely.

[0500] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0501] Program processing flow

[0502] Get current location

[0503] Step 1:

[0504] User: Puts on the glasses or earbuds and launches a navigation app.

[0505] What happens: A user taps the screen of their smart device to launch a navigation app.

[0506] Input: User action

[0507] Output: App launch

[0508] Step 2:

[0509] Device: Determines current location using built-in GPS sensor and beacons.

[0510] Specific operation: The device's GPS sensor is turned on, and the current latitude and longitude information is obtained, and the surrounding beacon signals are detected to supplement the location information.

[0511] Input: GPS sensor / beacon signal

[0512] Output: Latitude and longitude information of current location

[0513] Step 3:

[0514] Device: Sends the acquired location information to the server.

[0515] Specific operation: Location data including latitude and longitude information is packaged into a packet and sent to the server as an HTTP POST request.

[0516] Input: Latitude and longitude information of current location

[0517] Output: Location data sent to the server

[0518] Setting a destination

[0519] Step 4:

[0520] User: Set a destination in the app by voice or text input.

[0521] Specific behavior: The user speaks "Shinjuku Station Southeast Exit" into the microphone or uses the keyboard to enter the destination information into the text field.

[0522] Input: Voice or text input

[0523] Output: Destination information

[0524] Step 5:

[0525] Terminal: Sends destination information to the server.

[0526] Specific behavior: Formats the destination data and sends it to the server as an HTTP POST request.

[0527] Input: Destination information

[0528] Output: Destination data sent to the server

[0529] Calculating the best route

[0530] Step 6:

[0531] Server: Receives the user's current location and destination information and calculates the optimal route.

[0532] Specific operation: The server retrieves map information from the database and calculates the shortest route using an algorithm such as Dijkstra's algorithm.

[0533] Input: Current location and destination information

[0534] Output: Optimal route information

[0535] Step 7:

[0536] Server: Sends the calculation results to the terminal in real time.

[0537] Specific operation: The coordinate data of the optimal route is compiled into a packet in JSON format and sent to the terminal as an HTTP response.

[0538] Input: Optimal route information

[0539] Output: Route data sent to the device

[0540] Providing navigation information

[0541] Step 8:

[0542] Device: Notifies the user of the navigation information received.

[0543] Specific operation: Arrows and distance information are displayed on the HUD of the glasses-type device, or voice guidance is provided through the earphone-type device.

[0544] Input: Route data

[0545] Output: Navigation information provided to the user

[0546] Step 9:

[0547] User: Follow the device's directions to reach your destination.

[0548] Specific action: The user walks according to the device's instructions.

[0549] Input: Navigation information

[0550] Output: User Move

[0551] Real-time route corrections

[0552] Step 10:

[0553] Terminal: If the user takes a wrong turn, it sends that information to the server.

[0554] What happens: The GPS sensor gets an updated location and sends it back to the server.

[0555] Input: Updated location

[0556] Output: New location data sent to the server.

[0557] Step 11:

[0558] Server: Recalculates the route based on the new location information and sends the revised navigation information to the device.

[0559] Specific operation: The server recalculates the optimal route based on the new location information and sends the revised route data in JSON format to the device.

[0560] Input: New location

[0561] Output: Modified route data

[0562] Step 12:

[0563] Device: Notify the user of the revised navigation information.

[0564] What it does: Display the corrected arrow on the HUD or hear a voice prompt saying "Go back 50 meters and turn right again."

[0565] Input: Modified route data

[0566] Output: Corrected navigation information provided to the user

[0567] Step 13:

[0568] User: Follow the corrected directions to proceed to the destination.

[0569] Specific behavior: The user follows the new instructions.

[0570] Input: Corrected navigation information

[0571] Output: User Move

[0572] User emotion recognition

[0573] Step 14:

[0574] On the device: The emotion engine detects the user's facial expressions, tone of voice, and heart rate.

[0575] Specific operations: Collect data using a camera, microphone, and heart rate sensor.

[0576] Input: facial expression data, voice tone, heart rate

[0577] Output: Detected emotion data

[0578] Step 15:

[0579] Device: Analyzes detected data and recognizes the user's emotional state.

[0580] What it does: It uses machine learning models and algorithms to analyze collected data and determine emotional states.

[0581] Input: Detected emotion data

[0582] Output: Perceived emotional state

[0583] Step 16:

[0584] Device: Sends the recognized emotional state to the server.

[0585] What it does: Formats emotional state data and sends it to the server as an HTTP POST request.

[0586] Input: Perceived emotional state

[0587] Output: Emotion data sent to the server

[0588] Adjusting navigation information

[0589] Step 17:

[0590] Server: Adjust navigation information based on emotional state.

[0591] Specific actions: The server adjusts depending on the emotional state, such as increasing detailed instructions, changing instructions to simpler ones, or suggesting relay points or rest areas.

[0592] Input: Emotion data

[0593] Output: Adjusted navigation information

[0594] Step 18:

[0595] Server: Sends adjusted navigation information to the device.

[0596] Specific operation: The adjusted navigation information is compiled in JSON format and sent to the device as an HTTP response.

[0597] Input: Adjusted navigation information

[0598] Output: Navigation information sent to the device

[0599] Step 19:

[0600] Device: Notify user of adjusted navigation information.

[0601] What it does: Display adjusted navigation information on the HUD or provide audio guidance.

[0602] Input: Adjusted navigation information

[0603] Output: Adjusted navigation information provided to the user

[0604] (Application example 2)

[0605] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0606] In large stations and crowded areas, users often get lost when trying to find their destination, which can lead to stress and anxiety. Existing navigation systems lack consideration for the user's emotional state, resulting in a poor user experience. Furthermore, they lack detailed directions and guidance for rest stops, and navigation information can be overly complex, increasing anxiety. There is a need for a navigation system that can solve these issues and enable users to travel comfortably and safely.

[0607] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for identifying user location information, a means for inputting or setting destination information, a means for calculating an optimal route between the current location and the destination, a wearable device for providing navigation information to the user based on the calculated optimal route, a means for recalculating the route and providing revised navigation information when the user's location changes, and an emotion recognition engine for detecting the user's emotional state and adjusting the navigation information. This reduces the anxiety and stress the user feels during navigation, enabling the user to travel comfortably and with peace of mind.

[0608] "Means for identifying the user's location information" refers to technology that uses GPS sensors and beacon systems to obtain the user's current location in real time.

[0609] "Means for inputting or setting destination information" refers to technology that allows users to specify a destination through voice input or text input.

[0610] The "server device that calculates the optimal route between the current location and the destination" is a server that uses map information and algorithms to calculate the most efficient route from the user's current location to the destination.

[0611] "Wearable devices that provide users with navigation information based on calculated optimal routes" refers to eyeglasses or earphones that provide users with visual or audio guidance based on calculated route information.

[0612] "Means for recalculating the route and providing revised navigation information when the user's location changes" refers to technology for recalculating a new route and providing that information when the user deviates from the planned route.

[0613] The "emotion recognition engine that detects the user's emotional state and adjusts navigation information" is a technology that analyzes the user's facial expressions, heart rate, tone of voice, etc. to determine their emotional state and changes the navigation information based on that.

[0614] This invention is a navigation system that helps users avoid losing track of their destination in large shopping malls, crowded train stations, large commercial facilities, and other locations. The system provides a means for accurately acquiring the user's location information and setting the destination. It also utilizes a server device that calculates the optimal route between the user's current location and the destination, and a wearable device that provides navigation information based on the calculated optimal route. Furthermore, if the user takes a wrong turn, the system has the function of recalculating the route and providing corrected navigation information. Furthermore, by incorporating an emotion recognition engine, the system can detect the user's emotional state and adjust the navigation information accordingly.

[0615] First, the user puts on the glasses or earphones provided by the device and launches the navigation application. The device uses the built-in GPS sensor or beacon system to identify the user's current location and sends that location information to the server. The user then sets their destination within the app using voice or text input. This destination information is also sent to the server.

[0616] The server calculates the optimal route based on the received location and destination information and sends the results to the device in real time. The device then provides the received navigation information visually on glasses and audibly on earphones. If the user follows the guidance but accidentally goes in the wrong direction, the device will send updated location information to the server again. The server will then recalculate based on the new location information and send the revised navigation information to the device.

[0617] The emotion recognition engine detects the user's facial expressions, tone of voice, heart rate, etc. and analyzes the data to recognize the user's emotional state. This emotional state data is also sent to the server, which then adjusts the navigation information according to the user's emotions. For example, if the user is feeling anxious or stressed, the server will suggest detailed route directions and appropriate rest stops.

[0618] Specifically, consider a scenario in which a user is searching for a specific store in a shopping mall. The user inputs their destination using the eyeglasses, and navigation begins. The device tracks the user's location in real time and provides the optimal route. If the user takes a wrong turn along the way, the server recalculates a new route based on the updated location information and provides revised guidance.

[0619] At the same time, the emotion recognition engine detects the user's facial expressions and heart rate, and if it determines that the user is feeling anxious, the server provides detailed route guidance and suggests rest points. For example, the server might say, "You seem a little anxious right now. There is a rest area around the next corner, so why not take a break?" In this way, the navigation system allows users to reach their destination comfortably and with peace of mind.

[0620] An example of a prompt is as follows:

[0621] "Create a navigation app that provides the best route to help users find the store they're looking for, and adapts the navigation based on the user's emotional state."

[0622] This system will significantly improve users' navigation experience and support safe and comfortable travel.

[0623] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0624] Step 1:

[0625] The user puts on the glasses or earphones and launches the navigation application. The user specifies the destination by voice or text input. The input is analyzed by a speech recognition engine or text analysis engine, and the destination information is extracted. The extracted destination information is packetized in JSON format and sent to the server.

[0626] Step 2:

[0627] The device uses the built-in GPS sensor or beacon system to determine the user's current location. The acquired latitude and longitude information of the current location is compiled into a data packet and sent to the server as an HTTP POST request. The input data is obtained from the GPS sensor or beacon, and the output data is the user's current location information.

[0628] Step 3:

[0629] The server receives the user's current location and destination information and calculates the optimal route based on that. The server retrieves map information from a database and derives the optimal route using a route calculation algorithm such as Dijkstra's algorithm. The input data are the current location and destination information, and the output data is the calculated optimal route.

[0630] Step 4:

[0631] The server sends the calculated route information to the terminal in real time. The sent data is encoded as a JSON format packet and sent to the terminal as an HTTP response. The input data is the optimal route information, and the output data is navigation data.

[0632] Step 5:

[0633] The device analyzes the received navigation data and guides the user visually in the case of glasses-type devices and audibly in the case of earphone-type devices. Specifically, arrows and distance information are overlaid on the HUD of the glasses-type device, and the direction and distance are guided to the user audibly in the case of earphone-type devices. The input data is the navigation data received from the server, and the output data is the visual or audible guidance.

[0634] Step 6:

[0635] The user follows the device's guidance, but may accidentally go in the wrong direction. When this happens, the device reconfirms its current location using the GPS sensor or beacon system. The new location information is again sent to the server. The input data is the updated location information, and the output data is the new location information.

[0636] Step 7:

[0637] The server receives the new location information and recalculates the optimal route. The server reacquires map information and uses a route calculation algorithm to derive a new route. The newly calculated route information is again sent to the device. The input data is the new location information, and the output data is the revised route information.

[0638] Step 8:

[0639] The device analyzes the revised navigation information and provides the user with visual and audio guidance again. The HUD displays updated arrows and distance information, and the earphone device provides audio guidance with the new direction and distance. The input data is the revised navigation data, and the output data is the updated guidance.

[0640] Step 9:

[0641] The device uses an emotion recognition engine to detect the user's facial expressions, tone of voice, heart rate, etc. It analyzes this data to recognize the user's emotional state and sends that information to the server. The input data is emotional data obtained from the camera, microphone, and heart rate sensor, and the output data is the recognized emotional state.

[0642] Step 10:

[0643] Based on the received emotional state, the server adjusts navigation information to alleviate the user's anxiety and stress. This adjustment includes detailed route guidance and suggestions for rest stops. The adjusted navigation information is then sent back to the device. The input data is the recognized emotional state, and the output data is the adjusted navigation information.

[0644] Step 11:

[0645] The device analyzes the adjusted navigation information and provides visual or audio guidance to the user. For example, the device may provide guidance such as, "Turn right at the next corner and there is a rest area. Please take a break." The input data is the adjusted navigation data, and the output data is the visual or audio guidance.

[0646] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0647] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0648] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0649] [Second embodiment]

[0650] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0651] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0652] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0653] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0654] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0655] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0656] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0657] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0658] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0659] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0660] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0661] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0662] The present invention is a navigation system that helps users avoid getting lost in large train stations and other crowded places. This system identifies the user's current location, calculates the optimal route to the destination, and provides navigation information in real time. The program processing flow of this system is explained in detail below.

[0663] Program processing flow

[0664] Getting the user's current location

[0665] 1. User: Puts on the eyeglasses or earbuds and launches the navigation app.

[0666] When the app is launched, the device prepares to obtain its location information.

[0667] 2. Device: Determines current location using built-in GPS sensor or beacon.

[0668] The GPS sensor is activated to obtain latitude and longitude information, and if a beacon is available, its signal is detected and used as supplemental information.

[0669] 3. Device: Sends the acquired location information to the server.

[0670] The location information is packetized and sent to the server as an HTTP POST request.

[0671] Setting a destination

[0672] 4. User: Set a destination in the app by voice or text input.

[0673] For example, you can say "Shinjuku Station Southeast Exit" or enter it into the text form.

[0674] 5. Terminal: Sends destination information to the server.

[0675] The destination information is formatted and sent to the server.

[0676] Calculating the best route

[0677] 6. Server: Obtains current location and destination information and calculates the optimal route.

[0678] The server retrieves map information from a database and uses an algorithm (e.g., Dijkstra algorithm) to calculate the optimal route.

[0679] 7. Server: Sends the calculation results to the terminal in real time.

[0680] The calculated route information is packetized in JSON format and sent to the terminal.

[0681] Providing navigation information

[0682] 8. Terminal: The received navigation information is displayed to the user (glasses-type device) or guided by voice (earphone-type device).

[0683] In the case of glasses-type devices, arrows and distance information are displayed on the HUD, while in the case of earphone-type devices, direction and distance are guided by voice.

[0684] 9. User: Follow the device's directions to your destination.

[0685] Real-time route corrections

[0686] 10. Terminal: If the user takes a wrong turn, it sends that information to the server.

[0687] A new location is obtained and retransmitted to the server.

[0688] 11. Server: Recalculate the route based on the new location information and send the revised navigation information to the device.

[0689] Recalculate the optimal route from the new location information and send the revised route.

[0690] 12. Terminal: Display or audibly notify the user of the revised navigation information.

[0691] The glasses-type device displays the corrected route on the HUD, while the earphone-type device provides voice guidance such as "Go back 50 meters and turn left."

[0692] Specific examples

[0693] Meeting scenario at Shinjuku Station

[0694] 1. User: I am meeting a friend at Shinjuku Station and am using the glasses.

[0695] 2. User: Launch the app on the glasses-type device and voice-input "Southeast Exit" as the destination.

[0696] 3. Device: Detects current location using GPS sensor and sends that information to the server.

[0697] 4. Server: Calculates the optimal route between the current location and the destination "Southeast Exit" and sends it to the eyeglasses.

[0698] 5. Terminal: Displays arrows and distance information on the HUD to instruct the user on which direction to go.

[0699] 6. User: Follows instructions but accidentally goes in the wrong direction.

[0700] 7. Device: Resends updated location to server.

[0701] 8. Server: Recalculate the route based on the new position and send the corrected route.

[0702] 9. Terminal: Display the corrected route on the HUD and guide the user in the right direction.

[0703] 10. User: Proceed in the correct direction and arrive safely at the "Southeast Exit".

[0704] This series of processes allows users to reach their destination safely and efficiently, even in large stations and crowded places. This invention reduces the chances of getting lost or missing meeting places, and reduces stress and anxiety for users.

[0705] The processing flow will be explained below.

[0706] Step 1:

[0707] User: Puts on the glasses or earbuds and launches a navigation app.

[0708] Action: The user taps on the app to launch it.

[0709] Step 2:

[0710] Device: Determines current location using built-in GPS sensor or beacon.

[0711] Action: The GPS sensor is activated to obtain the current latitude and longitude coordinates, and if available, to detect beacon signals to supplement the location.

[0712] Step 3:

[0713] Device: Sends the acquired location information to the server.

[0714] Action: Packet location data (latitude and longitude) and send an HTTP POST request to the server.

[0715] Step 4:

[0716] User: Set a destination by voice or text input within the app.

[0717] Action: Say "Shinjuku Station Southeast Exit" or type it into the text field.

[0718] Step 5:

[0719] Terminal: Sends destination information to the server.

[0720] Action: Format the destination data and send it to the server as an HTTP POST request.

[0721] Step 6:

[0722] Server: Obtains the user's current location and destination information and calculates the optimal route.

[0723] Action: The server retrieves map information from the database and calculates the optimal route using an algorithm (e.g., Dijkstra algorithm).

[0724] Step 7:

[0725] Server: Sends the calculation results to the terminal in real time.

[0726] Action: Packet the coordinate data of the optimal route in JSON format and send it to the device as an HTTP response.

[0727] Step 8:

[0728] Terminal: Provides the received navigation information to the user visually or audibly.

[0729] Action: Display arrows and distance information on the HUD (glasses) or provide audio guidance of direction and distance (earbuds).

[0730] Step 9:

[0731] User: Follow the device's directions to reach your destination.

[0732] Action: Follow the arrows and audio prompts.

[0733] Step 10:

[0734] Terminal: If the user takes a wrong turn, the sensor detects it and sends the information to the server.

[0735] Action: The GPS sensor gets an updated location and sends it back to the server.

[0736] Step 11:

[0737] Server: Recalculates the route based on the new location information and sends the revised navigation information to the device.

[0738] Action: Recalculate the optimal route based on the new location information and send the revised route data in JSON format to the device.

[0739] Step 12:

[0740] On the device: Display or audibly notify the user of the revised navigation information.

[0741] Action: Display corrected arrow on HUD or voice prompt "Go back 50 meters and then right again."

[0742] Step 13:

[0743] User: Follows the revised directions and proceeds to the destination.

[0744] Action: Correct the mistake and move in the right direction.

[0745] Example 1

[0746] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0747] In large stations and crowded areas, it is difficult for users to reach their destination efficiently without getting lost. This can cause users anxiety and stress. Furthermore, there is a lack of navigation systems that can respond to real-time location changes, making it difficult to correct a route once it has been set. There is a need for a system that can solve these problems and provide users with a comfortable journey.

[0748] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0749] In this invention, the server includes means for acquiring user location information, means for inputting or setting destination information, means for calculating the optimum route between the acquired current location and the set destination, means for providing guidance information to the user based on the calculated optimum route, and means for recalculating the route and providing revised guidance information when the user's location changes, thereby enabling the user to reach their destination efficiently without getting lost even in large stations or crowded places.

[0750] "User" refers to a person who uses this system to obtain location information and set a destination.

[0751] "Means of obtaining location information" refers to devices or technologies for measuring a user's current location, specifically devices that use GPS sensors or beacons.

[0752] "Means for inputting or setting destination information" refers to an interface or device that allows a user to specify the location they want to go to, specifically a device for voice input or text input.

[0753] "Computing device" refers to the device or technology, specifically the server, that calculates the optimal route based on the user's current location and destination information.

[0754] The term "display device" refers to a device for providing visual guidance information to a user, specifically, a glasses-type device.

[0755] "Audio output device" refers to a device that provides guidance information to users by voice, specifically an earphone-type device.

[0756] "Re-route means" refers to the technology or algorithm used to recalculate a new, optimal route from the user's current location to the destination if the user's location changes.

[0757] "Guidance information" refers to information about the direction and distance a user needs to reach their destination.

[0758] "Real-time" refers to updating and providing information immediately when a user's location information changes.

[0759] The present invention relates to a navigation system that helps users avoid getting lost in large train stations and other crowded places. The system identifies the user's current location, calculates the optimal route to the destination, and provides real-time navigation information.

[0760] System configuration

[0761] The system consists of the following main components:

[0762] 1. User terminal: Glasses-type device or earphone-type device.

[0763] 2. Server: Performs route calculation and data management.

[0764] 3. Network: The communications infrastructure that connects user devices and servers.

[0765] Hardware and Software Examples

[0766] User device:

[0767] User terminals are glasses-type devices (e.g., smart glasses) with built-in GPS sensors or earphone-type devices (e.g., smart earphones) with voice guidance functions.

[0768] These devices use dedicated applications that run on operating systems such as Android and iOS.

[0769] server:

[0770] The server is installed with a database management system (e.g., MySQL) and software for executing a route calculation algorithm (e.g., Dijkstra's algorithm).

[0771] The server communicates with the user terminal using the HTTP protocol.

[0772] network:

[0773] Data is exchanged between the user terminal and the server using the Internet or a dedicated local network.

[0774] Data processing and calculation

[0775] User device: Uses a GPS sensor and beacon receiver to measure the current location and send that location information to the server. It also organizes destination information specified by the user and sends it to the server.

[0776] Server: Based on the received location and destination information, retrieves map data from the database, calculates the optimal route using a route calculation algorithm, and sends the calculation results to the user's device in real time.

[0777] Example of processing flow

[0778] Example 1: Meeting scenario at Shinjuku Station

[0779] 1. A user uses the eyeglasses to meet a friend at Shinjuku Station.

[0780] 2. The user launches the app on their device and voice-inputs "Southeast Exit" as their destination.

[0781] 3. The device determines its current location using its built-in GPS sensor and sends that information to the server.

[0782] 4. The server calculates the optimal route based on the received location information and the destination information, "Southeast Exit," and sends the results to the eyeglasses.

[0783] 5. The device displays arrows and distance information on the HUD to instruct the user on which direction to go.

[0784] 6. Users follow instructions but sometimes accidentally go in the wrong direction.

[0785] 7. The device obtains new location information and retransmits it to the server.

[0786] 8. The server recalculates the route based on the new location information and sends the revised route to the user device.

[0787] 9. The device displays the corrected route on the HUD and guides the user in the correct direction.

[0788] Examples of prompt statements

[0789] The following prompts can be used for speech or text input:

[0790] 1. "Please take me to the southeast exit of Shinjuku Station."

[0791] 2. "Please set a new destination. Southeast Exit."

[0792] 3. "What is the best route from my current location to my destination?"

[0793] This invention allows users to reach their destination efficiently without getting lost even in large stations or crowded places. This system reduces the chances of getting lost or missing meeting places, and reduces stress and anxiety for users.

[0794] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0795] Step 1:

[0796] The user turns on the eyeglasses or earphones.

[0797] Specific behavior: User turns on the device and opens the navigation app.

[0798] Input: User actions (device launch and app launch).

[0799] Output: The device is initialized and ready to acquire location information.

[0800] Step 2:

[0801] The device activates the GPS sensor and beacon to determine its current location.

[0802] Specific operation: The GPS sensor inside the device is activated, and the device captures surrounding beacon signals.

[0803] Input: Device location sensors (GPS and beacons).

[0804] Output: Latitude and longitude information and signal information from the beacon.

[0805] Step 3:

[0806] The location information acquired by the device is sent to the server.

[0807] Specific operation: The location information is converted into JSON format and sent to the server as an HTTP POST request.

[0808] Input: Latitude and longitude information and beacon signal data.

[0809] Output: Confirmation of sending location information to the server.

[0810] Step 4:

[0811] The user sets the destination by voice or text input.

[0812] Specific operation: The user specifies a destination using the device's input interface (microphone or keyboard). For example, the user enters "Shinjuku Station Southeast Exit."

[0813] Input: User speaks or texts destination.

[0814] Output: Destination information confirmed and set.

[0815] Step 5:

[0816] The terminal transmits the destination information to the server.

[0817] Specific operation: The input destination information is formatted, converted into JSON format, and sent to the server.

[0818] Input: Destination text or audio data.

[0819] Output: Confirmation of sending destination information to the server.

[0820] Step 6:

[0821] The server obtains information about the current location and destination and calculates the optimal route.

[0822] Specific operation: The server retrieves map information from the database and calculates the optimal route using a route calculation algorithm (e.g., Dijkstra algorithm).

[0823] Input: User's current location and destination information.

[0824] Output: Calculated optimal route data.

[0825] Step 7:

[0826] The server sends the calculation results to the terminal in real time.

[0827] Specific operation: The calculated route information is packetized in JSON format and sent to the terminal as an HTTP response.

[0828] Input: Optimal route data calculated by the server.

[0829] Output: Confirmation of sending route information to the device.

[0830] Step 8:

[0831] The navigation information received by the device is displayed or audibly provided to the user.

[0832] Specific operation: For glasses-type devices, arrows and distance information will be displayed on the HUD. For earphone-type devices, voice guidance will be provided.

[0833] Input: Route information received from the server.

[0834] Output: Providing visual or audio guidance to the user.

[0835] Step 9:

[0836] The user follows the navigation information.

[0837] Specific operation: The user follows the guidance of the glasses-type device or earphone-type device to move in the direction they should go.

[0838] Input: Guidance information from the terminal.

[0839] Output: The user follows the route provided.

[0840] Step 10:

[0841] If the device changes the user's location, it sends it back to the server.

[0842] Specific behavior: If the user deviates from the specified route, obtain new location information and resend it to the server.

[0843] Input: Updated location information.

[0844] Output: Confirmation of sending new location to server.

[0845] Step 11:

[0846] The server recalculates the route based on the new location information and sends the revised navigation information to the device.

[0847] Specific operation: The optimal route is recalculated based on the new location information, and the revised route information is packetized in JSON format and sent to the terminal.

[0848] Input: New location.

[0849] Output: Confirmation of sending corrected route information.

[0850] Step 12:

[0851] The device will display or audibly notify the user of the revised navigation information.

[0852] Specific operation: In the case of glasses-type devices, the revised route will be displayed on the HUD, and in the case of earphone-type devices, voice guidance will be given, such as "Go back 50 meters and turn left."

[0853] Input: The modified route information received from the server.

[0854] Output: Providing visual or audio correction guidance to the user.

[0855] (Application example 1)

[0856] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0857] Conventional navigation systems have limitations when it comes to navigating large stations and crowded areas. In particular, in businesses like food delivery, it is important to reach your destination efficiently, but it is difficult to flexibly change routes to take real-time traffic information into account. Furthermore, there are limited ways to provide navigation information, leaving delivery drivers with few intuitive and easy-to-understand directions.

[0858] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0859] In this invention, the server includes means for acquiring user location information and providing an optimal route to support the delivery driver's work, means for dynamically correcting the route by reflecting real-time traffic information, and means for providing navigation information to the device. This allows the delivery driver to receive optimal route information in real time and flexibly change the route according to traffic conditions, enabling efficient and effective delivery.

[0860] "Means of identifying the user's location"

[0861] It is a technology that uses sensors such as GPS and beacons to accurately detect the user's current location.

[0862] "Method for entering or setting destination information"

[0863] is a technology that allows users to specify navigation destinations to applications through voice or text input.

[0864] "Server device for calculating optimal routes"

[0865] is a computer system that uses an algorithm (e.g., Dijkstra algorithm or A) to calculate the shortest or fastest route based on the user's current location and destination.

[0866] "Eyeglasses-type device that provides navigation information"

[0867] is a wearable device that has a visual display and overlays navigation instructions into the user's field of view.

[0868] "Earphone-type device that provides navigation information"

[0869] is a wearable device that can provide navigation information to users via voice.

[0870] "Real-time traffic information"

[0871] This is road condition data that is updated instantly, including current traffic conditions, congestion, and accident information.

[0872] "Means for dynamically correcting routes"

[0873] This is a technology that takes real-time traffic information into account to recalculate the optimal route and provide it to the user.

[0874] "A means of providing optimal routes to support delivery drivers' work"

[0875] This is a technology that calculates and guides delivery drivers to the optimal delivery route to reach their destination efficiently and quickly.

[0876] The present invention is a system that identifies a user's current location, calculates the optimal route to a destination, and provides navigation information in real time, and is particularly used to improve the efficiency of food delivery operations.

[0877] 1. Obtaining user location information

[0878] The server uses the GPS sensor built into the delivery driver's smartphone to accurately determine the driver's current location (latitude and longitude). This GPS sensor sends the driver's location information to the server in real time. For example, the server can obtain location information using the smartphone's location information service.

[0879] 2. Setting destination information

[0880] The user sets the destination address of the customer on their smartphone using voice recognition or text input. Voice recognition technology can use the Google Voice Recognition API or a voice interface provided by the requester. The set address is sent to the server and used as the destination information for navigation.

[0881] 3. Calculating the optimal route

[0882] The server receives the user's current location and destination information to calculate the optimal route for navigation. The calculation uses Dijkstra's algorithm or A algorithm, which are executed on the server. The calculation results are sent to the user's smartphone or smart glasses in real time.

[0883] 4. Providing navigation information

[0884] The device provides the user with the optimal route information received from the server. In the case of a smartphone, the route map and direction instructions are displayed on the screen. In addition, if smart glasses are used, navigation information is overlaid on the HUD (Heads-Up Display). In the case of earphone-type devices, navigation information such as direction and distance is provided by voice.

[0885] 5. Real-time route correction

[0886] If road conditions change while the user is traveling, such as when traffic jams or an accident occurs, new location information is sent to the server. The server then recalculates the optimal route based on this information and sends the revised route information to the device in real time. This allows the user to navigate efficiently based on the latest information.

[0887] Specific hardware and software to be used

[0888] Smartphone: GPS sensor, location information services

[0889] Server: High performance server (Python, Node.js, PostgreSQL)

[0890] Glasses-type device: HUD (Heads-Up Display)

[0891] Earphone-type devices: Audio output technology

[0892] Example scenario

[0893] Consider a scenario where a user is working as a food delivery driver near Shinjuku Station. The delivery driver launches a smartphone app and uses the GPS sensor to determine their current location. They then voice-enter the customer's address and set it as their destination. The server calculates the optimal route based on their current location and destination information and sends it to the smartphone in real time. The driver then follows the navigation information displayed on the smartphone or smart glasses. If traffic congestion occurs along the way, new location information is sent to the server and the route is recalculated. The revised route information is then provided to the driver in real time.

[0894] Prompt Sentence Examples

[0895] What is the algorithm of the food delivery app that calculates the optimal route from Shinjuku Station to the customer's address and adjusts the route in real time to reflect current traffic information? Please also provide a detailed explanation of the technologies used (GPS, voice recognition, navigation, real-time updates).

[0896] In this way, the present invention can significantly improve the efficiency of delivery drivers by combining user location information with real-time traffic information.

[0897] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0898] Step 1:

[0899] When a user launches a smartphone app, the app uses the GPS sensor to obtain the user's current location (latitude and longitude).

[0900] Input: Smartphone app launch, GPS sensor data

[0901] Output: Current location (latitude and longitude) data

[0902] Specific behavior: Uses the smartphone's location services to call APIs such as locationManager.getLastKnownLocation() to obtain the coordinates of the current location.

[0903] Step 2:

[0904] The user sets the destination information (customer's address) through voice recognition or text input.

[0905] Input: Voice or text input data

[0906] Output: Destination information (address)

[0907] Specific operation: In the case of voice input, the user's destination is obtained using the Google Voice Recognition API, and in the case of text input, the destination is obtained using an input form within the app.

[0908] Step 3:

[0909] The device sends the current location and destination information to the server.

[0910] Input: Current location (latitude and longitude) data, destination information (address)

[0911] Output: HTTP POST request to the server

[0912] Specific operation: Format the current location and destination data into JSON format and send it to the server as an HTTP POST request.

[0913] Step 4:

[0914] The server calculates the optimal route based on the current location and destination information.

[0915] Input: Current location (latitude and longitude) data, destination information (address)

[0916] Output: Optimal route data (route information, distance, time, etc.)

[0917] Specific operation: The server retrieves map data from the database and calculates the optimal route using Dijkstra's algorithm or A algorithm.

[0918] Step 5:

[0919] The server sends the calculated optimal route to the terminal.

[0920] Input: Optimal route data

[0921] Output: HTTP response to the device

[0922] Specific operation: The calculated route information is packetized in JSON format and sent to the terminal as an HTTP response.

[0923] Step 6:

[0924] The terminal provides the received navigation information to the user.

[0925] Input: Optimal route data

[0926] Output: On-screen display or voice guidance

[0927] Specific operation: In the case of a smartphone, the route is displayed using a map application, in the case of smart glasses, the information is overlaid on the HUD, and in the case of earphones, voice guidance is provided.

[0928] Step 7:

[0929] The user follows the navigation.

[0930] Input: Navigation information provided by the device

[0931] Output: Tracking of travel route

[0932] Specific actions: The user follows instructions on their smartphone or smart glasses to move towards their destination.

[0933] Step 8:

[0934] The device updates the user's location information in real time and sends it to the server.

[0935] Input: Continuous GPS data

[0936] Output: Updated location information sent to the server

[0937] Specific operation: Obtain location information at regular intervals and resend it to the server.

[0938] Step 9:

[0939] The server recalculates the route based on real-time traffic information.

[0940] Input: Updated location, real-time traffic information

[0941] Output: Modified route data

[0942] Specific operation: The server recalculates the optimal route taking into account the new location information and real-time traffic information.

[0943] Step 10:

[0944] The server sends the modified route information to the terminal.

[0945] Input: Modified route data

[0946] Output: HTTP response to the device

[0947] Specific operation: The corrected route information is packetized in JSON format and sent to the terminal as an HTTP response.

[0948] Step 11:

[0949] The terminal provides the revised route information to the user.

[0950] Input: Modified route data

[0951] Output: Corrected screen display or voice guidance

[0952] Specific operation: On smartphones, the updated map information will be redisplayed, and on smart glasses or earphones, the updated information will be displayed as an overlay or announced via voice guidance.

[0953] Through the above processing steps, delivery drivers receive optimal route information in real time, enabling them to flexibly change routes according to traffic conditions, enabling them to make deliveries efficiently and effectively.

[0954] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0955] The present invention combines a navigation system that helps users avoid getting lost in large train stations and crowded places with an emotion engine that recognizes the user's emotions and adjusts navigation information based on those emotions. Specific embodiments of the present invention will be described below.

[0956] Program processing flow

[0957] Getting the user's current location

[0958] 1. User: Puts on the eyeglasses or earbuds and launches the navigation app.

[0959] Action: The user taps on the app to launch it.

[0960] 2. Device: Determines current location using built-in GPS sensor or beacon.

[0961] Action: The GPS sensor is activated to obtain the current latitude and longitude coordinates, and if available, to detect beacon signals to supplement the location.

[0962] 3. Device: Sends the acquired location information to the server.

[0963] Action: Packet location data (latitude and longitude) and send an HTTP POST request to the server.

[0964] Setting a destination

[0965] 4. User: Set a destination by voice or text input within the app.

[0966] Action: Say "Shinjuku Station Southeast Exit" or type it into the text field.

[0967] 5. Terminal: Sends destination information to the server.

[0968] Action: Format the destination data and send it to the server as an HTTP POST request.

[0969] Calculating the best route

[0970] 6. Server: Obtains the user's current location and destination information and calculates the optimal route.

[0971] Action: The server retrieves map information from the database and calculates the optimal route using an algorithm (e.g., Dijkstra algorithm).

[0972] 7. Server: Sends the calculation results to the terminal in real time.

[0973] Action: Packet the coordinate data of the optimal route in JSON format and send it to the device as an HTTP response.

[0974] Providing navigation information

[0975] 8. Terminal: Provides the received navigation information to the user visually or audibly.

[0976] Action: Display arrows and distance information on the HUD (glasses) or provide audio guidance of direction and distance (earbuds).

[0977] 9. User: Follow the device's directions to your destination.

[0978] Action: Follow the arrows and audio prompts.

[0979] Real-time route corrections

[0980] 10. Terminal: If the user takes a wrong turn, the sensor will detect it and send the information to the server.

[0981] Action: The GPS sensor gets an updated location and sends it back to the server.

[0982] 11. Server: Recalculate the route based on the new location information and send the revised navigation information to the device.

[0983] Action: Recalculate the optimal route based on the new location information and send the revised route data in JSON format to the device.

[0984] 12. Terminal: Display or audibly notify the user of the revised navigation information.

[0985] Action: Display corrected arrow on HUD or voice prompt "Go back 50 meters and then right again."

[0986] 13. User: Follow the modified directions and proceed towards your destination.

[0987] Action: Correct the mistake and move in the right direction.

[0988] Emotion Engine Processing Flow

[0989] User emotion recognition

[0990] 1. Device: The emotion engine detects the user's facial expressions, tone of voice, heart rate, etc.

[0991] Action: Collect data using devices such as cameras, microphones, and heart rate sensors.

[0992] 2. Device: Analyzes the detected data and recognizes the user's emotional state.

[0993] Action: Use machine learning models and algorithms to determine the user's emotional state from the collected data.

[0994] 3. Terminal: Sends the recognized emotional state to the server.

[0995] Action: Format the emotional state data and send it to the server as an HTTP POST request.

[0996] Adjusting navigation information

[0997] 4. Server: Based on the user's emotional state, adjust navigation information to reduce anxiety and stress.

[0998] Action: For example, make adjustments such as providing more detailed instructions, simplifying instructions, or suggesting stopovers or rest areas.

[0999] 5. Server: Sends the adjusted navigation information to the device.

[1000] Action: Packet the adjusted navigation information in JSON format and send it to the device as an HTTP response.

[1001] 6. Terminal: Providing tailored navigation information to the user visually or audibly.

[1002] Action: Display on HUD or give voice prompt.

[1003] Specific examples

[1004] Meeting scenario at Shinjuku Station

[1005] 1. User: I am meeting a friend at Shinjuku Station and am using the glasses.

[1006] 2. User: Launch the app on the glasses-type device and voice-input "Southeast Exit" as the destination.

[1007] 3. Device: Detects current location using GPS sensor and sends that information to the server.

[1008] 4. Server: Calculates the optimal route between the current location and the destination "Southeast Exit" and sends it to the eyeglasses.

[1009] 5. Terminal: Displays arrows and distance information on the HUD to instruct the user on which direction to go.

[1010] 6. User: Follows instructions but accidentally goes in the wrong direction.

[1011] 7. Device: Resends updated location to server.

[1012] 8. Server: Recalculate the route based on the new position and send the corrected route.

[1013] 9. Terminal: Display the corrected route on the HUD and guide the user in the right direction.

[1014] 10. User: Proceed in the correct direction and arrive safely at the "Southeast Exit".

[1015] 11. On the device: At the same time, the emotion engine detects the user's facial expressions and tone of voice and determines that the user is feeling anxious.

[1016] 12. Server: Provides detailed directions and suggests appropriate rest areas depending on the anxiety state.

[1017] 13. Terminal: Display the adjusted information on the HUD and guide the user by saying, "There is a rest point in 100 meters."

[1018] In this way, the present invention is a system that provides appropriate navigation information based on the user's current location and emotional state, and supports the user in reaching their destination comfortably and safely.

[1019] The processing flow will be explained below.

[1020] Step 1:

[1021] User: Puts on the glasses or earbuds and launches a navigation app.

[1022] Action: The user taps on the app to launch it.

[1023] Step 2:

[1024] Device: Determines current location using built-in GPS sensor or beacon.

[1025] Action: The GPS sensor is activated to obtain the current latitude and longitude coordinates, and if available, to detect beacon signals to supplement the location.

[1026] Step 3:

[1027] Device: Sends the acquired location information to the server.

[1028] Action: Packet location data (latitude and longitude) and send an HTTP POST request to the server.

[1029] Step 4:

[1030] User: Set a destination by voice or text input within the app.

[1031] Action: Say "Shinjuku Station Southeast Exit" or type it into the text field.

[1032] Step 5:

[1033] Terminal: Sends destination information to the server.

[1034] Action: Format the destination data and send it to the server as an HTTP POST request.

[1035] Step 6:

[1036] Server: Obtains the user's current location and destination information and calculates the optimal route.

[1037] Action: The server retrieves map information from the database and calculates the optimal route using an algorithm (e.g., Dijkstra algorithm).

[1038] Step 7:

[1039] Server: Sends the calculation results to the terminal in real time.

[1040] Action: Packet the coordinate data of the optimal route in JSON format and send it to the device as an HTTP response.

[1041] Step 8:

[1042] Terminal: Provides the received navigation information to the user visually or audibly.

[1043] Action: Display arrows and distance information on the HUD (glasses) or provide audio guidance of direction and distance (earbuds).

[1044] Step 9:

[1045] User: Follow the device's directions to reach your destination.

[1046] Action: Follow the arrows and audio prompts.

[1047] Step 10:

[1048] Terminal: If the user takes a wrong turn, the sensor detects it and sends the information to the server.

[1049] Action: The GPS sensor gets an updated location and sends it back to the server.

[1050] Step 11:

[1051] Server: Recalculates the route based on the new location information and sends the revised navigation information to the device.

[1052] Action: Recalculate the optimal route based on the new location information and send the revised route data in JSON format to the device.

[1053] Step 12:

[1054] On the device: Display or audibly notify the user of the revised navigation information.

[1055] Action: Display corrected arrow on HUD or voice prompt "Go back 50 meters and then right again."

[1056] Step 13:

[1057] Device: The emotion engine detects the user's facial expressions, tone of voice, heart rate, etc.

[1058] Action: Collect data using devices such as cameras, microphones, and heart rate sensors.

[1059] Step 14:

[1060] Device: Analyzes detected data and recognizes the user's emotional state.

[1061] Action: Use machine learning models and algorithms to determine the user's emotional state from the collected data.

[1062] Step 15:

[1063] Device: Sends the recognized emotional state to the server.

[1064] Action: Format the emotional state data and send it to the server as an HTTP POST request.

[1065] Step 16:

[1066] Server: Based on the user's emotional state, adjust navigation information to reduce anxiety and stress.

[1067] Action: For example, make adjustments such as providing more detailed instructions, simplifying instructions, or suggesting stopovers or rest areas.

[1068] Step 17:

[1069] Server: Sends adjusted navigation information to the device.

[1070] Action: Packet the adjusted navigation information in JSON format and send it to the device as an HTTP response.

[1071] Step 18:

[1072] Device: Provides tailored navigation information to the user visually or audibly.

[1073] Action: Display on HUD or give voice prompt.

[1074] Step 19:

[1075] User: Follow the tailored guidance and proceed towards your destination in a relaxed state.

[1076] Action: Follow the tailored details and rest stop suggestions to stay safe and relaxed.

[1077] Specific examples

[1078] Meeting scenario at Shinjuku Station

[1079] 1. User: I am meeting a friend at Shinjuku Station and am using the glasses.

[1080] 2. User: Launch the app on the glasses-type device and voice-input "Southeast Exit" as the destination.

[1081] 3. Device: Detects current location using GPS sensor and sends that information to the server.

[1082] 4. Server: Calculates the optimal route between the current location and the destination "Southeast Exit" and sends it to the eyeglasses.

[1083] 5. Terminal: Displays arrows and distance information on the HUD to instruct the user on which direction to go.

[1084] 6. User: Follows the arrows but accidentally goes in the wrong direction.

[1085] 7. Device: Resends updated location to server.

[1086] 8. Server: Recalculate the route based on the new position and send the corrected route.

[1087] 9. Terminal: Display the corrected route on the HUD and guide the user in the right direction.

[1088] 10. User: Proceed in the correct direction and arrive safely at the "Southeast Exit".

[1089] 11. On the device: At the same time, the emotion engine detects the user's facial expressions and tone of voice to analyze the user's emotional state.

[1090] 12. Device: If it determines that the user is feeling anxious, it sends emotional data to the server.

[1091] 13. Server: Responds to anxiety states and adjusts navigation information to provide detailed directions and suggest appropriate rest stops.

[1092] 14. Server: Sends the adjusted navigation information to the device.

[1093] 15. Terminal: Display the adjusted information on the HUD and guide the user by saying, "There is a rest point in 100 meters."

[1094] 16. User: Follow the suggestions and proceed to your destination in a relaxed state.

[1095] Example 2

[1096] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1097] While navigation systems exist to help users reach their destinations in large stations and crowded areas without getting lost, they often cause anxiety and stress. Furthermore, they lack optimal route guidance with real-time location correction, and navigation information tailored to the user's emotional state is not provided. This makes it difficult for users to reach their destination comfortably. The present invention aims to solve these problems.

[1098] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1099] In this invention, the server includes a means for identifying the user's location information, a means for inputting or setting destination information, an information processing device for calculating the optimal route between the current location and the destination, a visual display device or an audio output device for providing the user with navigation information based on the calculated optimal route, a means for recalculating the route and providing revised navigation information when the user's location changes, and a means for detecting the user's emotions and adjusting the navigation information based on the emotions. This allows the user to receive optimal route guidance including real-time location corrections, and the provision of navigation information according to the user's emotional state, enabling the user to reach the destination comfortably and safely.

[1100] "Means for identifying a user's location information" refers to technology that measures a user's current location using location measurement devices such as GPS sensors and beacons.

[1101] "Means for inputting or setting destination information" refers to technology that allows a user to specify a destination by voice input or text input via a device.

[1102] An "information processing device that calculates the optimal route between the current location and the destination" is a server or computer system equipped with an algorithm for calculating the optimal route based on the user's current location and the set destination.

[1103] "Visual display devices or audio output devices that provide navigation information to users based on the calculated optimal route" refers to devices such as head-up displays (HUDs) that display visual information to users and earphones that provide audio guidance.

[1104] "Means for recalculating routes and providing revised navigation information when the user's location changes" refers to technology that recalculates routes based on new location information when the user's location changes, and provides the results to the user's device in real time.

[1105] "Means for detecting the user's emotions and adjusting navigation information based on those emotions" refers to a technology that analyzes the user's facial expressions, tone of voice, heart rate, etc. to recognize their emotional state, and then adjusts and provides navigation information based on the results.

[1106] The present invention combines a navigation system that helps users avoid getting lost in large train stations and crowded places with an emotion engine that recognizes the user's emotions and adjusts navigation information based on those emotions. Specific embodiments of the present invention will be described below.

[1107] This system uses GPS sensors and beacons to identify the user's location. When the user wears the glasses or earphones and launches a navigation app, the device uses the built-in GPS sensor and surrounding beacon signals to identify the user's current location. The identified location information is sent from the device to the server via an HTTP POST request.

[1108] Next, the user sets their destination within the app by voice or text input. For example, the user can say "Shinjuku Station Southeast Exit" or enter the destination information in a text field. The device formats this destination data and sends it to the server.

[1109] The server receives the user's current location and destination information and calculates the optimal route. The server calculates the shortest route using algorithms such as Dijkstra's algorithm and sends the results in JSON format to the device. Based on the calculated optimal route, the device provides navigation information to the user using the HUD on the glasses or the voice guidance function on the earphones. For example, voice guidance such as "Go straight for 200 meters" or arrows are displayed.

[1110] If the user takes a wrong turn while following the directions, the device will send new location information to the server. The server will recalculate the route based on the new location and send the revised route data in JSON format to the device. The revised navigation information will be notified to the user again via HUD and voice.

[1111] Furthermore, the device uses an emotion engine to detect and analyze the user's facial expressions, tone of voice, heart rate, etc. to recognize the user's emotional state. For example, if the user is feeling anxious, the emotion engine will determine this. The recognized emotional state is sent to the server, which then adjusts the navigation information based on the emotional state. For example, it may provide more detailed instructions or suggest appropriate rest areas. The adjusted navigation information is then sent to the device, where it provides visual or audio guidance to the user. For example, it may display a message such as, "There is a rest point 100 meters further."

[1112] Specific examples

[1113] At Shinjuku Station, the user uses the glasses-type device to set the destination as the Southeast Exit using voice commands.

[1114] The GPS sensor detects the user's current location and sends that information to the server.

[1115] The server calculates the optimal route and sends it to the eyeglasses-type device.

[1116] The HUD displays arrows and distance information to guide the user in the direction they should go.

[1117] If the device takes a wrong turn, it resends updated location information to the server, which then recalculates the route and sends the revised route to the device.

[1118] Prompt Sentence Examples

[1119] "I want to go to the southeast exit of Shinjuku Station."

[1120] "Set destination as Southeast Exit"

[1121] "The emotion engine detected your anxiety."

[1122] "Please provide detailed route directions."

[1123] In this way, the present invention is a system that provides appropriate navigation information based on the user's current location and emotional state, and supports the user in reaching their destination comfortably and safely.

[1124] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1125] Program processing flow

[1126] Get current location

[1127] Step 1:

[1128] User: Puts on the glasses or earbuds and launches a navigation app.

[1129] What happens: A user taps the screen of their smart device to launch a navigation app.

[1130] Input: User action

[1131] Output: App launch

[1132] Step 2:

[1133] Device: Determines current location using built-in GPS sensor and beacons.

[1134] Specific operation: The device's GPS sensor is turned on, and the current latitude and longitude information is obtained, and the surrounding beacon signals are detected to supplement the location information.

[1135] Input: GPS sensor / beacon signal

[1136] Output: Latitude and longitude information of current location

[1137] Step 3:

[1138] Device: Sends the acquired location information to the server.

[1139] Specific operation: Location data including latitude and longitude information is packaged into a packet and sent to the server as an HTTP POST request.

[1140] Input: Latitude and longitude information of current location

[1141] Output: Location data sent to the server

[1142] Setting a destination

[1143] Step 4:

[1144] User: Set a destination in the app by voice or text input.

[1145] Specific behavior: The user speaks "Shinjuku Station Southeast Exit" into the microphone or uses the keyboard to enter the destination information into the text field.

[1146] Input: Voice or text input

[1147] Output: Destination information

[1148] Step 5:

[1149] Terminal: Sends destination information to the server.

[1150] Specific behavior: Formats the destination data and sends it to the server as an HTTP POST request.

[1151] Input: Destination information

[1152] Output: Destination data sent to the server

[1153] Calculating the best route

[1154] Step 6:

[1155] Server: Receives the user's current location and destination information and calculates the optimal route.

[1156] Specific operation: The server retrieves map information from the database and calculates the shortest route using an algorithm such as Dijkstra's algorithm.

[1157] Input: Current location and destination information

[1158] Output: Optimal route information

[1159] Step 7:

[1160] Server: Sends the calculation results to the terminal in real time.

[1161] Specific operation: The coordinate data of the optimal route is compiled into a packet in JSON format and sent to the terminal as an HTTP response.

[1162] Input: Optimal route information

[1163] Output: Route data sent to the device

[1164] Providing navigation information

[1165] Step 8:

[1166] Device: Notifies the user of the navigation information received.

[1167] Specific operation: Arrows and distance information are displayed on the HUD of the glasses-type device, or voice guidance is provided through the earphone-type device.

[1168] Input: Route data

[1169] Output: Navigation information provided to the user

[1170] Step 9:

[1171] User: Follow the device's directions to reach your destination.

[1172] Specific action: The user walks according to the device's instructions.

[1173] Input: Navigation information

[1174] Output: User Move

[1175] Real-time route corrections

[1176] Step 10:

[1177] Terminal: If the user takes a wrong turn, it sends that information to the server.

[1178] What happens: The GPS sensor gets an updated location and sends it back to the server.

[1179] Input: Updated location

[1180] Output: New location data sent to the server.

[1181] Step 11:

[1182] Server: Recalculates the route based on the new location information and sends the revised navigation information to the device.

[1183] Specific operation: The server recalculates the optimal route based on the new location information and sends the revised route data in JSON format to the device.

[1184] Input: New location

[1185] Output: Modified route data

[1186] Step 12:

[1187] Device: Notify the user of the revised navigation information.

[1188] What it does: Display the corrected arrow on the HUD or hear a voice prompt saying "Go back 50 meters and turn right again."

[1189] Input: Modified route data

[1190] Output: Corrected navigation information provided to the user

[1191] Step 13:

[1192] User: Follow the corrected directions to proceed to the destination.

[1193] Specific behavior: The user follows the new instructions.

[1194] Input: Corrected navigation information

[1195] Output: User Move

[1196] User emotion recognition

[1197] Step 14:

[1198] On the device: The emotion engine detects the user's facial expressions, tone of voice, and heart rate.

[1199] Specific operations: Collect data using a camera, microphone, and heart rate sensor.

[1200] Input: facial expression data, voice tone, heart rate

[1201] Output: Detected emotion data

[1202] Step 15:

[1203] Device: Analyzes detected data and recognizes the user's emotional state.

[1204] What it does: It uses machine learning models and algorithms to analyze collected data and determine emotional states.

[1205] Input: Detected emotion data

[1206] Output: Perceived emotional state

[1207] Step 16:

[1208] Device: Sends the recognized emotional state to the server.

[1209] What it does: Formats emotional state data and sends it to the server as an HTTP POST request.

[1210] Input: Perceived emotional state

[1211] Output: Emotion data sent to the server

[1212] Adjusting navigation information

[1213] Step 17:

[1214] Server: Adjust navigation information based on emotional state.

[1215] Specific actions: The server adjusts depending on the emotional state, such as increasing detailed instructions, changing instructions to simpler ones, or suggesting relay points or rest areas.

[1216] Input: Emotion data

[1217] Output: Adjusted navigation information

[1218] Step 18:

[1219] Server: Sends adjusted navigation information to the device.

[1220] Specific operation: The adjusted navigation information is compiled in JSON format and sent to the device as an HTTP response.

[1221] Input: Adjusted navigation information

[1222] Output: Navigation information sent to the device

[1223] Step 19:

[1224] Device: Notify user of adjusted navigation information.

[1225] What it does: Display adjusted navigation information on the HUD or provide audio guidance.

[1226] Input: Adjusted navigation information

[1227] Output: Adjusted navigation information provided to the user

[1228] (Application example 2)

[1229] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1230] In large stations and crowded areas, users often get lost when trying to find their destination, which can lead to stress and anxiety. Existing navigation systems lack consideration for the user's emotional state, resulting in a poor user experience. Furthermore, they lack detailed directions and guidance for rest stops, and navigation information can be overly complex, increasing anxiety. There is a need for a navigation system that can solve these issues and enable users to travel comfortably and safely.

[1231] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for identifying user location information, a means for inputting or setting destination information, a means for calculating an optimal route between the current location and the destination, a wearable device for providing navigation information to the user based on the calculated optimal route, a means for recalculating the route and providing revised navigation information when the user's location changes, and an emotion recognition engine for detecting the user's emotional state and adjusting the navigation information. This reduces the anxiety and stress the user feels during navigation, enabling the user to travel comfortably and with peace of mind.

[1232] "Means for identifying the user's location information" refers to technology that uses GPS sensors and beacon systems to obtain the user's current location in real time.

[1233] "Means for inputting or setting destination information" refers to technology that allows users to specify a destination through voice input or text input.

[1234] The "server device that calculates the optimal route between the current location and the destination" is a server that uses map information and algorithms to calculate the most efficient route from the user's current location to the destination.

[1235] "Wearable devices that provide users with navigation information based on calculated optimal routes" refers to eyeglasses or earphones that provide users with visual or audio guidance based on calculated route information.

[1236] "Means for recalculating the route and providing revised navigation information when the user's location changes" refers to technology for recalculating a new route and providing that information when the user deviates from the planned route.

[1237] The "emotion recognition engine that detects the user's emotional state and adjusts navigation information" is a technology that analyzes the user's facial expressions, heart rate, tone of voice, etc. to determine their emotional state and changes the navigation information based on that.

[1238] This invention is a navigation system that helps users avoid losing track of their destination in large shopping malls, crowded train stations, large commercial facilities, and other locations. The system provides a means for accurately acquiring the user's location information and setting the destination. It also utilizes a server device that calculates the optimal route between the user's current location and the destination, and a wearable device that provides navigation information based on the calculated optimal route. Furthermore, if the user takes a wrong turn, the system has the function of recalculating the route and providing corrected navigation information. Furthermore, by incorporating an emotion recognition engine, the system can detect the user's emotional state and adjust the navigation information accordingly.

[1239] First, the user puts on the glasses or earphones provided by the device and launches the navigation application. The device uses the built-in GPS sensor or beacon system to identify the user's current location and sends that location information to the server. The user then sets their destination within the app using voice or text input. This destination information is also sent to the server.

[1240] The server calculates the optimal route based on the received location and destination information and sends the results to the device in real time. The device then provides the received navigation information visually on glasses and audibly on earphones. If the user follows the guidance but accidentally goes in the wrong direction, the device will send updated location information to the server again. The server will then recalculate based on the new location information and send the revised navigation information to the device.

[1241] The emotion recognition engine detects the user's facial expressions, tone of voice, heart rate, etc. and analyzes the data to recognize the user's emotional state. This emotional state data is also sent to the server, which then adjusts the navigation information according to the user's emotions. For example, if the user is feeling anxious or stressed, the server will suggest detailed route directions and appropriate rest stops.

[1242] Specifically, consider a scenario in which a user is searching for a specific store in a shopping mall. The user inputs their destination using the eyeglasses, and navigation begins. The device tracks the user's location in real time and provides the optimal route. If the user takes a wrong turn along the way, the server recalculates a new route based on the updated location information and provides revised guidance.

[1243] At the same time, the emotion recognition engine detects the user's facial expressions and heart rate, and if it determines that the user is feeling anxious, the server provides detailed route guidance and suggests rest points. For example, the server might say, "You seem a little anxious right now. There is a rest area around the next corner, so why not take a break?" In this way, the navigation system allows users to reach their destination comfortably and with peace of mind.

[1244] An example of a prompt is as follows:

[1245] "Create a navigation app that provides the best route to help users find the store they're looking for, and adapts the navigation based on the user's emotional state."

[1246] This system will significantly improve users' navigation experience and support safe and comfortable travel.

[1247] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1248] Step 1:

[1249] The user puts on the glasses or earphones and launches the navigation application. The user specifies the destination by voice or text input. The input is analyzed by a speech recognition engine or text analysis engine, and the destination information is extracted. The extracted destination information is packetized in JSON format and sent to the server.

[1250] Step 2:

[1251] The device uses the built-in GPS sensor or beacon system to determine the user's current location. The acquired latitude and longitude information of the current location is compiled into a data packet and sent to the server as an HTTP POST request. The input data is obtained from the GPS sensor or beacon, and the output data is the user's current location information.

[1252] Step 3:

[1253] The server receives the user's current location and destination information and calculates the optimal route based on that. The server retrieves map information from a database and derives the optimal route using a route calculation algorithm such as Dijkstra's algorithm. The input data are the current location and destination information, and the output data is the calculated optimal route.

[1254] Step 4:

[1255] The server sends the calculated route information to the terminal in real time. The sent data is encoded as a JSON format packet and sent to the terminal as an HTTP response. The input data is the optimal route information, and the output data is navigation data.

[1256] Step 5:

[1257] The device analyzes the received navigation data and guides the user visually in the case of glasses-type devices and audibly in the case of earphone-type devices. Specifically, arrows and distance information are overlaid on the HUD of the glasses-type device, and the direction and distance are guided to the user audibly in the case of earphone-type devices. The input data is the navigation data received from the server, and the output data is the visual or audible guidance.

[1258] Step 6:

[1259] The user follows the device's guidance, but may accidentally go in the wrong direction. When this happens, the device reconfirms its current location using the GPS sensor or beacon system. The new location information is again sent to the server. The input data is the updated location information, and the output data is the new location information.

[1260] Step 7:

[1261] The server receives the new location information and recalculates the optimal route. The server reacquires map information and uses a route calculation algorithm to derive a new route. The newly calculated route information is again sent to the device. The input data is the new location information, and the output data is the revised route information.

[1262] Step 8:

[1263] The device analyzes the revised navigation information and provides the user with visual and audio guidance again. The HUD displays updated arrows and distance information, and the earphone device provides audio guidance with the new direction and distance. The input data is the revised navigation data, and the output data is the updated guidance.

[1264] Step 9:

[1265] The device uses an emotion recognition engine to detect the user's facial expressions, tone of voice, heart rate, etc. It analyzes this data to recognize the user's emotional state and sends that information to the server. The input data is emotional data obtained from the camera, microphone, and heart rate sensor, and the output data is the recognized emotional state.

[1266] Step 10:

[1267] Based on the received emotional state, the server adjusts navigation information to alleviate the user's anxiety and stress. This adjustment includes detailed route guidance and suggestions for rest stops. The adjusted navigation information is then sent back to the device. The input data is the recognized emotional state, and the output data is the adjusted navigation information.

[1268] Step 11:

[1269] The device analyzes the adjusted navigation information and provides visual or audio guidance to the user. For example, the device may provide guidance such as, "Turn right at the next corner and there is a rest area. Please take a break." The input data is the adjusted navigation data, and the output data is the visual or audio guidance.

[1270] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1271] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1272] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1273] [Third embodiment]

[1274] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1275] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1276] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1277] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1278] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1279] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1280] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1281] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1282] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1283] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1284] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1285] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1286] The present invention is a navigation system that helps users avoid getting lost in large train stations and other crowded places. This system identifies the user's current location, calculates the optimal route to the destination, and provides navigation information in real time. The program processing flow of this system is explained in detail below.

[1287] Program processing flow

[1288] Getting the user's current location

[1289] 1. User: Puts on the eyeglasses or earbuds and launches the navigation app.

[1290] When the app is launched, the device prepares to obtain its location information.

[1291] 2. Device: Determines current location using built-in GPS sensor or beacon.

[1292] The GPS sensor is activated to obtain latitude and longitude information, and if a beacon is available, its signal is detected and used as supplemental information.

[1293] 3. Device: Sends the acquired location information to the server.

[1294] The location information is packetized and sent to the server as an HTTP POST request.

[1295] Setting a destination

[1296] 4. User: Set a destination in the app by voice or text input.

[1297] For example, you can say "Shinjuku Station Southeast Exit" or enter it into the text form.

[1298] 5. Terminal: Sends destination information to the server.

[1299] The destination information is formatted and sent to the server.

[1300] Calculating the best route

[1301] 6. Server: Obtains current location and destination information and calculates the optimal route.

[1302] The server retrieves map information from a database and uses an algorithm (e.g., Dijkstra algorithm) to calculate the optimal route.

[1303] 7. Server: Sends the calculation results to the terminal in real time.

[1304] The calculated route information is packetized in JSON format and sent to the terminal.

[1305] Providing navigation information

[1306] 8. Terminal: The received navigation information is displayed to the user (glasses-type device) or guided by voice (earphone-type device).

[1307] In the case of glasses-type devices, arrows and distance information are displayed on the HUD, while in the case of earphone-type devices, direction and distance are guided by voice.

[1308] 9. User: Follow the device's directions to your destination.

[1309] Real-time route corrections

[1310] 10. Terminal: If the user takes a wrong turn, it sends that information to the server.

[1311] A new location is obtained and retransmitted to the server.

[1312] 11. Server: Recalculate the route based on the new location information and send the revised navigation information to the device.

[1313] Recalculate the optimal route from the new location information and send the revised route.

[1314] 12. Terminal: Display or audibly notify the user of the revised navigation information.

[1315] The glasses-type device displays the corrected route on the HUD, while the earphone-type device provides voice guidance such as "Go back 50 meters and turn left."

[1316] Specific examples

[1317] Meeting scenario at Shinjuku Station

[1318] 1. User: I am meeting a friend at Shinjuku Station and am using the glasses.

[1319] 2. User: Launch the app on the glasses-type device and voice-input "Southeast Exit" as the destination.

[1320] 3. Device: Detects current location using GPS sensor and sends that information to the server.

[1321] 4. Server: Calculates the optimal route between the current location and the destination "Southeast Exit" and sends it to the eyeglasses.

[1322] 5. Terminal: Displays arrows and distance information on the HUD to instruct the user on which direction to go.

[1323] 6. User: Follows instructions but accidentally goes in the wrong direction.

[1324] 7. Device: Resends updated location to server.

[1325] 8. Server: Recalculate the route based on the new position and send the corrected route.

[1326] 9. Terminal: Display the corrected route on the HUD and guide the user in the right direction.

[1327] 10. User: Proceed in the correct direction and arrive safely at the "Southeast Exit".

[1328] This series of processes allows users to reach their destination safely and efficiently, even in large stations and crowded places. This invention reduces the chances of getting lost or missing meeting places, and reduces stress and anxiety for users.

[1329] The processing flow will be explained below.

[1330] Step 1:

[1331] User: Puts on the glasses or earbuds and launches a navigation app.

[1332] Action: The user taps on the app to launch it.

[1333] Step 2:

[1334] Device: Determines current location using built-in GPS sensor or beacon.

[1335] Action: The GPS sensor is activated to obtain the current latitude and longitude coordinates, and if available, to detect beacon signals to supplement the location.

[1336] Step 3:

[1337] Device: Sends the acquired location information to the server.

[1338] Action: Packet location data (latitude and longitude) and send an HTTP POST request to the server.

[1339] Step 4:

[1340] User: Set a destination by voice or text input within the app.

[1341] Action: Say "Shinjuku Station Southeast Exit" or type it into the text field.

[1342] Step 5:

[1343] Terminal: Sends destination information to the server.

[1344] Action: Format the destination data and send it to the server as an HTTP POST request.

[1345] Step 6:

[1346] Server: Obtains the user's current location and destination information and calculates the optimal route.

[1347] Action: The server retrieves map information from the database and calculates the optimal route using an algorithm (e.g., Dijkstra algorithm).

[1348] Step 7:

[1349] Server: Sends the calculation results to the terminal in real time.

[1350] Action: Packet the coordinate data of the optimal route in JSON format and send it to the device as an HTTP response.

[1351] Step 8:

[1352] Terminal: Provides the received navigation information to the user visually or audibly.

[1353] Action: Display arrows and distance information on the HUD (glasses) or provide audio guidance of direction and distance (earbuds).

[1354] Step 9:

[1355] User: Follow the device's directions to reach your destination.

[1356] Action: Follow the arrows and audio prompts.

[1357] Step 10:

[1358] Terminal: If the user takes a wrong turn, the sensor detects it and sends the information to the server.

[1359] Action: The GPS sensor gets an updated location and sends it back to the server.

[1360] Step 11:

[1361] Server: Recalculates the route based on the new location information and sends the revised navigation information to the device.

[1362] Action: Recalculate the optimal route based on the new location information and send the revised route data in JSON format to the device.

[1363] Step 12:

[1364] On the device: Display or audibly notify the user of the revised navigation information.

[1365] Action: Display corrected arrow on HUD or voice prompt "Go back 50 meters and then right again."

[1366] Step 13:

[1367] User: Follows the revised directions and proceeds to the destination.

[1368] Action: Correct the mistake and move in the right direction.

[1369] Example 1

[1370] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1371] In large stations and crowded areas, it is difficult for users to reach their destination efficiently without getting lost. This can cause users anxiety and stress. Furthermore, there is a lack of navigation systems that can respond to real-time location changes, making it difficult to correct a route once it has been set. There is a need for a system that can solve these problems and provide users with a comfortable journey.

[1372] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1373] In this invention, the server includes means for acquiring user location information, means for inputting or setting destination information, means for calculating the optimum route between the acquired current location and the set destination, means for providing guidance information to the user based on the calculated optimum route, and means for recalculating the route and providing revised guidance information when the user's location changes, thereby enabling the user to reach their destination efficiently without getting lost even in large stations or crowded places.

[1374] "User" refers to a person who uses this system to obtain location information and set a destination.

[1375] "Means of obtaining location information" refers to devices or technologies for measuring a user's current location, specifically devices that use GPS sensors or beacons.

[1376] "Means for inputting or setting destination information" refers to an interface or device that allows a user to specify the location they want to go to, specifically a device for voice input or text input.

[1377] "Computing device" refers to the device or technology, specifically the server, that calculates the optimal route based on the user's current location and destination information.

[1378] The term "display device" refers to a device for providing visual guidance information to a user, specifically, a glasses-type device.

[1379] "Audio output device" refers to a device that provides guidance information to users by voice, specifically an earphone-type device.

[1380] "Re-route means" refers to the technology or algorithm used to recalculate a new, optimal route from the user's current location to the destination if the user's location changes.

[1381] "Guidance information" refers to information about the direction and distance a user needs to reach their destination.

[1382] "Real-time" refers to updating and providing information immediately when a user's location information changes.

[1383] The present invention relates to a navigation system that helps users avoid getting lost in large train stations and other crowded places. The system identifies the user's current location, calculates the optimal route to the destination, and provides real-time navigation information.

[1384] System configuration

[1385] The system consists of the following main components:

[1386] 1. User terminal: Glasses-type device or earphone-type device.

[1387] 2. Server: Performs route calculation and data management.

[1388] 3. Network: The communications infrastructure that connects user devices and servers.

[1389] Hardware and Software Examples

[1390] User device:

[1391] User terminals are glasses-type devices (e.g., smart glasses) with built-in GPS sensors or earphone-type devices (e.g., smart earphones) with voice guidance functions.

[1392] These devices use dedicated applications that run on operating systems such as Android and iOS.

[1393] server:

[1394] The server is installed with a database management system (e.g., MySQL) and software for executing a route calculation algorithm (e.g., Dijkstra's algorithm).

[1395] The server communicates with the user terminal using the HTTP protocol.

[1396] network:

[1397] Data is exchanged between the user terminal and the server using the Internet or a dedicated local network.

[1398] Data processing and calculation

[1399] User device: Uses a GPS sensor and beacon receiver to measure the current location and send that location information to the server. It also organizes destination information specified by the user and sends it to the server.

[1400] Server: Based on the received location and destination information, retrieves map data from the database, calculates the optimal route using a route calculation algorithm, and sends the calculation results to the user's device in real time.

[1401] Example of processing flow

[1402] Example 1: Meeting scenario at Shinjuku Station

[1403] 1. A user uses the eyeglasses to meet a friend at Shinjuku Station.

[1404] 2. The user launches the app on their device and voice-inputs "Southeast Exit" as their destination.

[1405] 3. The device determines its current location using its built-in GPS sensor and sends that information to the server.

[1406] 4. The server calculates the optimal route based on the received location information and the destination information, "Southeast Exit," and sends the results to the eyeglasses.

[1407] 5. The device displays arrows and distance information on the HUD to instruct the user on which direction to go.

[1408] 6. Users follow instructions but sometimes accidentally go in the wrong direction.

[1409] 7. The device obtains new location information and retransmits it to the server.

[1410] 8. The server recalculates the route based on the new location information and sends the revised route to the user device.

[1411] 9. The device displays the corrected route on the HUD and guides the user in the correct direction.

[1412] Examples of prompt statements

[1413] The following prompts can be used for speech or text input:

[1414] 1. "Please take me to the southeast exit of Shinjuku Station."

[1415] 2. "Please set a new destination. Southeast Exit."

[1416] 3. "What is the best route from my current location to my destination?"

[1417] This invention allows users to reach their destination efficiently without getting lost even in large stations or crowded places. This system reduces the chances of getting lost or missing meeting places, and reduces stress and anxiety for users.

[1418] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1419] Step 1:

[1420] The user turns on the eyeglasses or earphones.

[1421] Specific behavior: User turns on the device and opens the navigation app.

[1422] Input: User actions (device launch and app launch).

[1423] Output: The device is initialized and ready to acquire location information.

[1424] Step 2:

[1425] The device activates the GPS sensor and beacon to determine its current location.

[1426] Specific operation: The GPS sensor inside the device is activated, and the device captures surrounding beacon signals.

[1427] Input: Device location sensors (GPS and beacons).

[1428] Output: Latitude and longitude information and signal information from the beacon.

[1429] Step 3:

[1430] The location information acquired by the device is sent to the server.

[1431] Specific operation: The location information is converted into JSON format and sent to the server as an HTTP POST request.

[1432] Input: Latitude and longitude information and beacon signal data.

[1433] Output: Confirmation of sending location information to the server.

[1434] Step 4:

[1435] The user sets the destination by voice or text input.

[1436] Specific operation: The user specifies a destination using the device's input interface (microphone or keyboard). For example, the user enters "Shinjuku Station Southeast Exit."

[1437] Input: User speaks or texts destination.

[1438] Output: Destination information confirmed and set.

[1439] Step 5:

[1440] The terminal transmits the destination information to the server.

[1441] Specific operation: The input destination information is formatted, converted into JSON format, and sent to the server.

[1442] Input: Destination text or audio data.

[1443] Output: Confirmation of sending destination information to the server.

[1444] Step 6:

[1445] The server obtains information about the current location and destination and calculates the optimal route.

[1446] Specific operation: The server retrieves map information from the database and calculates the optimal route using a route calculation algorithm (e.g., Dijkstra algorithm).

[1447] Input: User's current location and destination information.

[1448] Output: Calculated optimal route data.

[1449] Step 7:

[1450] The server sends the calculation results to the terminal in real time.

[1451] Specific operation: The calculated route information is packetized in JSON format and sent to the terminal as an HTTP response.

[1452] Input: Optimal route data calculated by the server.

[1453] Output: Confirmation of sending route information to the device.

[1454] Step 8:

[1455] The navigation information received by the device is displayed or audibly provided to the user.

[1456] Specific operation: For glasses-type devices, arrows and distance information will be displayed on the HUD. For earphone-type devices, voice guidance will be provided.

[1457] Input: Route information received from the server.

[1458] Output: Providing visual or audio guidance to the user.

[1459] Step 9:

[1460] The user follows the navigation information.

[1461] Specific operation: The user follows the guidance of the glasses-type device or earphone-type device to move in the direction they should go.

[1462] Input: Guidance information from the terminal.

[1463] Output: The user follows the route provided.

[1464] Step 10:

[1465] If the device changes the user's location, it sends it back to the server.

[1466] Specific behavior: If the user deviates from the specified route, obtain new location information and resend it to the server.

[1467] Input: Updated location information.

[1468] Output: Confirmation of sending new location to server.

[1469] Step 11:

[1470] The server recalculates the route based on the new location information and sends the revised navigation information to the device.

[1471] Specific operation: The optimal route is recalculated based on the new location information, and the revised route information is packetized in JSON format and sent to the terminal.

[1472] Input: New location.

[1473] Output: Confirmation of sending corrected route information.

[1474] Step 12:

[1475] The device will display or audibly notify the user of the revised navigation information.

[1476] Specific operation: In the case of glasses-type devices, the revised route will be displayed on the HUD, and in the case of earphone-type devices, voice guidance will be given, such as "Go back 50 meters and turn left."

[1477] Input: The modified route information received from the server.

[1478] Output: Providing visual or audio correction guidance to the user.

[1479] (Application example 1)

[1480] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1481] Conventional navigation systems have limitations when it comes to navigating large stations and crowded areas. In particular, in businesses like food delivery, it is important to reach your destination efficiently, but it is difficult to flexibly change routes to take real-time traffic information into account. Furthermore, there are limited ways to provide navigation information, leaving delivery drivers with few intuitive and easy-to-understand directions.

[1482] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1483] In this invention, the server includes means for acquiring user location information and providing an optimal route to support the delivery driver's work, means for dynamically correcting the route by reflecting real-time traffic information, and means for providing navigation information to the device. This allows the delivery driver to receive optimal route information in real time and flexibly change the route according to traffic conditions, enabling efficient and effective delivery.

[1484] "Means of identifying the user's location"

[1485] It is a technology that uses sensors such as GPS and beacons to accurately detect the user's current location.

[1486] "Method for entering or setting destination information"

[1487] is a technology that allows users to specify navigation destinations to applications through voice or text input.

[1488] "Server device for calculating optimal routes"

[1489] is a computer system that uses an algorithm (e.g., Dijkstra algorithm or A) to calculate the shortest or fastest route based on the user's current location and destination.

[1490] "Eyeglasses-type device that provides navigation information"

[1491] is a wearable device that has a visual display and overlays navigation instructions into the user's field of view.

[1492] "Earphone-type device that provides navigation information"

[1493] is a wearable device that can provide navigation information to users via voice.

[1494] "Real-time traffic information"

[1495] This is road condition data that is updated instantly, including current traffic conditions, congestion, and accident information.

[1496] "Means for dynamically correcting routes"

[1497] This is a technology that takes real-time traffic information into account to recalculate the optimal route and provide it to the user.

[1498] "A means of providing optimal routes to support delivery drivers' work"

[1499] This is a technology that calculates and guides delivery drivers to the optimal delivery route to reach their destination efficiently and quickly.

[1500] The present invention is a system that identifies a user's current location, calculates the optimal route to a destination, and provides navigation information in real time, and is particularly used to improve the efficiency of food delivery operations.

[1501] 1. Obtaining user location information

[1502] The server uses the GPS sensor built into the delivery driver's smartphone to accurately determine the driver's current location (latitude and longitude). This GPS sensor sends the driver's location information to the server in real time. For example, the server can obtain location information using the smartphone's location information service.

[1503] 2. Setting destination information

[1504] The user sets the destination address of the customer on their smartphone using voice recognition or text input. Voice recognition technology can use the Google Voice Recognition API or a voice interface provided by the requester. The set address is sent to the server and used as the destination information for navigation.

[1505] 3. Calculating the optimal route

[1506] The server receives the user's current location and destination information to calculate the optimal route for navigation. The calculation uses Dijkstra's algorithm or A algorithm, which are executed on the server. The calculation results are sent to the user's smartphone or smart glasses in real time.

[1507] 4. Providing navigation information

[1508] The device provides the user with the optimal route information received from the server. In the case of a smartphone, the route map and direction instructions are displayed on the screen. In addition, if smart glasses are used, navigation information is overlaid on the HUD (Heads-Up Display). In the case of earphone-type devices, navigation information such as direction and distance is provided by voice.

[1509] 5. Real-time route correction

[1510] If road conditions change while the user is traveling, such as when traffic jams or an accident occurs, new location information is sent to the server. The server then recalculates the optimal route based on this information and sends the revised route information to the device in real time. This allows the user to navigate efficiently based on the latest information.

[1511] Specific hardware and software to be used

[1512] Smartphone: GPS sensor, location information services

[1513] Server: High performance server (Python, Node.js, PostgreSQL)

[1514] Glasses-type device: HUD (Heads-Up Display)

[1515] Earphone-type devices: Audio output technology

[1516] Example scenario

[1517] Consider a scenario where a user is working as a food delivery driver near Shinjuku Station. The delivery driver launches a smartphone app and uses the GPS sensor to determine their current location. They then voice-enter the customer's address and set it as their destination. The server calculates the optimal route based on their current location and destination information and sends it to the smartphone in real time. The driver then follows the navigation information displayed on the smartphone or smart glasses. If traffic congestion occurs along the way, new location information is sent to the server and the route is recalculated. The revised route information is then provided to the driver in real time.

[1518] Prompt Sentence Examples

[1519] What is the algorithm of the food delivery app that calculates the optimal route from Shinjuku Station to the customer's address and adjusts the route in real time to reflect current traffic information? Please also provide a detailed explanation of the technologies used (GPS, voice recognition, navigation, real-time updates).

[1520] In this way, the present invention can significantly improve the efficiency of delivery drivers by combining user location information with real-time traffic information.

[1521] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1522] Step 1:

[1523] When a user launches a smartphone app, the app uses the GPS sensor to obtain the user's current location (latitude and longitude).

[1524] Input: Smartphone app launch, GPS sensor data

[1525] Output: Current location (latitude and longitude) data

[1526] Specific behavior: Uses the smartphone's location services to call APIs such as locationManager.getLastKnownLocation() to obtain the coordinates of the current location.

[1527] Step 2:

[1528] The user sets the destination information (customer's address) through voice recognition or text input.

[1529] Input: Voice or text input data

[1530] Output: Destination information (address)

[1531] Specific operation: In the case of voice input, the user's destination is obtained using the Google Voice Recognition API, and in the case of text input, the destination is obtained using an input form within the app.

[1532] Step 3:

[1533] The device sends the current location and destination information to the server.

[1534] Input: Current location (latitude and longitude) data, destination information (address)

[1535] Output: HTTP POST request to the server

[1536] Specific operation: Format the current location and destination data into JSON format and send it to the server as an HTTP POST request.

[1537] Step 4:

[1538] The server calculates the optimal route based on the current location and destination information.

[1539] Input: Current location (latitude and longitude) data, destination information (address)

[1540] Output: Optimal route data (route information, distance, time, etc.)

[1541] Specific operation: The server retrieves map data from the database and calculates the optimal route using Dijkstra's algorithm or A algorithm.

[1542] Step 5:

[1543] The server sends the calculated optimal route to the terminal.

[1544] Input: Optimal route data

[1545] Output: HTTP response to the device

[1546] Specific operation: The calculated route information is packetized in JSON format and sent to the terminal as an HTTP response.

[1547] Step 6:

[1548] The terminal provides the received navigation information to the user.

[1549] Input: Optimal route data

[1550] Output: On-screen display or voice guidance

[1551] Specific operation: In the case of a smartphone, the route is displayed using a map application, in the case of smart glasses, the information is overlaid on the HUD, and in the case of earphones, voice guidance is provided.

[1552] Step 7:

[1553] The user follows the navigation.

[1554] Input: Navigation information provided by the device

[1555] Output: Tracking of travel route

[1556] Specific actions: The user follows instructions on their smartphone or smart glasses to move towards their destination.

[1557] Step 8:

[1558] The device updates the user's location information in real time and sends it to the server.

[1559] Input: Continuous GPS data

[1560] Output: Updated location information sent to the server

[1561] Specific operation: Obtain location information at regular intervals and resend it to the server.

[1562] Step 9:

[1563] The server recalculates the route based on real-time traffic information.

[1564] Input: Updated location, real-time traffic information

[1565] Output: Modified route data

[1566] Specific operation: The server recalculates the optimal route taking into account the new location information and real-time traffic information.

[1567] Step 10:

[1568] The server sends the modified route information to the terminal.

[1569] Input: Modified route data

[1570] Output: HTTP response to the device

[1571] Specific operation: The corrected route information is packetized in JSON format and sent to the terminal as an HTTP response.

[1572] Step 11:

[1573] The terminal provides the revised route information to the user.

[1574] Input: Modified route data

[1575] Output: Corrected screen display or voice guidance

[1576] Specific operation: On smartphones, the updated map information will be redisplayed, and on smart glasses or earphones, the updated information will be displayed as an overlay or announced via voice guidance.

[1577] Through the above processing steps, delivery drivers receive optimal route information in real time, enabling them to flexibly change routes according to traffic conditions, enabling them to make deliveries efficiently and effectively.

[1578] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1579] The present invention combines a navigation system that helps users avoid getting lost in large train stations and crowded places with an emotion engine that recognizes the user's emotions and adjusts navigation information based on those emotions. Specific embodiments of the present invention will be described below.

[1580] Program processing flow

[1581] Getting the user's current location

[1582] 1. User: Puts on the eyeglasses or earbuds and launches the navigation app.

[1583] Action: The user taps on the app to launch it.

[1584] 2. Device: Determines current location using built-in GPS sensor or beacon.

[1585] Action: The GPS sensor is activated to obtain the current latitude and longitude coordinates, and if available, to detect beacon signals to supplement the location.

[1586] 3. Device: Sends the acquired location information to the server.

[1587] Action: Packet location data (latitude and longitude) and send an HTTP POST request to the server.

[1588] Setting a destination

[1589] 4. User: Set a destination by voice or text input within the app.

[1590] Action: Say "Shinjuku Station Southeast Exit" or type it into the text field.

[1591] 5. Terminal: Sends destination information to the server.

[1592] Action: Format the destination data and send it to the server as an HTTP POST request.

[1593] Calculating the best route

[1594] 6. Server: Obtains the user's current location and destination information and calculates the optimal route.

[1595] Action: The server retrieves map information from the database and calculates the optimal route using an algorithm (e.g., Dijkstra algorithm).

[1596] 7. Server: Sends the calculation results to the terminal in real time.

[1597] Action: Packet the coordinate data of the optimal route in JSON format and send it to the device as an HTTP response.

[1598] Providing navigation information

[1599] 8. Terminal: Provides the received navigation information to the user visually or audibly.

[1600] Action: Display arrows and distance information on the HUD (glasses) or provide audio guidance of direction and distance (earbuds).

[1601] 9. User: Follow the device's directions to your destination.

[1602] Action: Follow the arrows and audio prompts.

[1603] Real-time route corrections

[1604] 10. Terminal: If the user takes a wrong turn, the sensor will detect it and send the information to the server.

[1605] Action: The GPS sensor gets an updated location and sends it back to the server.

[1606] 11. Server: Recalculate the route based on the new location information and send the revised navigation information to the device.

[1607] Action: Recalculate the optimal route based on the new location information and send the revised route data in JSON format to the device.

[1608] 12. Terminal: Display or audibly notify the user of the revised navigation information.

[1609] Action: Display corrected arrow on HUD or voice prompt "Go back 50 meters and then right again."

[1610] 13. User: Follow the modified directions and proceed towards your destination.

[1611] Action: Correct the mistake and move in the right direction.

[1612] Emotion Engine Processing Flow

[1613] User emotion recognition

[1614] 1. Device: The emotion engine detects the user's facial expressions, tone of voice, heart rate, etc.

[1615] Action: Collect data using devices such as cameras, microphones, and heart rate sensors.

[1616] 2. Device: Analyzes the detected data and recognizes the user's emotional state.

[1617] Action: Use machine learning models and algorithms to determine the user's emotional state from the collected data.

[1618] 3. Terminal: Sends the recognized emotional state to the server.

[1619] Action: Format the emotional state data and send it to the server as an HTTP POST request.

[1620] Adjusting navigation information

[1621] 4. Server: Based on the user's emotional state, adjust navigation information to reduce anxiety and stress.

[1622] Action: For example, make adjustments such as providing more detailed instructions, simplifying instructions, or suggesting stopovers or rest areas.

[1623] 5. Server: Sends the adjusted navigation information to the device.

[1624] Action: Packet the adjusted navigation information in JSON format and send it to the device as an HTTP response.

[1625] 6. Terminal: Providing tailored navigation information to the user visually or audibly.

[1626] Action: Display on HUD or give voice prompt.

[1627] Specific examples

[1628] Meeting scenario at Shinjuku Station

[1629] 1. User: I am meeting a friend at Shinjuku Station and am using the glasses.

[1630] 2. User: Launch the app on the glasses-type device and voice-input "Southeast Exit" as the destination.

[1631] 3. Device: Detects current location using GPS sensor and sends that information to the server.

[1632] 4. Server: Calculates the optimal route between the current location and the destination "Southeast Exit" and sends it to the eyeglasses.

[1633] 5. Terminal: Displays arrows and distance information on the HUD to instruct the user on which direction to go.

[1634] 6. User: Follows instructions but accidentally goes in the wrong direction.

[1635] 7. Device: Resends updated location to server.

[1636] 8. Server: Recalculate the route based on the new position and send the corrected route.

[1637] 9. Terminal: Display the corrected route on the HUD and guide the user in the right direction.

[1638] 10. User: Proceed in the correct direction and arrive safely at the "Southeast Exit".

[1639] 11. On the device: At the same time, the emotion engine detects the user's facial expressions and tone of voice and determines that the user is feeling anxious.

[1640] 12. Server: Provides detailed directions and suggests appropriate rest areas depending on the anxiety state.

[1641] 13. Terminal: Display the adjusted information on the HUD and guide the user by saying, "There is a rest point in 100 meters."

[1642] In this way, the present invention is a system that provides appropriate navigation information based on the user's current location and emotional state, and supports the user in reaching their destination comfortably and safely.

[1643] The processing flow will be explained below.

[1644] Step 1:

[1645] User: Puts on the glasses or earbuds and launches a navigation app.

[1646] Action: The user taps on the app to launch it.

[1647] Step 2:

[1648] Device: Determines current location using built-in GPS sensor or beacon.

[1649] Action: The GPS sensor is activated to obtain the current latitude and longitude coordinates, and if available, to detect beacon signals to supplement the location.

[1650] Step 3:

[1651] Device: Sends the acquired location information to the server.

[1652] Action: Packet location data (latitude and longitude) and send an HTTP POST request to the server.

[1653] Step 4:

[1654] User: Set a destination by voice or text input within the app.

[1655] Action: Say "Shinjuku Station Southeast Exit" or type it into the text field.

[1656] Step 5:

[1657] Terminal: Sends destination information to the server.

[1658] Action: Format the destination data and send it to the server as an HTTP POST request.

[1659] Step 6:

[1660] Server: Obtains the user's current location and destination information and calculates the optimal route.

[1661] Action: The server retrieves map information from the database and calculates the optimal route using an algorithm (e.g., Dijkstra algorithm).

[1662] Step 7:

[1663] Server: Sends the calculation results to the terminal in real time.

[1664] Action: Packet the coordinate data of the optimal route in JSON format and send it to the device as an HTTP response.

[1665] Step 8:

[1666] Terminal: Provides the received navigation information to the user visually or audibly.

[1667] Action: Display arrows and distance information on the HUD (glasses) or provide audio guidance of direction and distance (earbuds).

[1668] Step 9:

[1669] User: Follow the device's directions to reach your destination.

[1670] Action: Follow the arrows and audio prompts.

[1671] Step 10:

[1672] Terminal: If the user takes a wrong turn, the sensor detects it and sends the information to the server.

[1673] Action: The GPS sensor gets an updated location and sends it back to the server.

[1674] Step 11:

[1675] Server: Recalculates the route based on the new location information and sends the revised navigation information to the device.

[1676] Action: Recalculate the optimal route based on the new location information and send the revised route data in JSON format to the device.

[1677] Step 12:

[1678] On the device: Display or audibly notify the user of the revised navigation information.

[1679] Action: Display corrected arrow on HUD or voice prompt "Go back 50 meters and then right again."

[1680] Step 13:

[1681] Device: The emotion engine detects the user's facial expressions, tone of voice, heart rate, etc.

[1682] Action: Collect data using devices such as cameras, microphones, and heart rate sensors.

[1683] Step 14:

[1684] Device: Analyzes detected data and recognizes the user's emotional state.

[1685] Action: Use machine learning models and algorithms to determine the user's emotional state from the collected data.

[1686] Step 15:

[1687] Device: Sends the recognized emotional state to the server.

[1688] Action: Format the emotional state data and send it to the server as an HTTP POST request.

[1689] Step 16:

[1690] Server: Based on the user's emotional state, adjust navigation information to reduce anxiety and stress.

[1691] Action: For example, make adjustments such as providing more detailed instructions, simplifying instructions, or suggesting stopovers or rest areas.

[1692] Step 17:

[1693] Server: Sends adjusted navigation information to the device.

[1694] Action: Packet the adjusted navigation information in JSON format and send it to the device as an HTTP response.

[1695] Step 18:

[1696] Device: Provides tailored navigation information to the user visually or audibly.

[1697] Action: Display on HUD or give voice prompt.

[1698] Step 19:

[1699] User: Follow the tailored guidance and proceed towards your destination in a relaxed state.

[1700] Action: Follow the tailored details and rest stop suggestions to stay safe and relaxed.

[1701] Specific examples

[1702] Meeting scenario at Shinjuku Station

[1703] 1. User: I am meeting a friend at Shinjuku Station and am using the glasses.

[1704] 2. User: Launch the app on the glasses-type device and voice-input "Southeast Exit" as the destination.

[1705] 3. Device: Detects current location using GPS sensor and sends that information to the server.

[1706] 4. Server: Calculates the optimal route between the current location and the destination "Southeast Exit" and sends it to the eyeglasses.

[1707] 5. Terminal: Displays arrows and distance information on the HUD to instruct the user on which direction to go.

[1708] 6. User: Follows the arrows but accidentally goes in the wrong direction.

[1709] 7. Device: Resends updated location to server.

[1710] 8. Server: Recalculate the route based on the new position and send the corrected route.

[1711] 9. Terminal: Display the corrected route on the HUD and guide the user in the right direction.

[1712] 10. User: Proceed in the correct direction and arrive safely at the "Southeast Exit".

[1713] 11. On the device: At the same time, the emotion engine detects the user's facial expressions and tone of voice to analyze the user's emotional state.

[1714] 12. Device: If it determines that the user is feeling anxious, it sends emotional data to the server.

[1715] 13. Server: Responds to anxiety states and adjusts navigation information to provide detailed directions and suggest appropriate rest stops.

[1716] 14. Server: Sends the adjusted navigation information to the device.

[1717] 15. Terminal: Display the adjusted information on the HUD and guide the user by saying, "There is a rest point in 100 meters."

[1718] 16. User: Follow the suggestions and proceed to your destination in a relaxed state.

[1719] Example 2

[1720] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1721] While navigation systems exist to help users reach their destinations in large stations and crowded areas without getting lost, they often cause anxiety and stress. Furthermore, they lack optimal route guidance with real-time location correction, and navigation information tailored to the user's emotional state is not provided. This makes it difficult for users to reach their destination comfortably. The present invention aims to solve these problems.

[1722] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1723] In this invention, the server includes a means for identifying the user's location information, a means for inputting or setting destination information, an information processing device for calculating the optimal route between the current location and the destination, a visual display device or an audio output device for providing the user with navigation information based on the calculated optimal route, a means for recalculating the route and providing revised navigation information when the user's location changes, and a means for detecting the user's emotions and adjusting the navigation information based on the emotions. This allows the user to receive optimal route guidance including real-time location corrections, and the provision of navigation information according to the user's emotional state, enabling the user to reach the destination comfortably and safely.

[1724] "Means for identifying a user's location information" refers to technology that measures a user's current location using location measurement devices such as GPS sensors and beacons.

[1725] "Means for inputting or setting destination information" refers to technology that allows a user to specify a destination by voice input or text input via a device.

[1726] An "information processing device that calculates the optimal route between the current location and the destination" is a server or computer system equipped with an algorithm for calculating the optimal route based on the user's current location and the set destination.

[1727] "Visual display devices or audio output devices that provide navigation information to users based on the calculated optimal route" refers to devices such as head-up displays (HUDs) that display visual information to users and earphones that provide audio guidance.

[1728] "Means for recalculating routes and providing revised navigation information when the user's location changes" refers to technology that recalculates routes based on new location information when the user's location changes, and provides the results to the user's device in real time.

[1729] "Means for detecting the user's emotions and adjusting navigation information based on those emotions" refers to a technology that analyzes the user's facial expressions, tone of voice, heart rate, etc. to recognize their emotional state, and then adjusts and provides navigation information based on the results.

[1730] The present invention combines a navigation system that helps users avoid getting lost in large train stations and crowded places with an emotion engine that recognizes the user's emotions and adjusts navigation information based on those emotions. Specific embodiments of the present invention will be described below.

[1731] This system uses GPS sensors and beacons to identify the user's location. When the user wears the glasses or earphones and launches a navigation app, the device uses the built-in GPS sensor and surrounding beacon signals to identify the user's current location. The identified location information is sent from the device to the server via an HTTP POST request.

[1732] Next, the user sets their destination within the app by voice or text input. For example, the user can say "Shinjuku Station Southeast Exit" or enter the destination information in a text field. The device formats this destination data and sends it to the server.

[1733] The server receives the user's current location and destination information and calculates the optimal route. The server calculates the shortest route using algorithms such as Dijkstra's algorithm and sends the results in JSON format to the device. Based on the calculated optimal route, the device provides navigation information to the user using the HUD on the glasses or the voice guidance function on the earphones. For example, voice guidance such as "Go straight for 200 meters" or arrows are displayed.

[1734] If the user takes a wrong turn while following the directions, the device will send new location information to the server. The server will recalculate the route based on the new location and send the revised route data in JSON format to the device. The revised navigation information will be notified to the user again via HUD and voice.

[1735] Furthermore, the device uses an emotion engine to detect and analyze the user's facial expressions, tone of voice, heart rate, etc. to recognize the user's emotional state. For example, if the user is feeling anxious, the emotion engine will determine this. The recognized emotional state is sent to the server, which then adjusts the navigation information based on the emotional state. For example, it may provide more detailed instructions or suggest appropriate rest areas. The adjusted navigation information is then sent to the device, where it provides visual or audio guidance to the user. For example, it may display a message such as, "There is a rest point 100 meters further."

[1736] Specific examples

[1737] At Shinjuku Station, the user uses the glasses-type device to set the destination as the Southeast Exit using voice commands.

[1738] The GPS sensor detects the user's current location and sends that information to the server.

[1739] The server calculates the optimal route and sends it to the eyeglasses-type device.

[1740] The HUD displays arrows and distance information to guide the user in the direction they should go.

[1741] If the device takes a wrong turn, it resends updated location information to the server, which then recalculates the route and sends the revised route to the device.

[1742] Prompt Sentence Examples

[1743] "I want to go to the southeast exit of Shinjuku Station."

[1744] "Set destination as Southeast Exit"

[1745] "The emotion engine detected your anxiety."

[1746] "Please provide detailed route directions."

[1747] In this way, the present invention is a system that provides appropriate navigation information based on the user's current location and emotional state, and supports the user in reaching their destination comfortably and safely.

[1748] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1749] Program processing flow

[1750] Get current location

[1751] Step 1:

[1752] User: Puts on the glasses or earbuds and launches a navigation app.

[1753] What happens: A user taps the screen of their smart device to launch a navigation app.

[1754] Input: User action

[1755] Output: App launch

[1756] Step 2:

[1757] Device: Determines current location using built-in GPS sensor and beacons.

[1758] Specific operation: The device's GPS sensor is turned on, and the current latitude and longitude information is obtained, and the surrounding beacon signals are detected to supplement the location information.

[1759] Input: GPS sensor / beacon signal

[1760] Output: Latitude and longitude information of current location

[1761] Step 3:

[1762] Device: Sends the acquired location information to the server.

[1763] Specific operation: Location data including latitude and longitude information is packaged into a packet and sent to the server as an HTTP POST request.

[1764] Input: Latitude and longitude information of current location

[1765] Output: Location data sent to the server

[1766] Setting a destination

[1767] Step 4:

[1768] User: Set a destination in the app by voice or text input.

[1769] Specific behavior: The user speaks "Shinjuku Station Southeast Exit" into the microphone or uses the keyboard to enter the destination information into the text field.

[1770] Input: Voice or text input

[1771] Output: Destination information

[1772] Step 5:

[1773] Terminal: Sends destination information to the server.

[1774] Specific behavior: Formats the destination data and sends it to the server as an HTTP POST request.

[1775] Input: Destination information

[1776] Output: Destination data sent to the server

[1777] Calculating the best route

[1778] Step 6:

[1779] Server: Receives the user's current location and destination information and calculates the optimal route.

[1780] Specific operation: The server retrieves map information from the database and calculates the shortest route using an algorithm such as Dijkstra's algorithm.

[1781] Input: Current location and destination information

[1782] Output: Optimal route information

[1783] Step 7:

[1784] Server: Sends the calculation results to the terminal in real time.

[1785] Specific operation: The coordinate data of the optimal route is compiled into a packet in JSON format and sent to the terminal as an HTTP response.

[1786] Input: Optimal route information

[1787] Output: Route data sent to the device

[1788] Providing navigation information

[1789] Step 8:

[1790] Device: Notifies the user of the navigation information received.

[1791] Specific operation: Arrows and distance information are displayed on the HUD of the glasses-type device, or voice guidance is provided through the earphone-type device.

[1792] Input: Route data

[1793] Output: Navigation information provided to the user

[1794] Step 9:

[1795] User: Follow the device's directions to reach your destination.

[1796] Specific action: The user walks according to the device's instructions.

[1797] Input: Navigation information

[1798] Output: User Move

[1799] Real-time route corrections

[1800] Step 10:

[1801] Terminal: If the user takes a wrong turn, it sends that information to the server.

[1802] What happens: The GPS sensor gets an updated location and sends it back to the server.

[1803] Input: Updated location

[1804] Output: New location data sent to the server.

[1805] Step 11:

[1806] Server: Recalculates the route based on the new location information and sends the revised navigation information to the device.

[1807] Specific operation: The server recalculates the optimal route based on the new location information and sends the revised route data in JSON format to the device.

[1808] Input: New location

[1809] Output: Modified route data

[1810] Step 12:

[1811] Device: Notify the user of the revised navigation information.

[1812] What it does: Display the corrected arrow on the HUD or hear a voice prompt saying "Go back 50 meters and turn right again."

[1813] Input: Modified route data

[1814] Output: Corrected navigation information provided to the user

[1815] Step 13:

[1816] User: Follow the corrected directions to proceed to the destination.

[1817] Specific behavior: The user follows the new instructions.

[1818] Input: Corrected navigation information

[1819] Output: User Move

[1820] User emotion recognition

[1821] Step 14:

[1822] On the device: The emotion engine detects the user's facial expressions, tone of voice, and heart rate.

[1823] Specific operations: Collect data using a camera, microphone, and heart rate sensor.

[1824] Input: facial expression data, voice tone, heart rate

[1825] Output: Detected emotion data

[1826] Step 15:

[1827] Device: Analyzes detected data and recognizes the user's emotional state.

[1828] What it does: It uses machine learning models and algorithms to analyze collected data and determine emotional states.

[1829] Input: Detected emotion data

[1830] Output: Perceived emotional state

[1831] Step 16:

[1832] Device: Sends the recognized emotional state to the server.

[1833] What it does: Formats emotional state data and sends it to the server as an HTTP POST request.

[1834] Input: Perceived emotional state

[1835] Output: Emotion data sent to the server

[1836] Adjusting navigation information

[1837] Step 17:

[1838] Server: Adjust navigation information based on emotional state.

[1839] Specific actions: The server adjusts depending on the emotional state, such as increasing detailed instructions, changing instructions to simpler ones, or suggesting relay points or rest areas.

[1840] Input: Emotion data

[1841] Output: Adjusted navigation information

[1842] Step 18:

[1843] Server: Sends adjusted navigation information to the device.

[1844] Specific operation: The adjusted navigation information is compiled in JSON format and sent to the device as an HTTP response.

[1845] Input: Adjusted navigation information

[1846] Output: Navigation information sent to the device

[1847] Step 19:

[1848] Device: Notify user of adjusted navigation information.

[1849] What it does: Display adjusted navigation information on the HUD or provide audio guidance.

[1850] Input: Adjusted navigation information

[1851] Output: Adjusted navigation information provided to the user

[1852] (Application example 2)

[1853] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1854] In large stations and crowded areas, users often get lost when trying to find their destination, which can lead to stress and anxiety. Existing navigation systems lack consideration for the user's emotional state, resulting in a poor user experience. Furthermore, they lack detailed directions and guidance for rest stops, and navigation information can be overly complex, increasing anxiety. There is a need for a navigation system that can solve these issues and enable users to travel comfortably and safely.

[1855] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for identifying user location information, a means for inputting or setting destination information, a means for calculating an optimal route between the current location and the destination, a wearable device for providing navigation information to the user based on the calculated optimal route, a means for recalculating the route and providing revised navigation information when the user's location changes, and an emotion recognition engine for detecting the user's emotional state and adjusting the navigation information. This reduces the anxiety and stress the user feels during navigation, enabling the user to travel comfortably and with peace of mind.

[1856] "Means for identifying the user's location information" refers to technology that uses GPS sensors and beacon systems to obtain the user's current location in real time.

[1857] "Means for inputting or setting destination information" refers to technology that allows users to specify a destination through voice input or text input.

[1858] The "server device that calculates the optimal route between the current location and the destination" is a server that uses map information and algorithms to calculate the most efficient route from the user's current location to the destination.

[1859] "Wearable devices that provide users with navigation information based on calculated optimal routes" refers to eyeglasses or earphones that provide users with visual or audio guidance based on calculated route information.

[1860] "Means for recalculating the route and providing revised navigation information when the user's location changes" refers to technology for recalculating a new route and providing that information when the user deviates from the planned route.

[1861] The "emotion recognition engine that detects the user's emotional state and adjusts navigation information" is a technology that analyzes the user's facial expressions, heart rate, tone of voice, etc. to determine their emotional state and changes the navigation information based on that.

[1862] This invention is a navigation system that helps users avoid losing track of their destination in large shopping malls, crowded train stations, large commercial facilities, and other locations. The system provides a means for accurately acquiring the user's location information and setting the destination. It also utilizes a server device that calculates the optimal route between the user's current location and the destination, and a wearable device that provides navigation information based on the calculated optimal route. Furthermore, if the user takes a wrong turn, the system has the function of recalculating the route and providing corrected navigation information. Furthermore, by incorporating an emotion recognition engine, the system can detect the user's emotional state and adjust the navigation information accordingly.

[1863] First, the user puts on the glasses or earphones provided by the device and launches the navigation application. The device uses the built-in GPS sensor or beacon system to identify the user's current location and sends that location information to the server. The user then sets their destination within the app using voice or text input. This destination information is also sent to the server.

[1864] The server calculates the optimal route based on the received location and destination information and sends the results to the device in real time. The device then provides the received navigation information visually on glasses and audibly on earphones. If the user follows the guidance but accidentally goes in the wrong direction, the device will send updated location information to the server again. The server will then recalculate based on the new location information and send the revised navigation information to the device.

[1865] The emotion recognition engine detects the user's facial expressions, tone of voice, heart rate, etc. and analyzes the data to recognize the user's emotional state. This emotional state data is also sent to the server, which then adjusts the navigation information according to the user's emotions. For example, if the user is feeling anxious or stressed, the server will suggest detailed route directions and appropriate rest stops.

[1866] Specifically, consider a scenario in which a user is searching for a specific store in a shopping mall. The user inputs their destination using the eyeglasses, and navigation begins. The device tracks the user's location in real time and provides the optimal route. If the user takes a wrong turn along the way, the server recalculates a new route based on the updated location information and provides revised guidance.

[1867] At the same time, the emotion recognition engine detects the user's facial expressions and heart rate, and if it determines that the user is feeling anxious, the server provides detailed route guidance and suggests rest points. For example, the server might say, "You seem a little anxious right now. There is a rest area around the next corner, so why not take a break?" In this way, the navigation system allows users to reach their destination comfortably and with peace of mind.

[1868] An example of a prompt is as follows:

[1869] "Create a navigation app that provides the best route to help users find the store they're looking for, and adapts the navigation based on the user's emotional state."

[1870] This system will significantly improve users' navigation experience and support safe and comfortable travel.

[1871] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1872] Step 1:

[1873] The user puts on the glasses or earphones and launches the navigation application. The user specifies the destination by voice or text input. The input is analyzed by a speech recognition engine or text analysis engine, and the destination information is extracted. The extracted destination information is packetized in JSON format and sent to the server.

[1874] Step 2:

[1875] The device uses the built-in GPS sensor or beacon system to determine the user's current location. The acquired latitude and longitude information of the current location is compiled into a data packet and sent to the server as an HTTP POST request. The input data is obtained from the GPS sensor or beacon, and the output data is the user's current location information.

[1876] Step 3:

[1877] The server receives the user's current location and destination information and calculates the optimal route based on that. The server retrieves map information from a database and derives the optimal route using a route calculation algorithm such as Dijkstra's algorithm. The input data are the current location and destination information, and the output data is the calculated optimal route.

[1878] Step 4:

[1879] The server sends the calculated route information to the terminal in real time. The sent data is encoded as a JSON format packet and sent to the terminal as an HTTP response. The input data is the optimal route information, and the output data is navigation data.

[1880] Step 5:

[1881] The device analyzes the received navigation data and guides the user visually in the case of glasses-type devices and audibly in the case of earphone-type devices. Specifically, arrows and distance information are overlaid on the HUD of the glasses-type device, and the direction and distance are guided to the user audibly in the case of earphone-type devices. The input data is the navigation data received from the server, and the output data is the visual or audible guidance.

[1882] Step 6:

[1883] The user follows the device's guidance, but may accidentally go in the wrong direction. When this happens, the device reconfirms its current location using the GPS sensor or beacon system. The new location information is again sent to the server. The input data is the updated location information, and the output data is the new location information.

[1884] Step 7:

[1885] The server receives the new location information and recalculates the optimal route. The server reacquires map information and uses a route calculation algorithm to derive a new route. The newly calculated route information is again sent to the device. The input data is the new location information, and the output data is the revised route information.

[1886] Step 8:

[1887] The device analyzes the revised navigation information and provides the user with visual and audio guidance again. The HUD displays updated arrows and distance information, and the earphone device provides audio guidance with the new direction and distance. The input data is the revised navigation data, and the output data is the updated guidance.

[1888] Step 9:

[1889] The device uses an emotion recognition engine to detect the user's facial expressions, tone of voice, heart rate, etc. It analyzes this data to recognize the user's emotional state and sends that information to the server. The input data is emotional data obtained from the camera, microphone, and heart rate sensor, and the output data is the recognized emotional state.

[1890] Step 10:

[1891] Based on the received emotional state, the server adjusts navigation information to alleviate the user's anxiety and stress. This adjustment includes detailed route guidance and suggestions for rest stops. The adjusted navigation information is then sent back to the device. The input data is the recognized emotional state, and the output data is the adjusted navigation information.

[1892] Step 11:

[1893] The device analyzes the adjusted navigation information and provides visual or audio guidance to the user. For example, the device may provide guidance such as, "Turn right at the next corner and there is a rest area. Please take a break." The input data is the adjusted navigation data, and the output data is the visual or audio guidance.

[1894] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1895] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1896] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1897] [Fourth embodiment]

[1898] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1899] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1900] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1901] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1902] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1903] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1904] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1905] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1906] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1907] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1908] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1909] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1910] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1911] The present invention is a navigation system that helps users avoid getting lost in large train stations and other crowded places. This system identifies the user's current location, calculates the optimal route to the destination, and provides navigation information in real time. The program processing flow of this system is explained in detail below.

[1912] Program processing flow

[1913] Getting the user's current location

[1914] 1. User: Puts on the eyeglasses or earbuds and launches the navigation app.

[1915] When the app is launched, the device prepares to obtain its location information.

[1916] 2. Device: Determines current location using built-in GPS sensor or beacon.

[1917] The GPS sensor is activated to obtain latitude and longitude information, and if a beacon is available, its signal is detected and used as supplemental information.

[1918] 3. Device: Sends the acquired location information to the server.

[1919] The location information is packetized and sent to the server as an HTTP POST request.

[1920] Setting a destination

[1921] 4. User: Set a destination in the app by voice or text input.

[1922] For example, you can say "Shinjuku Station Southeast Exit" or enter it into the text form.

[1923] 5. Terminal: Sends destination information to the server.

[1924] The destination information is formatted and sent to the server.

[1925] Calculating the best route

[1926] 6. Server: Obtains current location and destination information and calculates the optimal route.

[1927] The server retrieves map information from a database and uses an algorithm (e.g., Dijkstra algorithm) to calculate the optimal route.

[1928] 7. Server: Sends the calculation results to the terminal in real time.

[1929] The calculated route information is packetized in JSON format and sent to the terminal.

[1930] Providing navigation information

[1931] 8. Terminal: The received navigation information is displayed to the user (glasses-type device) or guided by voice (earphone-type device).

[1932] In the case of glasses-type devices, arrows and distance information are displayed on the HUD, while in the case of earphone-type devices, direction and distance are guided by voice.

[1933] 9. User: Follow the device's directions to your destination.

[1934] Real-time route corrections

[1935] 10. Terminal: If the user takes a wrong turn, it sends that information to the server.

[1936] A new location is obtained and retransmitted to the server.

[1937] 11. Server: Recalculate the route based on the new location information and send the revised navigation information to the device.

[1938] Recalculate the optimal route from the new location information and send the revised route.

[1939] 12. Terminal: Display or audibly notify the user of the revised navigation information.

[1940] The glasses-type device displays the corrected route on the HUD, while the earphone-type device provides voice guidance such as "Go back 50 meters and turn left."

[1941] Specific examples

[1942] Meeting scenario at Shinjuku Station

[1943] 1. User: I am meeting a friend at Shinjuku Station and am using the glasses.

[1944] 2. User: Launch the app on the glasses-type device and voice-input "Southeast Exit" as the destination.

[1945] 3. Device: Detects current location using GPS sensor and sends that information to the server.

[1946] 4. Server: Calculates the optimal route between the current location and the destination "Southeast Exit" and sends it to the eyeglasses.

[1947] 5. Terminal: Displays arrows and distance information on the HUD to instruct the user on which direction to go.

[1948] 6. User: Follows instructions but accidentally goes in the wrong direction.

[1949] 7. Device: Resends updated location to server.

[1950] 8. Server: Recalculate the route based on the new position and send the corrected route.

[1951] 9. Terminal: Display the corrected route on the HUD and guide the user in the right direction.

[1952] 10. User: Proceed in the correct direction and arrive safely at the "Southeast Exit".

[1953] This series of processes allows users to reach their destination safely and efficiently, even in large stations and crowded places. This invention reduces the chances of getting lost or missing meeting places, and reduces stress and anxiety for users.

[1954] The processing flow will be explained below.

[1955] Step 1:

[1956] User: Puts on the glasses or earbuds and launches a navigation app.

[1957] Action: The user taps on the app to launch it.

[1958] Step 2:

[1959] Device: Determines current location using built-in GPS sensor or beacon.

[1960] Action: The GPS sensor is activated to obtain the current latitude and longitude coordinates, and if available, to detect beacon signals to supplement the location.

[1961] Step 3:

[1962] Device: Sends the acquired location information to the server.

[1963] Action: Packet location data (latitude and longitude) and send an HTTP POST request to the server.

[1964] Step 4:

[1965] User: Set a destination by voice or text input within the app.

[1966] Action: Say "Shinjuku Station Southeast Exit" or type it into the text field.

[1967] Step 5:

[1968] Terminal: Sends destination information to the server.

[1969] Action: Format the destination data and send it to the server as an HTTP POST request.

[1970] Step 6:

[1971] Server: Obtains the user's current location and destination information and calculates the optimal route.

[1972] Action: The server retrieves map information from the database and calculates the optimal route using an algorithm (e.g., Dijkstra algorithm).

[1973] Step 7:

[1974] Server: Sends the calculation results to the terminal in real time.

[1975] Action: Packet the coordinate data of the optimal route in JSON format and send it to the device as an HTTP response.

[1976] Step 8:

[1977] Terminal: Provides the received navigation information to the user visually or audibly.

[1978] Action: Display arrows and distance information on the HUD (glasses) or provide audio guidance of direction and distance (earbuds).

[1979] Step 9:

[1980] User: Follow the device's directions to reach your destination.

[1981] Action: Follow the arrows and audio prompts.

[1982] Step 10:

[1983] Terminal: If the user takes a wrong turn, the sensor detects it and sends the information to the server.

[1984] Action: The GPS sensor gets an updated location and sends it back to the server.

[1985] Step 11:

[1986] Server: Recalculates the route based on the new location information and sends the revised navigation information to the device.

[1987] Action: Recalculate the optimal route based on the new location information and send the revised route data in JSON format to the device.

[1988] Step 12:

[1989] On the device: Display or audibly notify the user of the revised navigation information.

[1990] Action: Display corrected arrow on HUD or voice prompt "Go back 50 meters and then right again."

[1991] Step 13:

[1992] User: Follows the revised directions and proceeds to the destination.

[1993] Action: Correct the mistake and move in the right direction.

[1994] Example 1

[1995] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1996] In large stations and crowded areas, it is difficult for users to reach their destination efficiently without getting lost. This can cause users anxiety and stress. Furthermore, there is a lack of navigation systems that can respond to real-time location changes, making it difficult to correct a route once it has been set. There is a need for a system that can solve these problems and provide users with a comfortable journey.

[1997] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1998] In this invention, the server includes means for acquiring user location information, means for inputting or setting destination information, means for calculating the optimum route between the acquired current location and the set destination, means for providing guidance information to the user based on the calculated optimum route, and means for recalculating the route and providing revised guidance information when the user's location changes, thereby enabling the user to reach their destination efficiently without getting lost even in large stations or crowded places.

[1999] "User" refers to a person who uses this system to obtain location information and set a destination.

[2000] "Means of obtaining location information" refers to devices or technologies for measuring a user's current location, specifically devices that use GPS sensors or beacons.

[2001] "Means for inputting or setting destination information" refers to an interface or device that allows a user to specify the location they want to go to, specifically a device for voice input or text input.

[2002] "Computing device" refers to the device or technology, specifically the server, that calculates the optimal route based on the user's current location and destination information.

[2003] The term "display device" refers to a device for providing visual guidance information to a user, specifically, a glasses-type device.

[2004] "Audio output device" refers to a device that provides guidance information to users by voice, specifically an earphone-type device.

[2005] "Re-route means" refers to the technology or algorithm used to recalculate a new, optimal route from the user's current location to the destination if the user's location changes.

[2006] "Guidance information" refers to information about the direction and distance a user needs to reach their destination.

[2007] "Real-time" refers to updating and providing information immediately when a user's location information changes.

[2008] The present invention relates to a navigation system that helps users avoid getting lost in large train stations and other crowded places. The system identifies the user's current location, calculates the optimal route to the destination, and provides real-time navigation information.

[2009] System configuration

[2010] The system consists of the following main components:

[2011] 1. User terminal: Glasses-type device or earphone-type device.

[2012] 2. Server: Performs route calculation and data management.

[2013] 3. Network: The communications infrastructure that connects user devices and servers.

[2014] Hardware and Software Examples

[2015] User device:

[2016] User terminals are glasses-type devices (e.g., smart glasses) with built-in GPS sensors or earphone-type devices (e.g., smart earphones) with voice guidance functions.

[2017] These devices use dedicated applications that run on operating systems such as Android and iOS.

[2018] server:

[2019] The server is installed with a database management system (e.g., MySQL) and software for executing a route calculation algorithm (e.g., Dijkstra's algorithm).

[2020] The server communicates with the user terminal using the HTTP protocol.

[2021] network:

[2022] Data is exchanged between the user terminal and the server using the Internet or a dedicated local network.

[2023] Data processing and calculation

[2024] User device: Uses a GPS sensor and beacon receiver to measure the current location and send that location information to the server. It also organizes destination information specified by the user and sends it to the server.

[2025] Server: Based on the received location and destination information, retrieves map data from the database, calculates the optimal route using a route calculation algorithm, and sends the calculation results to the user's device in real time.

[2026] Example of processing flow

[2027] Example 1: Meeting scenario at Shinjuku Station

[2028] 1. A user uses the eyeglasses to meet a friend at Shinjuku Station.

[2029] 2. The user launches the app on their device and voice-inputs "Southeast Exit" as their destination.

[2030] 3. The device determines its current location using its built-in GPS sensor and sends that information to the server.

[2031] 4. The server calculates the optimal route based on the received location information and the destination information, "Southeast Exit," and sends the results to the eyeglasses.

[2032] 5. The device displays arrows and distance information on the HUD to instruct the user on which direction to go.

[2033] 6. Users follow instructions but sometimes accidentally go in the wrong direction.

[2034] 7. The device obtains new location information and retransmits it to the server.

[2035] 8. The server recalculates the route based on the new location information and sends the revised route to the user device.

[2036] 9. The device displays the corrected route on the HUD and guides the user in the correct direction.

[2037] Examples of prompt statements

[2038] The following prompts can be used for speech or text input:

[2039] 1. "Please take me to the southeast exit of Shinjuku Station."

[2040] 2. "Please set a new destination. Southeast Exit."

[2041] 3. "What is the best route from my current location to my destination?"

[2042] This invention allows users to reach their destination efficiently without getting lost even in large stations or crowded places. This system reduces the chances of getting lost or missing meeting places, and reduces stress and anxiety for users.

[2043] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2044] Step 1:

[2045] The user turns on the eyeglasses or earphones.

[2046] Specific behavior: User turns on the device and opens the navigation app.

[2047] Input: User actions (device launch and app launch).

[2048] Output: The device is initialized and ready to acquire location information.

[2049] Step 2:

[2050] The device activates the GPS sensor and beacon to determine its current location.

[2051] Specific operation: The GPS sensor inside the device is activated, and the device captures surrounding beacon signals.

[2052] Input: Device location sensors (GPS and beacons).

[2053] Output: Latitude and longitude information and signal information from the beacon.

[2054] Step 3:

[2055] The location information acquired by the device is sent to the server.

[2056] Specific operation: The location information is converted into JSON format and sent to the server as an HTTP POST request.

[2057] Input: Latitude and longitude information and beacon signal data.

[2058] Output: Confirmation of sending location information to the server.

[2059] Step 4:

[2060] The user sets the destination by voice or text input.

[2061] Specific operation: The user specifies a destination using the device's input interface (microphone or keyboard). For example, the user enters "Shinjuku Station Southeast Exit."

[2062] Input: User speaks or texts destination.

[2063] Output: Destination information confirmed and set.

[2064] Step 5:

[2065] The terminal transmits the destination information to the server.

[2066] Specific operation: The input destination information is formatted, converted into JSON format, and sent to the server.

[2067] Input: Destination text or audio data.

[2068] Output: Confirmation of sending destination information to the server.

[2069] Step 6:

[2070] The server obtains information about the current location and destination and calculates the optimal route.

[2071] Specific operation: The server retrieves map information from the database and calculates the optimal route using a route calculation algorithm (e.g., Dijkstra algorithm).

[2072] Input: User's current location and destination information.

[2073] Output: Calculated optimal route data.

[2074] Step 7:

[2075] The server sends the calculation results to the terminal in real time.

[2076] Specific operation: The calculated route information is packetized in JSON format and sent to the terminal as an HTTP response.

[2077] Input: Optimal route data calculated by the server.

[2078] Output: Confirmation of sending route information to the device.

[2079] Step 8:

[2080] The navigation information received by the device is displayed or audibly provided to the user.

[2081] Specific operation: For glasses-type devices, arrows and distance information will be displayed on the HUD. For earphone-type devices, voice guidance will be provided.

[2082] Input: Route information received from the server.

[2083] Output: Providing visual or audio guidance to the user.

[2084] Step 9:

[2085] The user follows the navigation information.

[2086] Specific operation: The user follows the guidance of the glasses-type device or earphone-type device to move in the direction they should go.

[2087] Input: Guidance information from the terminal.

[2088] Output: The user follows the route provided.

[2089] Step 10:

[2090] If the device changes the user's location, it sends it back to the server.

[2091] Specific behavior: If the user deviates from the specified route, obtain new location information and resend it to the server.

[2092] Input: Updated location information.

[2093] Output: Confirmation of sending new location to server.

[2094] Step 11:

[2095] The server recalculates the route based on the new location information and sends the revised navigation information to the device.

[2096] Specific operation: The optimal route is recalculated based on the new location information, and the revised route information is packetized in JSON format and sent to the terminal.

[2097] Input: New location.

[2098] Output: Confirmation of sending corrected route information.

[2099] Step 12:

[2100] The device will display or audibly notify the user of the revised navigation information.

[2101] Specific operation: In the case of glasses-type devices, the revised route will be displayed on the HUD, and in the case of earphone-type devices, voice guidance will be given, such as "Go back 50 meters and turn left."

[2102] Input: The modified route information received from the server.

[2103] Output: Providing visual or audio correction guidance to the user.

[2104] (Application example 1)

[2105] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2106] Conventional navigation systems have limitations when it comes to navigating large stations and crowded areas. In particular, in businesses like food delivery, it is important to reach your destination efficiently, but it is difficult to flexibly change routes to take real-time traffic information into account. Furthermore, there are limited ways to provide navigation information, leaving delivery drivers with few intuitive and easy-to-understand directions.

[2107] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2108] In this invention, the server includes means for acquiring user location information and providing an optimal route to support the delivery driver's work, means for dynamically correcting the route by reflecting real-time traffic information, and means for providing navigation information to the device. This allows the delivery driver to receive optimal route information in real time and flexibly change the route according to traffic conditions, enabling efficient and effective delivery.

[2109] "Means of identifying the user's location"

[2110] It is a technology that uses sensors such as GPS and beacons to accurately detect the user's current location.

[2111] "Method for entering or setting destination information"

[2112] is a technology that allows users to specify navigation destinations to applications through voice or text input.

[2113] "Server device for calculating optimal routes"

[2114] is a computer system that uses an algorithm (e.g., Dijkstra algorithm or A) to calculate the shortest or fastest route based on the user's current location and destination.

[2115] "Eyeglasses-type device that provides navigation information"

[2116] is a wearable device that has a visual display and overlays navigation instructions into the user's field of view.

[2117] "Earphone-type device that provides navigation information"

[2118] is a wearable device that can provide navigation information to users via voice.

[2119] "Real-time traffic information"

[2120] This is road condition data that is updated instantly, including current traffic conditions, congestion, and accident information.

[2121] "Means for dynamically correcting routes"

[2122] This is a technology that takes real-time traffic information into account to recalculate the optimal route and provide it to the user.

[2123] "A means of providing optimal routes to support delivery drivers' work"

[2124] This is a technology that calculates and guides delivery drivers to the optimal delivery route to reach their destination efficiently and quickly.

[2125] The present invention is a system that identifies a user's current location, calculates the optimal route to a destination, and provides navigation information in real time, and is particularly used to improve the efficiency of food delivery operations.

[2126] 1. Obtaining user location information

[2127] The server uses the GPS sensor built into the delivery driver's smartphone to accurately determine the driver's current location (latitude and longitude). This GPS sensor sends the driver's location information to the server in real time. For example, the server can obtain location information using the smartphone's location information service.

[2128] 2. Setting destination information

[2129] The user sets the destination address of the customer on their smartphone using voice recognition or text input. Voice recognition technology can use the Google Voice Recognition API or a voice interface provided by the requester. The set address is sent to the server and used as the destination information for navigation.

[2130] 3. Calculating the optimal route

[2131] The server receives the user's current location and destination information to calculate the optimal route for navigation. The calculation uses Dijkstra's algorithm or A algorithm, which are executed on the server. The calculation results are sent to the user's smartphone or smart glasses in real time.

[2132] 4. Providing navigation information

[2133] The device provides the user with the optimal route information received from the server. In the case of a smartphone, the route map and direction instructions are displayed on the screen. In addition, if smart glasses are used, navigation information is overlaid on the HUD (Heads-Up Display). In the case of earphone-type devices, navigation information such as direction and distance is provided by voice.

[2134] 5. Real-time route correction

[2135] If road conditions change while the user is traveling, such as when traffic jams or an accident occurs, new location information is sent to the server. The server then recalculates the optimal route based on this information and sends the revised route information to the device in real time. This allows the user to navigate efficiently based on the latest information.

[2136] Specific hardware and software to be used

[2137] Smartphone: GPS sensor, location information services

[2138] Server: High performance server (Python, Node.js, PostgreSQL)

[2139] Glasses-type device: HUD (Heads-Up Display)

[2140] Earphone-type devices: Audio output technology

[2141] Example scenario

[2142] Consider a scenario where a user is working as a food delivery driver near Shinjuku Station. The delivery driver launches a smartphone app and uses the GPS sensor to determine their current location. They then voice-enter the customer's address and set it as their destination. The server calculates the optimal route based on their current location and destination information and sends it to the smartphone in real time. The driver then follows the navigation information displayed on the smartphone or smart glasses. If traffic congestion occurs along the way, new location information is sent to the server and the route is recalculated. The revised route information is then provided to the driver in real time.

[2143] Prompt Sentence Examples

[2144] What is the algorithm of the food delivery app that calculates the optimal route from Shinjuku Station to the customer's address and adjusts the route in real time to reflect current traffic information? Please also provide a detailed explanation of the technologies used (GPS, voice recognition, navigation, real-time updates).

[2145] In this way, the present invention can significantly improve the efficiency of delivery drivers by combining user location information with real-time traffic information.

[2146] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2147] Step 1:

[2148] When a user launches a smartphone app, the app uses the GPS sensor to obtain the user's current location (latitude and longitude).

[2149] Input: Smartphone app launch, GPS sensor data

[2150] Output: Current location (latitude and longitude) data

[2151] Specific behavior: Uses the smartphone's location services to call APIs such as locationManager.getLastKnownLocation() to obtain the coordinates of the current location.

[2152] Step 2:

[2153] The user sets the destination information (customer's address) through voice recognition or text input.

[2154] Input: Voice or text input data

[2155] Output: Destination information (address)

[2156] Specific operation: In the case of voice input, the user's destination is obtained using the Google Voice Recognition API, and in the case of text input, the destination is obtained using an input form within the app.

[2157] Step 3:

[2158] The device sends the current location and destination information to the server.

[2159] Input: Current location (latitude and longitude) data, destination information (address)

[2160] Output: HTTP POST request to the server

[2161] Specific operation: Format the current location and destination data into JSON format and send it to the server as an HTTP POST request.

[2162] Step 4:

[2163] The server calculates the optimal route based on the current location and destination information.

[2164] Input: Current location (latitude and longitude) data, destination information (address)

[2165] Output: Optimal route data (route information, distance, time, etc.)

[2166] Specific operation: The server retrieves map data from the database and calculates the optimal route using Dijkstra's algorithm or A algorithm.

[2167] Step 5:

[2168] The server sends the calculated optimal route to the terminal.

[2169] Input: Optimal route data

[2170] Output: HTTP response to the device

[2171] Specific operation: The calculated route information is packetized in JSON format and sent to the terminal as an HTTP response.

[2172] Step 6:

[2173] The terminal provides the received navigation information to the user.

[2174] Input: Optimal route data

[2175] Output: On-screen display or voice guidance

[2176] Specific operation: In the case of a smartphone, the route is displayed using a map application, in the case of smart glasses, the information is overlaid on the HUD, and in the case of earphones, voice guidance is provided.

[2177] Step 7:

[2178] The user follows the navigation.

[2179] Input: Navigation information provided by the device

[2180] Output: Tracking of travel route

[2181] Specific actions: The user follows instructions on their smartphone or smart glasses to move towards their destination.

[2182] Step 8:

[2183] The device updates the user's location information in real time and sends it to the server.

[2184] Input: Continuous GPS data

[2185] Output: Updated location information sent to the server

[2186] Specific operation: Obtain location information at regular intervals and resend it to the server.

[2187] Step 9:

[2188] The server recalculates the route based on real-time traffic information.

[2189] Input: Updated location, real-time traffic information

[2190] Output: Modified route data

[2191] Specific operation: The server recalculates the optimal route taking into account the new location information and real-time traffic information.

[2192] Step 10:

[2193] The server sends the modified route information to the terminal.

[2194] Input: Modified route data

[2195] Output: HTTP response to the device

[2196] Specific operation: The corrected route information is packetized in JSON format and sent to the terminal as an HTTP response.

[2197] Step 11:

[2198] The terminal provides the revised route information to the user.

[2199] Input: Modified route data

[2200] Output: Corrected screen display or voice guidance

[2201] Specific operation: On smartphones, the updated map information will be redisplayed, and on smart glasses or earphones, the updated information will be displayed as an overlay or announced via voice guidance.

[2202] Through the above processing steps, delivery drivers receive optimal route information in real time, enabling them to flexibly change routes according to traffic conditions, enabling them to make deliveries efficiently and effectively.

[2203] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2204] The present invention combines a navigation system that helps users avoid getting lost in large train stations and crowded places with an emotion engine that recognizes the user's emotions and adjusts navigation information based on those emotions. Specific embodiments of the present invention will be described below.

[2205] Program processing flow

[2206] Getting the user's current location

[2207] 1. User: Puts on the eyeglasses or earbuds and launches the navigation app.

[2208] Action: The user taps on the app to launch it.

[2209] 2. Device: Determines current location using built-in GPS sensor or beacon.

[2210] Action: The GPS sensor is activated to obtain the current latitude and longitude coordinates, and if available, to detect beacon signals to supplement the location.

[2211] 3. Device: Sends the acquired location information to the server.

[2212] Action: Packet location data (latitude and longitude) and send an HTTP POST request to the server.

[2213] Setting a destination

[2214] 4. User: Set a destination by voice or text input within the app.

[2215] Action: Say "Shinjuku Station Southeast Exit" or type it into the text field.

[2216] 5. Terminal: Sends destination information to the server.

[2217] Action: Format the destination data and send it to the server as an HTTP POST request.

[2218] Calculating the best route

[2219] 6. Server: Obtains the user's current location and destination information and calculates the optimal route.

[2220] Action: The server retrieves map information from the database and calculates the optimal route using an algorithm (e.g., Dijkstra algorithm).

[2221] 7. Server: Sends the calculation results to the terminal in real time.

[2222] Action: Packet the coordinate data of the optimal route in JSON format and send it to the device as an HTTP response.

[2223] Providing navigation information

[2224] 8. Terminal: Provides the received navigation information to the user visually or audibly.

[2225] Action: Display arrows and distance information on the HUD (glasses) or provide audio guidance of direction and distance (earbuds).

[2226] 9. User: Follow the device's directions to your destination.

[2227] Action: Follow the arrows and audio prompts.

[2228] Real-time route corrections

[2229] 10. Terminal: If the user takes a wrong turn, the sensor will detect it and send the information to the server.

[2230] Action: The GPS sensor gets an updated location and sends it back to the server.

[2231] 11. Server: Recalculate the route based on the new location information and send the revised navigation information to the device.

[2232] Action: Recalculate the optimal route based on the new location information and send the revised route data in JSON format to the device.

[2233] 12. Terminal: Display or audibly notify the user of the revised navigation information.

[2234] Action: Display corrected arrow on HUD or voice prompt "Go back 50 meters and then right again."

[2235] 13. User: Follow the modified directions and proceed towards your destination.

[2236] Action: Correct the mistake and move in the right direction.

[2237] Emotion Engine Processing Flow

[2238] User emotion recognition

[2239] 1. Device: The emotion engine detects the user's facial expressions, tone of voice, heart rate, etc.

[2240] Action: Collect data using devices such as cameras, microphones, and heart rate sensors.

[2241] 2. Device: Analyzes the detected data and recognizes the user's emotional state.

[2242] Action: Use machine learning models and algorithms to determine the user's emotional state from the collected data.

[2243] 3. Terminal: Sends the recognized emotional state to the server.

[2244] Action: Format the emotional state data and send it to the server as an HTTP POST request.

[2245] Adjusting navigation information

[2246] 4. Server: Based on the user's emotional state, adjust navigation information to reduce anxiety and stress.

[2247] Action: For example, make adjustments such as providing more detailed instructions, simplifying instructions, or suggesting stopovers or rest areas.

[2248] 5. Server: Sends the adjusted navigation information to the device.

[2249] Action: Packet the adjusted navigation information in JSON format and send it to the device as an HTTP response.

[2250] 6. Terminal: Providing tailored navigation information to the user visually or audibly.

[2251] Action: Display on HUD or give voice prompt.

[2252] Specific examples

[2253] Meeting scenario at Shinjuku Station

[2254] 1. User: I am meeting a friend at Shinjuku Station and am using the glasses.

[2255] 2. User: Launch the app on the glasses-type device and voice-input "Southeast Exit" as the destination.

[2256] 3. Device: Detects current location using GPS sensor and sends that information to the server.

[2257] 4. Server: Calculates the optimal route between the current location and the destination "Southeast Exit" and sends it to the eyeglasses.

[2258] 5. Terminal: Displays arrows and distance information on the HUD to instruct the user on which direction to go.

[2259] 6. User: Follows instructions but accidentally goes in the wrong direction.

[2260] 7. Device: Resends updated location to server.

[2261] 8. Server: Recalculate the route based on the new position and send the corrected route.

[2262] 9. Terminal: Display the corrected route on the HUD and guide the user in the right direction.

[2263] 10. User: Proceed in the correct direction and arrive safely at the "Southeast Exit".

[2264] 11. On the device: At the same time, the emotion engine detects the user's facial expressions and tone of voice and determines that the user is feeling anxious.

[2265] 12. Server: Provides detailed directions and suggests appropriate rest areas depending on the anxiety state.

[2266] 13. Terminal: Display the adjusted information on the HUD and guide the user by saying, "There is a rest point in 100 meters."

[2267] In this way, the present invention is a system that provides appropriate navigation information based on the user's current location and emotional state, and supports the user in reaching their destination comfortably and safely.

[2268] The processing flow will be explained below.

[2269] Step 1:

[2270] User: Puts on the glasses or earbuds and launches a navigation app.

[2271] Action: The user taps on the app to launch it.

[2272] Step 2:

[2273] Device: Determines current location using built-in GPS sensor or beacon.

[2274] Action: The GPS sensor is activated to obtain the current latitude and longitude coordinates, and if available, to detect beacon signals to supplement the location.

[2275] Step 3:

[2276] Device: Sends the acquired location information to the server.

[2277] Action: Packet location data (latitude and longitude) and send an HTTP POST request to the server.

[2278] Step 4:

[2279] User: Set a destination by voice or text input within the app.

[2280] Action: Say "Shinjuku Station Southeast Exit" or type it into the text field.

[2281] Step 5:

[2282] Terminal: Sends destination information to the server.

[2283] Action: Format the destination data and send it to the server as an HTTP POST request.

[2284] Step 6:

[2285] Server: Obtains the user's current location and destination information and calculates the optimal route.

[2286] Action: The server retrieves map information from the database and calculates the optimal route using an algorithm (e.g., Dijkstra algorithm).

[2287] Step 7:

[2288] Server: Sends the calculation results to the terminal in real time.

[2289] Action: Packet the coordinate data of the optimal route in JSON format and send it to the device as an HTTP response.

[2290] Step 8:

[2291] Terminal: Provides the received navigation information to the user visually or audibly.

[2292] Action: Display arrows and distance information on the HUD (glasses) or provide audio guidance of direction and distance (earbuds).

[2293] Step 9:

[2294] User: Follow the device's directions to reach your destination.

[2295] Action: Follow the arrows and audio prompts.

[2296] Step 10:

[2297] Terminal: If the user takes a wrong turn, the sensor detects it and sends the information to the server.

[2298] Action: The GPS sensor gets an updated location and sends it back to the server.

[2299] Step 11:

[2300] Server: Recalculates the route based on the new location information and sends the revised navigation information to the device.

[2301] Action: Recalculate the optimal route based on the new location information and send the revised route data in JSON format to the device.

[2302] Step 12:

[2303] On the device: Display or audibly notify the user of the revised navigation information.

[2304] Action: Display corrected arrow on HUD or voice prompt "Go back 50 meters and then right again."

[2305] Step 13:

[2306] Device: The emotion engine detects the user's facial expressions, tone of voice, heart rate, etc.

[2307] Action: Collect data using devices such as cameras, microphones, and heart rate sensors.

[2308] Step 14:

[2309] Device: Analyzes detected data and recognizes the user's emotional state.

[2310] Action: Use machine learning models and algorithms to determine the user's emotional state from the collected data.

[2311] Step 15:

[2312] Device: Sends the recognized emotional state to the server.

[2313] Action: Format the emotional state data and send it to the server as an HTTP POST request.

[2314] Step 16:

[2315] Server: Based on the user's emotional state, adjust navigation information to reduce anxiety and stress.

[2316] Action: For example, make adjustments such as providing more detailed instructions, simplifying instructions, or suggesting stopovers or rest areas.

[2317] Step 17:

[2318] Server: Sends adjusted navigation information to the device.

[2319] Action: Packet the adjusted navigation information in JSON format and send it to the device as an HTTP response.

[2320] Step 18:

[2321] Device: Provides tailored navigation information to the user visually or audibly.

[2322] Action: Display on HUD or give voice prompt.

[2323] Step 19:

[2324] User: Follow the tailored guidance and proceed towards your destination in a relaxed state.

[2325] Action: Follow the tailored details and rest stop suggestions to stay safe and relaxed.

[2326] Specific examples

[2327] Meeting scenario at Shinjuku Station

[2328] 1. User: I am meeting a friend at Shinjuku Station and am using the glasses.

[2329] 2. User: Launch the app on the glasses-type device and voice-input "Southeast Exit" as the destination.

[2330] 3. Device: Detects current location using GPS sensor and sends that information to the server.

[2331] 4. Server: Calculates the optimal route between the current location and the destination "Southeast Exit" and sends it to the eyeglasses.

[2332] 5. Terminal: Displays arrows and distance information on the HUD to instruct the user on which direction to go.

[2333] 6. User: Follows the arrows but accidentally goes in the wrong direction.

[2334] 7. Device: Resends updated location to server.

[2335] 8. Server: Recalculate the route based on the new position and send the corrected route.

[2336] 9. Terminal: Display the corrected route on the HUD and guide the user in the right direction.

[2337] 10. User: Proceed in the correct direction and arrive safely at the "Southeast Exit".

[2338] 11. On the device: At the same time, the emotion engine detects the user's facial expressions and tone of voice to analyze the user's emotional state.

[2339] 12. Device: If it determines that the user is feeling anxious, it sends emotional data to the server.

[2340] 13. Server: Responds to anxiety states and adjusts navigation information to provide detailed directions and suggest appropriate rest stops.

[2341] 14. Server: Sends the adjusted navigation information to the device.

[2342] 15. Terminal: Display the adjusted information on the HUD and guide the user by saying, "There is a rest point in 100 meters."

[2343] 16. User: Follow the suggestions and proceed to your destination in a relaxed state.

[2344] Example 2

[2345] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2346] While navigation systems exist to help users reach their destinations in large stations and crowded areas without getting lost, they often cause anxiety and stress. Furthermore, they lack optimal route guidance with real-time location correction, and navigation information tailored to the user's emotional state is not provided. This makes it difficult for users to reach their destination comfortably. The present invention aims to solve these problems.

[2347] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2348] In this invention, the server includes a means for identifying the user's location information, a means for inputting or setting destination information, an information processing device for calculating the optimal route between the current location and the destination, a visual display device or an audio output device for providing the user with navigation information based on the calculated optimal route, a means for recalculating the route and providing revised navigation information when the user's location changes, and a means for detecting the user's emotions and adjusting the navigation information based on the emotions. This allows the user to receive optimal route guidance including real-time location corrections, and the provision of navigation information according to the user's emotional state, enabling the user to reach the destination comfortably and safely.

[2349] "Means for identifying a user's location information" refers to technology that measures a user's current location using location measurement devices such as GPS sensors and beacons.

[2350] "Means for inputting or setting destination information" refers to technology that allows a user to specify a destination by voice input or text input via a device.

[2351] An "information processing device that calculates the optimal route between the current location and the destination" is a server or computer system equipped with an algorithm for calculating the optimal route based on the user's current location and the set destination.

[2352] "Visual display devices or audio output devices that provide navigation information to users based on the calculated optimal route" refers to devices such as head-up displays (HUDs) that display visual information to users and earphones that provide audio guidance.

[2353] "Means for recalculating routes and providing revised navigation information when the user's location changes" refers to technology that recalculates routes based on new location information when the user's location changes, and provides the results to the user's device in real time.

[2354] "Means for detecting the user's emotions and adjusting navigation information based on those emotions" refers to a technology that analyzes the user's facial expressions, tone of voice, heart rate, etc. to recognize their emotional state, and then adjusts and provides navigation information based on the results.

[2355] The present invention combines a navigation system that helps users avoid getting lost in large train stations and crowded places with an emotion engine that recognizes the user's emotions and adjusts navigation information based on those emotions. Specific embodiments of the present invention will be described below.

[2356] This system uses GPS sensors and beacons to identify the user's location. When the user wears the glasses or earphones and launches a navigation app, the device uses the built-in GPS sensor and surrounding beacon signals to identify the user's current location. The identified location information is sent from the device to the server via an HTTP POST request.

[2357] Next, the user sets their destination within the app by voice or text input. For example, the user can say "Shinjuku Station Southeast Exit" or enter the destination information in a text field. The device formats this destination data and sends it to the server.

[2358] The server receives the user's current location and destination information and calculates the optimal route. The server calculates the shortest route using algorithms such as Dijkstra's algorithm and sends the results in JSON format to the device. Based on the calculated optimal route, the device provides navigation information to the user using the HUD on the glasses or the voice guidance function on the earphones. For example, voice guidance such as "Go straight for 200 meters" or arrows are displayed.

[2359] If the user takes a wrong turn while following the directions, the device will send new location information to the server. The server will recalculate the route based on the new location and send the revised route data in JSON format to the device. The revised navigation information will be notified to the user again via HUD and voice.

[2360] Furthermore, the device uses an emotion engine to detect and analyze the user's facial expressions, tone of voice, heart rate, etc. to recognize the user's emotional state. For example, if the user is feeling anxious, the emotion engine will determine this. The recognized emotional state is sent to the server, which then adjusts the navigation information based on the emotional state. For example, it may provide more detailed instructions or suggest appropriate rest areas. The adjusted navigation information is then sent to the device, where it provides visual or audio guidance to the user. For example, it may display a message such as, "There is a rest point 100 meters further."

[2361] Specific examples

[2362] At Shinjuku Station, the user uses the glasses-type device to set the destination as the Southeast Exit using voice commands.

[2363] The GPS sensor detects the user's current location and sends that information to the server.

[2364] The server calculates the optimal route and sends it to the eyeglasses-type device.

[2365] The HUD displays arrows and distance information to guide the user in the direction they should go.

[2366] If the device takes a wrong turn, it resends updated location information to the server, which then recalculates the route and sends the revised route to the device.

[2367] Prompt Sentence Examples

[2368] "I want to go to the southeast exit of Shinjuku Station."

[2369] "Set destination as Southeast Exit"

[2370] "The emotion engine detected your anxiety."

[2371] "Please provide detailed route directions."

[2372] In this way, the present invention is a system that provides appropriate navigation information based on the user's current location and emotional state, and supports the user in reaching their destination comfortably and safely.

[2373] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2374] Program processing flow

[2375] Get current location

[2376] Step 1:

[2377] User: Puts on the glasses or earbuds and launches a navigation app.

[2378] What happens: A user taps the screen of their smart device to launch a navigation app.

[2379] Input: User action

[2380] Output: App launch

[2381] Step 2:

[2382] Device: Determines current location using built-in GPS sensor and beacons.

[2383] Specific operation: The device's GPS sensor is turned on, and the current latitude and longitude information is obtained, and the surrounding beacon signals are detected to supplement the location information.

[2384] Input: GPS sensor / beacon signal

[2385] Output: Latitude and longitude information of current location

[2386] Step 3:

[2387] Device: Sends the acquired location information to the server.

[2388] Specific operation: Location data including latitude and longitude information is packaged into a packet and sent to the server as an HTTP POST request.

[2389] Input: Latitude and longitude information of current location

[2390] Output: Location data sent to the server

[2391] Setting a destination

[2392] Step 4:

[2393] User: Set a destination in the app by voice or text input.

[2394] Specific behavior: The user speaks "Shinjuku Station Southeast Exit" into the microphone or uses the keyboard to enter the destination information into the text field.

[2395] Input: Voice or text input

[2396] Output: Destination information

[2397] Step 5:

[2398] Terminal: Sends destination information to the server.

[2399] Specific behavior: Formats the destination data and sends it to the server as an HTTP POST request.

[2400] Input: Destination information

[2401] Output: Destination data sent to the server

[2402] Calculating the best route

[2403] Step 6:

[2404] Server: Receives the user's current location and destination information and calculates the optimal route.

[2405] Specific operation: The server retrieves map information from the database and calculates the shortest route using an algorithm such as Dijkstra's algorithm.

[2406] Input: Current location and destination information

[2407] Output: Optimal route information

[2408] Step 7:

[2409] Server: Sends the calculation results to the terminal in real time.

[2410] Specific operation: The coordinate data of the optimal route is compiled into a packet in JSON format and sent to the terminal as an HTTP response.

[2411] Input: Optimal route information

[2412] Output: Route data sent to the device

[2413] Providing navigation information

[2414] Step 8:

[2415] Device: Notifies the user of the navigation information received.

[2416] Specific operation: Arrows and distance information are displayed on the HUD of the glasses-type device, or voice guidance is provided through the earphone-type device.

[2417] Input: Route data

[2418] Output: Navigation information provided to the user

[2419] Step 9:

[2420] User: Follow the device's directions to reach your destination.

[2421] Specific action: The user walks according to the device's instructions.

[2422] Input: Navigation information

[2423] Output: User Move

[2424] Real-time route corrections

[2425] Step 10:

[2426] Terminal: If the user takes a wrong turn, it sends that information to the server.

[2427] What happens: The GPS sensor gets an updated location and sends it back to the server.

[2428] Input: Updated location

[2429] Output: New location data sent to the server.

[2430] Step 11:

[2431] Server: Recalculates the route based on the new location information and sends the revised navigation information to the device.

[2432] Specific operation: The server recalculates the optimal route based on the new location information and sends the revised route data in JSON format to the device.

[2433] Input: New location

[2434] Output: Modified route data

[2435] Step 12:

[2436] Device: Notify the user of the revised navigation information.

[2437] What it does: Display the corrected arrow on the HUD or hear a voice prompt saying "Go back 50 meters and turn right again."

[2438] Input: Modified route data

[2439] Output: Corrected navigation information provided to the user

[2440] Step 13:

[2441] User: Follow the corrected directions to proceed to the destination.

[2442] Specific behavior: The user follows the new instructions.

[2443] Input: Corrected navigation information

[2444] Output: User Move

[2445] User emotion recognition

[2446] Step 14:

[2447] On the device: The emotion engine detects the user's facial expressions, tone of voice, and heart rate.

[2448] Specific operations: Collect data using a camera, microphone, and heart rate sensor.

[2449] Input: facial expression data, voice tone, heart rate

[2450] Output: Detected emotion data

[2451] Step 15:

[2452] Device: Analyzes detected data and recognizes the user's emotional state.

[2453] What it does: It uses machine learning models and algorithms to analyze collected data and determine emotional states.

[2454] Input: Detected emotion data

[2455] Output: Perceived emotional state

[2456] Step 16:

[2457] Device: Sends the recognized emotional state to the server.

[2458] What it does: Formats emotional state data and sends it to the server as an HTTP POST request.

[2459] Input: Perceived emotional state

[2460] Output: Emotion data sent to the server

[2461] Adjusting navigation information

[2462] Step 17:

[2463] Server: Adjust navigation information based on emotional state.

[2464] Specific actions: The server adjusts depending on the emotional state, such as increasing detailed instructions, changing instructions to simpler ones, or suggesting relay points or rest areas.

[2465] Input: Emotion data

[2466] Output: Adjusted navigation information

[2467] Step 18:

[2468] Server: Sends adjusted navigation information to the device.

[2469] Specific operation: The adjusted navigation information is compiled in JSON format and sent to the device as an HTTP response.

[2470] Input: Adjusted navigation information

[2471] Output: Navigation information sent to the device

[2472] Step 19:

[2473] Device: Notify user of adjusted navigation information.

[2474] What it does: Display adjusted navigation information on the HUD or provide audio guidance.

[2475] Input: Adjusted navigation information

[2476] Output: Adjusted navigation information provided to the user

[2477] (Application example 2)

[2478] Next, a description will be given of Application Example 2. In the following description, the ...

Claims

1. a means for determining the user's location; a means for inputting or setting destination information; a server device that calculates an optimal route between a current location and a destination; a glasses-type device or earphone-type device that provides navigation information to a user based on a calculated optimal route; means for recalculating the route and providing revised navigation information if the user's location changes; A system including:

2. 10. The system of claim 1, wherein the system transmits the user's location information to a server, and the server transmits a recalculated route to the user's device in real time to provide real-time navigation information.

3. The system according to claim 1 , wherein the device is a glasses-type device that displays navigation information as an overlay in the user's field of vision, or an earphone-type device that provides navigation information by voice.

Images